INFO: Started server process [1] INFO: Waiting for application startup. INFO: Application startup complete. INFO: Uvicorn running on http://0.0.0.0:8000 (Press CTRL+C to quit) INFO: 172.21.0.1:52656 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51996 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40708 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34112 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60910 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37010 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37026 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:37042 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49292 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51206 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41726 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36852 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54996 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42844 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42852 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:42862 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33356 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43878 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59236 - "GET / HTTP/1.0" 200 OK 2026-03-13 08:15:50,538 - lava_callback - INFO - Received callback for node 69b124a79d191758182539f4 2026-03-13 08:15:50,545 - lava_callback - INFO - Starting async job submit for node 69b124a79d191758182539f4 INFO: 172.21.0.1:57736 - "POST /node/69b124a79d191758182539f4 HTTP/1.0" 202 Accepted 2026-03-13 08:15:50,547 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 08:15:50,583 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b124a79d191758182539f4 HTTP/1.1" 200 None 2026-03-13 08:15:50,584 - lava_callback - DEBUG - Processing node 69b124a79d191758182539f4: baseline-arm64-baylibre 2026-03-13 08:15:50,585 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b124a79d191758182539f4 2026-03-13 08:15:50,586 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 08:15:50,606 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b124a79d191758182539f4 HTTP/1.1" 200 None 2026-03-13 08:15:50,609 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 08:15:50,626 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ab6e44efa461f55e59cdc8 HTTP/1.1" 200 None 2026-03-13 08:15:50,627 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 08:15:50,681 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b124a79d191758182539f4 HTTP/1.1" 200 None 2026-03-13 08:15:50,683 - lava_callback - ERROR - Error processing callback for node 69b124a79d191758182539f4: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:57740 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36578 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55102 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55106 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:55116 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35410 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39284 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50130 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52406 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55410 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44886 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44892 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:44896 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42050 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55714 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46846 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46856 - "GET /favicon.ico HTTP/1.0" 404 Not Found INFO: 172.21.0.1:46864 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43308 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37652 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51534 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51538 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:51542 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59492 - "GET /robots.txt HTTP/1.0" 404 Not Found INFO: 172.21.0.1:59506 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59014 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54346 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60488 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40786 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:32942 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:32952 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:32966 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36920 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41410 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44116 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51990 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39510 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56140 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56142 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:56156 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47402 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40974 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45344 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49140 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40010 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39966 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39974 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:39976 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50958 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58784 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48926 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47390 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60382 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59908 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59914 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:59924 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48370 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46610 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40484 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47356 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45442 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60596 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60598 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:60608 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34402 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49430 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35954 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48970 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42490 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53782 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53790 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:53806 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47368 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52716 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40004 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45366 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54056 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60502 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60514 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:60524 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40894 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57460 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48586 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33808 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52964 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51826 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51834 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:51838 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60558 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38082 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57058 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40188 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44948 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36256 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36258 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:36264 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43150 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54980 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50082 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37322 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54962 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33364 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33368 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:33382 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51126 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51280 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55486 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47410 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52916 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47214 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47230 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:47234 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52330 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35064 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39676 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58402 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33668 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50758 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50770 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:50784 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57736 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41472 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46804 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51136 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52260 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42218 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42228 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:42238 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48638 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33072 - "GET / HTTP/1.0" 200 OK 2026-03-13 08:31:41,309 - lava_callback - INFO - Received callback for node 69b3caeb1727ff69d6f22174 INFO: 172.21.0.1:33068 - "POST /node/69b3caeb1727ff69d6f22174 HTTP/1.0" 202 Accepted 2026-03-13 08:31:41,315 - lava_callback - INFO - Starting async job submit for node 69b3caeb1727ff69d6f22174 2026-03-13 08:31:41,353 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 08:31:41,390 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b3caeb1727ff69d6f22174 HTTP/1.1" 200 None 2026-03-13 08:31:41,391 - lava_callback - DEBUG - Processing node 69b3caeb1727ff69d6f22174: baseline-arm 2026-03-13 08:31:41,572 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-13 08:31:41,769 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-13 08:31:41,771 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-69b3caeb1727ff69d6f22174/log.txt.gz 2026-03-13 08:31:41,879 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-13 08:31:42,139 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-13 08:31:42,141 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm-69b3caeb1727ff69d6f22174/lava-logs.yaml 2026-03-13 08:31:42,146 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-13 08:31:42,309 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-13 08:31:42,311 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-69b3caeb1727ff69d6f22174/lava_callback.json.gz 2026-03-13 08:31:42,334 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 08:31:42,369 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b3caeb1727ff69d6f22174 HTTP/1.1" 200 None 2026-03-13 08:31:42,371 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 08:31:42,385 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b3c7ff1727ff69d6f21d8f HTTP/1.1" 200 None 2026-03-13 08:31:42,386 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 08:31:42,413 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b3caeb1727ff69d6f22174 HTTP/1.1" 200 None 2026-03-13 08:31:42,416 - lava_callback - INFO - Completed processing callback for node 69b3caeb1727ff69d6f22174 INFO: 172.21.0.1:33074 - "GET / HTTP/1.0" 200 OK 2026-03-13 08:31:50,687 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 08:31:50,706 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:38260 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58996 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58934 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58950 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:58956 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39462 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52376 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39552 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58328 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37610 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50468 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50474 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:50486 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49582 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43994 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51392 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51462 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51008 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36466 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36480 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:36494 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54046 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58050 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59360 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55438 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33970 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45510 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45526 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:45536 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42166 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55968 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57590 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36304 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59146 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47474 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47488 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:47498 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54682 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47448 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44250 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59224 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54360 - "GET / HTTP/1.0" 200 OK 2026-03-13 08:37:12,096 - lava_callback - INFO - Received callback for node 69b3cca91727ff69d6f221b5 INFO: 172.21.0.1:56458 - "POST /node/69b3cca91727ff69d6f221b5 HTTP/1.0" 202 Accepted 2026-03-13 08:37:12,103 - lava_callback - INFO - Starting async job submit for node 69b3cca91727ff69d6f221b5 2026-03-13 08:37:12,106 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 08:37:12,127 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b3cca91727ff69d6f221b5 HTTP/1.1" 200 None 2026-03-13 08:37:12,128 - lava_callback - DEBUG - Processing node 69b3cca91727ff69d6f221b5: baseline-arm 2026-03-13 08:37:12,137 - lava_callback - WARNING - Failed to upload log 2026-03-13 08:37:12,141 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-13 08:37:12,266 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-13 08:37:12,267 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm-69b3cca91727ff69d6f221b5/lava-logs.yaml 2026-03-13 08:37:12,269 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-13 08:37:12,382 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-13 08:37:12,384 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-69b3cca91727ff69d6f221b5/lava_callback.json.gz 2026-03-13 08:37:12,387 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 08:37:12,402 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b3cca91727ff69d6f221b5 HTTP/1.1" 200 None 2026-03-13 08:37:12,403 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 08:37:12,433 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b3c7f91727ff69d6f21d89 HTTP/1.1" 200 None 2026-03-13 08:37:12,434 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 08:37:12,464 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b3cca91727ff69d6f221b5 HTTP/1.1" 200 None 2026-03-13 08:37:12,471 - lava_callback - INFO - Completed processing callback for node 69b3cca91727ff69d6f221b5 INFO: 172.21.0.1:56468 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:56474 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56480 - "GET / HTTP/1.0" 200 OK 2026-03-13 08:37:20,710 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 08:37:20,737 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 2026-03-13 08:37:25,769 - lava_callback - INFO - Received callback for node 69b3cc9f1727ff69d6f22191 INFO: 172.21.0.1:55470 - "POST /node/69b3cc9f1727ff69d6f22191 HTTP/1.0" 202 Accepted 2026-03-13 08:37:25,821 - lava_callback - INFO - Starting async job submit for node 69b3cc9f1727ff69d6f22191 2026-03-13 08:37:25,841 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 08:37:25,856 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b3cc9f1727ff69d6f22191 HTTP/1.1" 200 None 2026-03-13 08:37:25,857 - lava_callback - DEBUG - Processing node 69b3cc9f1727ff69d6f22191: baseline-x86 2026-03-13 08:37:26,036 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-13 08:37:26,170 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-13 08:37:26,172 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-x86-69b3cc9f1727ff69d6f22191/log.txt.gz 2026-03-13 08:37:26,287 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-13 08:37:26,467 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-13 08:37:26,469 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-x86-69b3cc9f1727ff69d6f22191/lava-logs.yaml 2026-03-13 08:37:26,475 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 INFO: 172.21.0.1:55482 - "GET / HTTP/1.0" 200 OK 2026-03-13 08:37:26,707 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-13 08:37:26,710 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-x86-69b3cc9f1727ff69d6f22191/lava_callback.json.gz 2026-03-13 08:37:26,736 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 08:37:26,756 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b3cc9f1727ff69d6f22191 HTTP/1.1" 200 None 2026-03-13 08:37:26,757 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 08:37:26,770 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b3c81d1727ff69d6f21db3 HTTP/1.1" 200 None 2026-03-13 08:37:26,772 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 08:37:26,796 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b3cc9f1727ff69d6f22191 HTTP/1.1" 200 None 2026-03-13 08:37:26,797 - lava_callback - INFO - Completed processing callback for node 69b3cc9f1727ff69d6f22191 2026-03-13 08:37:34,107 - lava_callback - INFO - Received callback for node 69b3cca11727ff69d6f2219a INFO: 172.21.0.1:44748 - "POST /node/69b3cca11727ff69d6f2219a HTTP/1.0" 202 Accepted 2026-03-13 08:37:34,113 - lava_callback - INFO - Starting async job submit for node 69b3cca11727ff69d6f2219a 2026-03-13 08:37:34,131 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 08:37:34,149 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b3cca11727ff69d6f2219a HTTP/1.1" 200 None 2026-03-13 08:37:34,150 - lava_callback - DEBUG - Processing node 69b3cca11727ff69d6f2219a: baseline-x86 2026-03-13 08:37:34,327 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-13 08:37:34,453 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-13 08:37:34,455 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-x86-69b3cca11727ff69d6f2219a/log.txt.gz 2026-03-13 08:37:34,608 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-13 08:37:34,791 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-13 08:37:34,793 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-x86-69b3cca11727ff69d6f2219a/lava-logs.yaml 2026-03-13 08:37:34,798 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-13 08:37:34,948 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-13 08:37:34,950 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-x86-69b3cca11727ff69d6f2219a/lava_callback.json.gz 2026-03-13 08:37:34,986 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 08:37:35,008 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b3cca11727ff69d6f2219a HTTP/1.1" 200 None 2026-03-13 08:37:35,010 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 08:37:35,023 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b3c81d1727ff69d6f21db3 HTTP/1.1" 200 None 2026-03-13 08:37:35,024 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 08:37:35,060 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b3cca11727ff69d6f2219a HTTP/1.1" 200 None 2026-03-13 08:37:35,061 - lava_callback - INFO - Completed processing callback for node 69b3cca11727ff69d6f2219a INFO: 172.21.0.1:44756 - "GET / HTTP/1.0" 200 OK 2026-03-13 08:37:36,749 - lava_callback - INFO - Received callback for node 69b3ccaa1727ff69d6f221b8 INFO: 172.21.0.1:44772 - "POST /node/69b3ccaa1727ff69d6f221b8 HTTP/1.0" 202 Accepted 2026-03-13 08:37:36,797 - lava_callback - INFO - Starting async job submit for node 69b3ccaa1727ff69d6f221b8 2026-03-13 08:37:36,816 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 08:37:36,837 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b3ccaa1727ff69d6f221b8 HTTP/1.1" 200 None 2026-03-13 08:37:36,837 - lava_callback - DEBUG - Processing node 69b3ccaa1727ff69d6f221b8: baseline-arm 2026-03-13 08:37:37,036 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-13 08:37:37,165 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-13 08:37:37,167 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-69b3ccaa1727ff69d6f221b8/log.txt.gz 2026-03-13 08:37:37,272 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-13 08:37:37,526 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-13 08:37:37,528 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm-69b3ccaa1727ff69d6f221b8/lava-logs.yaml 2026-03-13 08:37:37,533 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-13 08:37:37,703 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-13 08:37:37,704 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-69b3ccaa1727ff69d6f221b8/lava_callback.json.gz 2026-03-13 08:37:37,723 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 08:37:37,737 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b3ccaa1727ff69d6f221b8 HTTP/1.1" 200 None 2026-03-13 08:37:37,738 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 08:37:37,752 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b3c7f91727ff69d6f21d89 HTTP/1.1" 200 None 2026-03-13 08:37:37,754 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 08:37:37,777 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b3ccaa1727ff69d6f221b8 HTTP/1.1" 200 None 2026-03-13 08:37:37,785 - lava_callback - INFO - Completed processing callback for node 69b3ccaa1727ff69d6f221b8 2026-03-13 08:37:45,489 - lava_callback - INFO - Received callback for node 69b3ccad1727ff69d6f221c1 INFO: 172.21.0.1:56256 - "POST /node/69b3ccad1727ff69d6f221c1 HTTP/1.0" 202 Accepted 2026-03-13 08:37:45,538 - lava_callback - INFO - Starting async job submit for node 69b3ccad1727ff69d6f221c1 2026-03-13 08:37:45,566 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 08:37:45,612 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b3ccad1727ff69d6f221c1 HTTP/1.1" 200 None 2026-03-13 08:37:45,614 - lava_callback - DEBUG - Processing node 69b3ccad1727ff69d6f221c1: baseline-arm 2026-03-13 08:37:45,782 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-13 08:37:45,916 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-13 08:37:45,918 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-69b3ccad1727ff69d6f221c1/log.txt.gz 2026-03-13 08:37:45,991 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-13 08:37:46,167 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-13 08:37:46,170 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm-69b3ccad1727ff69d6f221c1/lava-logs.yaml 2026-03-13 08:37:46,175 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-13 08:37:46,387 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-13 08:37:46,389 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-69b3ccad1727ff69d6f221c1/lava_callback.json.gz 2026-03-13 08:37:46,408 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 08:37:46,422 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b3ccad1727ff69d6f221c1 HTTP/1.1" 200 None 2026-03-13 08:37:46,424 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 08:37:46,438 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b3c7f91727ff69d6f21d89 HTTP/1.1" 200 None 2026-03-13 08:37:46,439 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 08:37:46,464 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b3ccad1727ff69d6f221c1 HTTP/1.1" 200 None 2026-03-13 08:37:46,466 - lava_callback - INFO - Completed processing callback for node 69b3ccad1727ff69d6f221c1 INFO: 172.21.0.1:56266 - "GET / HTTP/1.0" 200 OK 2026-03-13 08:37:50,740 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 08:37:50,758 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 15 INFO: 172.21.0.1:44140 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37222 - "GET / HTTP/1.0" 200 OK 2026-03-13 08:38:06,845 - lava_callback - INFO - Received callback for node 69b3cca01727ff69d6f22194 INFO: 172.21.0.1:37234 - "POST /node/69b3cca01727ff69d6f22194 HTTP/1.0" 202 Accepted 2026-03-13 08:38:06,852 - lava_callback - INFO - Starting async job submit for node 69b3cca01727ff69d6f22194 2026-03-13 08:38:06,871 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 08:38:06,885 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b3cca01727ff69d6f22194 HTTP/1.1" 200 None 2026-03-13 08:38:06,886 - lava_callback - DEBUG - Processing node 69b3cca01727ff69d6f22194: baseline-x86 2026-03-13 08:38:07,153 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-13 08:38:07,451 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-13 08:38:07,453 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-x86-69b3cca01727ff69d6f22194/log.txt.gz 2026-03-13 08:38:07,685 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-13 08:38:07,901 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-13 08:38:07,903 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-x86-69b3cca01727ff69d6f22194/lava-logs.yaml 2026-03-13 08:38:07,911 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-13 08:38:08,104 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-13 08:38:08,106 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-x86-69b3cca01727ff69d6f22194/lava_callback.json.gz 2026-03-13 08:38:08,125 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 08:38:08,141 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b3cca01727ff69d6f22194 HTTP/1.1" 200 None 2026-03-13 08:38:08,142 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 08:38:08,159 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b3c81d1727ff69d6f21db3 HTTP/1.1" 200 None 2026-03-13 08:38:08,160 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 08:38:08,188 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b3cca01727ff69d6f22194 HTTP/1.1" 200 None 2026-03-13 08:38:08,190 - lava_callback - INFO - Completed processing callback for node 69b3cca01727ff69d6f22194 2026-03-13 08:38:11,605 - lava_callback - INFO - Received callback for node 69b3ccab1727ff69d6f221be INFO: 172.21.0.1:39776 - "POST /node/69b3ccab1727ff69d6f221be HTTP/1.0" 202 Accepted 2026-03-13 08:38:11,611 - lava_callback - INFO - Starting async job submit for node 69b3ccab1727ff69d6f221be 2026-03-13 08:38:11,642 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 08:38:11,672 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b3ccab1727ff69d6f221be HTTP/1.1" 200 None 2026-03-13 08:38:11,675 - lava_callback - DEBUG - Processing node 69b3ccab1727ff69d6f221be: baseline-arm 2026-03-13 08:38:11,952 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-13 08:38:12,072 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-13 08:38:12,074 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-69b3ccab1727ff69d6f221be/log.txt.gz 2026-03-13 08:38:12,221 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-13 08:38:12,450 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-13 08:38:12,452 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm-69b3ccab1727ff69d6f221be/lava-logs.yaml 2026-03-13 08:38:12,458 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-13 08:38:12,608 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-13 08:38:12,610 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-69b3ccab1727ff69d6f221be/lava_callback.json.gz 2026-03-13 08:38:12,671 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 08:38:12,690 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b3ccab1727ff69d6f221be HTTP/1.1" 200 None 2026-03-13 08:38:12,692 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 08:38:12,705 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b3c7f91727ff69d6f21d89 HTTP/1.1" 200 None 2026-03-13 08:38:12,707 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 08:38:12,761 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b3ccab1727ff69d6f221be HTTP/1.1" 200 None 2026-03-13 08:38:12,763 - lava_callback - INFO - Completed processing callback for node 69b3ccab1727ff69d6f221be INFO: 172.21.0.1:39792 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:39798 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39800 - "GET / HTTP/1.0" 200 OK 2026-03-13 08:38:20,760 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 08:38:20,779 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:47392 - "GET / HTTP/1.0" 200 OK 2026-03-13 08:38:27,932 - lava_callback - INFO - Received callback for node 69b3cccc1727ff69d6f22240 INFO: 172.21.0.1:47408 - "POST /node/69b3cccc1727ff69d6f22240 HTTP/1.0" 202 Accepted 2026-03-13 08:38:27,941 - lava_callback - INFO - Starting async job submit for node 69b3cccc1727ff69d6f22240 2026-03-13 08:38:27,974 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 08:38:28,008 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b3cccc1727ff69d6f22240 HTTP/1.1" 200 None 2026-03-13 08:38:28,009 - lava_callback - DEBUG - Processing node 69b3cccc1727ff69d6f22240: baseline-arm-pengutronix 2026-03-13 08:38:28,210 - lava_callback - INFO - Received callback for node 69b3cca81727ff69d6f221b2 2026-03-13 08:38:28,241 - lava_callback - INFO - Starting async job submit for node 69b3cca81727ff69d6f221b2 INFO: 172.21.0.1:47420 - "POST /node/69b3cca81727ff69d6f221b2 HTTP/1.0" 202 Accepted 2026-03-13 08:38:28,299 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-13 08:38:28,313 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 08:38:28,342 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b3cca81727ff69d6f221b2 HTTP/1.1" 200 None 2026-03-13 08:38:28,343 - lava_callback - DEBUG - Processing node 69b3cca81727ff69d6f221b2: baseline-arm 2026-03-13 08:38:28,693 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-13 08:38:28,792 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-13 08:38:28,794 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-pengutronix-69b3cccc1727ff69d6f22240/log.txt.gz 2026-03-13 08:38:28,982 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-13 08:38:29,217 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-13 08:38:29,220 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-69b3cca81727ff69d6f221b2/log.txt.gz 2026-03-13 08:38:29,423 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-13 08:38:29,546 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-13 08:38:29,549 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm-pengutronix-69b3cccc1727ff69d6f22240/lava-logs.yaml 2026-03-13 08:38:29,554 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-13 08:38:29,981 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-13 08:38:29,983 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-pengutronix-69b3cccc1727ff69d6f22240/lava_callback.json.gz 2026-03-13 08:38:30,012 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-13 08:38:30,015 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm-69b3cca81727ff69d6f221b2/lava-logs.yaml 2026-03-13 08:38:30,029 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 08:38:30,030 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-13 08:38:30,056 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b3cccc1727ff69d6f22240 HTTP/1.1" 200 None 2026-03-13 08:38:30,059 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 08:38:30,087 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b3c7f91727ff69d6f21d89 HTTP/1.1" 200 None 2026-03-13 08:38:30,089 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 08:38:30,144 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b3cccc1727ff69d6f22240 HTTP/1.1" 200 None 2026-03-13 08:38:30,146 - lava_callback - INFO - Completed processing callback for node 69b3cccc1727ff69d6f22240 2026-03-13 08:38:30,534 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-13 08:38:30,536 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-69b3cca81727ff69d6f221b2/lava_callback.json.gz 2026-03-13 08:38:30,577 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 08:38:30,606 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b3cca81727ff69d6f221b2 HTTP/1.1" 200 None 2026-03-13 08:38:30,608 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 08:38:30,636 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b3c7f91727ff69d6f21d89 HTTP/1.1" 200 None 2026-03-13 08:38:30,639 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 08:38:30,675 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b3cca81727ff69d6f221b2 HTTP/1.1" 200 None 2026-03-13 08:38:30,677 - lava_callback - INFO - Completed processing callback for node 69b3cca81727ff69d6f221b2 2026-03-13 08:38:36,422 - lava_callback - INFO - Received callback for node 69b3cca11727ff69d6f22197 INFO: 172.21.0.1:46302 - "POST /node/69b3cca11727ff69d6f22197 HTTP/1.0" 202 Accepted 2026-03-13 08:38:36,431 - lava_callback - INFO - Starting async job submit for node 69b3cca11727ff69d6f22197 2026-03-13 08:38:36,467 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 08:38:36,489 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b3cca11727ff69d6f22197 HTTP/1.1" 200 None 2026-03-13 08:38:36,491 - lava_callback - DEBUG - Processing node 69b3cca11727ff69d6f22197: baseline-x86 INFO: 172.21.0.1:46316 - "GET / HTTP/1.0" 200 OK 2026-03-13 08:38:36,928 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-13 08:38:37,252 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-13 08:38:37,254 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-x86-69b3cca11727ff69d6f22197/log.txt.gz 2026-03-13 08:38:37,545 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-13 08:38:38,016 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-13 08:38:38,019 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-x86-69b3cca11727ff69d6f22197/lava-logs.yaml 2026-03-13 08:38:38,028 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-13 08:38:38,335 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-13 08:38:38,338 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-x86-69b3cca11727ff69d6f22197/lava_callback.json.gz 2026-03-13 08:38:38,372 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 08:38:38,404 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b3cca11727ff69d6f22197 HTTP/1.1" 200 None 2026-03-13 08:38:38,407 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 08:38:38,464 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b3c81d1727ff69d6f21db3 HTTP/1.1" 200 None 2026-03-13 08:38:38,467 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 08:38:38,516 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b3cca11727ff69d6f22197 HTTP/1.1" 200 None 2026-03-13 08:38:38,519 - lava_callback - INFO - Completed processing callback for node 69b3cca11727ff69d6f22197 2026-03-13 08:38:41,038 - lava_callback - INFO - Received callback for node 69b3ccd01727ff69d6f2224d INFO: 172.21.0.1:47806 - "POST /node/69b3ccd01727ff69d6f2224d HTTP/1.0" 202 Accepted 2026-03-13 08:38:41,093 - lava_callback - INFO - Starting async job submit for node 69b3ccd01727ff69d6f2224d 2026-03-13 08:38:41,127 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 08:38:41,153 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b3ccd01727ff69d6f2224d HTTP/1.1" 200 None 2026-03-13 08:38:41,155 - lava_callback - DEBUG - Processing node 69b3ccd01727ff69d6f2224d: baseline-arm-pengutronix 2026-03-13 08:38:41,353 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-13 08:38:41,671 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-13 08:38:41,673 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-pengutronix-69b3ccd01727ff69d6f2224d/log.txt.gz 2026-03-13 08:38:41,698 - lava_callback - INFO - Received callback for node 69b3ccc11727ff69d6f221f6 INFO: 172.21.0.1:47810 - "POST /node/69b3ccc11727ff69d6f221f6 HTTP/1.0" 202 Accepted 2026-03-13 08:38:41,715 - lava_callback - INFO - Starting async job submit for node 69b3ccc11727ff69d6f221f6 2026-03-13 08:38:41,791 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 08:38:41,847 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b3ccc11727ff69d6f221f6 HTTP/1.1" 200 None 2026-03-13 08:38:41,849 - lava_callback - DEBUG - Processing node 69b3ccc11727ff69d6f221f6: baseline-arm-clabbe 2026-03-13 08:38:41,857 - lava_callback - INFO - Received callback for node 69b3ccba1727ff69d6f221e0 2026-03-13 08:38:41,890 - lava_callback - INFO - Starting async job submit for node 69b3ccba1727ff69d6f221e0 INFO: 172.21.0.1:47822 - "POST /node/69b3ccba1727ff69d6f221e0 HTTP/1.0" 202 Accepted 2026-03-13 08:38:41,968 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-13 08:38:41,991 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 08:38:42,053 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b3ccba1727ff69d6f221e0 HTTP/1.1" 200 None 2026-03-13 08:38:42,055 - lava_callback - DEBUG - Processing node 69b3ccba1727ff69d6f221e0: baseline-arm-broonie 2026-03-13 08:38:42,501 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-13 08:38:42,504 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm-pengutronix-69b3ccd01727ff69d6f2224d/lava-logs.yaml 2026-03-13 08:38:42,516 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-13 08:38:42,651 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-13 08:38:42,751 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-13 08:38:42,997 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-13 08:38:42,999 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-pengutronix-69b3ccd01727ff69d6f2224d/lava_callback.json.gz 2026-03-13 08:38:43,038 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-13 08:38:43,040 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-clabbe-69b3ccc11727ff69d6f221f6/log.txt.gz 2026-03-13 08:38:43,059 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 08:38:43,099 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-13 08:38:43,102 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-broonie-69b3ccba1727ff69d6f221e0/log.txt.gz 2026-03-13 08:38:43,212 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b3ccd01727ff69d6f2224d HTTP/1.1" 200 None 2026-03-13 08:38:43,268 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 08:38:43,406 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b3c7f91727ff69d6f21d89 HTTP/1.1" 200 None 2026-03-13 08:38:43,414 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 08:38:43,597 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b3ccd01727ff69d6f2224d HTTP/1.1" 200 None 2026-03-13 08:38:43,599 - lava_callback - INFO - Completed processing callback for node 69b3ccd01727ff69d6f2224d 2026-03-13 08:38:43,607 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-13 08:38:43,644 - lava_callback - INFO - Received callback for node 69b3ccbb1727ff69d6f221e3 2026-03-13 08:38:43,671 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 INFO: 172.21.0.1:47826 - "POST /node/69b3ccbb1727ff69d6f221e3 HTTP/1.0" 202 Accepted 2026-03-13 08:38:43,685 - lava_callback - INFO - Starting async job submit for node 69b3ccbb1727ff69d6f221e3 2026-03-13 08:38:43,766 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 08:38:43,800 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b3ccbb1727ff69d6f221e3 HTTP/1.1" 200 None 2026-03-13 08:38:43,801 - lava_callback - DEBUG - Processing node 69b3ccbb1727ff69d6f221e3: baseline-arm-broonie 2026-03-13 08:38:44,196 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-13 08:38:44,238 - lava_callback - INFO - Received callback for node 69b129fea870a1dc3343bb12 2026-03-13 08:38:44,247 - lava_callback - INFO - Starting async job submit for node 69b129fea870a1dc3343bb12 2026-03-13 08:38:44,248 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 INFO: 172.21.0.1:47836 - "POST /node/69b129fea870a1dc3343bb12 HTTP/1.0" 202 Accepted 2026-03-13 08:38:44,278 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b129fea870a1dc3343bb12 HTTP/1.1" 200 None 2026-03-13 08:38:44,280 - lava_callback - DEBUG - Processing node 69b129fea870a1dc3343bb12: baseline-arm-clabbe 2026-03-13 08:38:44,280 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b129fea870a1dc3343bb12 2026-03-13 08:38:44,281 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 08:38:44,324 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b129fea870a1dc3343bb12 HTTP/1.1" 200 None 2026-03-13 08:38:44,326 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 08:38:44,364 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b12591a870a1dc3343ba82 HTTP/1.1" 200 None 2026-03-13 08:38:44,366 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 08:38:44,415 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b129fea870a1dc3343bb12 HTTP/1.1" 200 None 2026-03-13 08:38:44,416 - lava_callback - ERROR - Error processing callback for node 69b129fea870a1dc3343bb12: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' 2026-03-13 08:38:44,586 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-13 08:38:44,589 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm-clabbe-69b3ccc11727ff69d6f221f6/lava-logs.yaml 2026-03-13 08:38:44,591 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-13 08:38:44,593 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm-broonie-69b3ccba1727ff69d6f221e0/lava-logs.yaml 2026-03-13 08:38:44,605 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-13 08:38:44,615 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-13 08:38:44,862 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-13 08:38:44,865 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-broonie-69b3ccbb1727ff69d6f221e3/log.txt.gz 2026-03-13 08:38:44,923 - lava_callback - INFO - Received callback for node 69b12a02a870a1dc3343bb1f INFO: 172.21.0.1:47846 - "POST /node/69b12a02a870a1dc3343bb1f HTTP/1.0" 202 Accepted 2026-03-13 08:38:44,932 - lava_callback - INFO - Starting async job submit for node 69b12a02a870a1dc3343bb1f 2026-03-13 08:38:44,950 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 08:38:45,009 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b12a02a870a1dc3343bb1f HTTP/1.1" 200 None 2026-03-13 08:38:45,011 - lava_callback - DEBUG - Processing node 69b12a02a870a1dc3343bb1f: baseline-arm-clabbe 2026-03-13 08:38:45,012 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b12a02a870a1dc3343bb1f 2026-03-13 08:38:45,013 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 08:38:45,150 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b12a02a870a1dc3343bb1f HTTP/1.1" 200 None 2026-03-13 08:38:45,155 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 08:38:45,155 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-13 08:38:45,159 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-broonie-69b3ccba1727ff69d6f221e0/lava_callback.json.gz 2026-03-13 08:38:45,228 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-13 08:38:45,252 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b12591a870a1dc3343ba82 HTTP/1.1" 200 None 2026-03-13 08:38:45,255 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-clabbe-69b3ccc11727ff69d6f221f6/lava_callback.json.gz 2026-03-13 08:38:45,260 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 08:38:45,271 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-13 08:38:45,299 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 08:38:45,318 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 08:38:45,352 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b3ccba1727ff69d6f221e0 HTTP/1.1" 200 None 2026-03-13 08:38:45,355 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 08:38:45,368 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b12a02a870a1dc3343bb1f HTTP/1.1" 200 None 2026-03-13 08:38:45,369 - lava_callback - ERROR - Error processing callback for node 69b12a02a870a1dc3343bb1f: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' 2026-03-13 08:38:45,391 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b3ccc11727ff69d6f221f6 HTTP/1.1" 200 None 2026-03-13 08:38:45,404 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 08:38:45,417 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b3c7f91727ff69d6f21d89 HTTP/1.1" 200 None 2026-03-13 08:38:45,421 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 08:38:45,468 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b3c7f91727ff69d6f21d89 HTTP/1.1" 200 None 2026-03-13 08:38:45,471 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 08:38:45,496 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b3ccba1727ff69d6f221e0 HTTP/1.1" 200 None 2026-03-13 08:38:45,498 - lava_callback - INFO - Completed processing callback for node 69b3ccba1727ff69d6f221e0 2026-03-13 08:38:45,580 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b3ccc11727ff69d6f221f6 HTTP/1.1" 200 None 2026-03-13 08:38:45,582 - lava_callback - INFO - Completed processing callback for node 69b3ccc11727ff69d6f221f6 2026-03-13 08:38:45,624 - lava_callback - INFO - Received callback for node 69b12a03a870a1dc3343bb22 INFO: 172.21.0.1:47854 - "POST /node/69b12a03a870a1dc3343bb22 HTTP/1.0" 202 Accepted 2026-03-13 08:38:45,634 - lava_callback - INFO - Starting async job submit for node 69b12a03a870a1dc3343bb22 2026-03-13 08:38:45,638 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 08:38:45,678 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b12a03a870a1dc3343bb22 HTTP/1.1" 200 None 2026-03-13 08:38:45,683 - lava_callback - DEBUG - Processing node 69b12a03a870a1dc3343bb22: baseline-arm-clabbe 2026-03-13 08:38:45,684 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b12a03a870a1dc3343bb22 2026-03-13 08:38:45,684 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 08:38:45,736 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b12a03a870a1dc3343bb22 HTTP/1.1" 200 None 2026-03-13 08:38:45,738 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 08:38:45,777 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b12591a870a1dc3343ba82 HTTP/1.1" 200 None 2026-03-13 08:38:45,781 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 08:38:45,865 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b12a03a870a1dc3343bb22 HTTP/1.1" 200 None 2026-03-13 08:38:45,867 - lava_callback - ERROR - Error processing callback for node 69b12a03a870a1dc3343bb22: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' 2026-03-13 08:38:46,304 - lava_callback - INFO - Received callback for node 69b12a04a870a1dc3343bb25 INFO: 172.21.0.1:47864 - "POST /node/69b12a04a870a1dc3343bb25 HTTP/1.0" 202 Accepted 2026-03-13 08:38:46,312 - lava_callback - INFO - Starting async job submit for node 69b12a04a870a1dc3343bb25 2026-03-13 08:38:46,313 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 08:38:46,355 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b12a04a870a1dc3343bb25 HTTP/1.1" 200 None 2026-03-13 08:38:46,357 - lava_callback - DEBUG - Processing node 69b12a04a870a1dc3343bb25: baseline-arm-clabbe 2026-03-13 08:38:46,357 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b12a04a870a1dc3343bb25 2026-03-13 08:38:46,358 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 08:38:46,395 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b12a04a870a1dc3343bb25 HTTP/1.1" 200 None 2026-03-13 08:38:46,397 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 08:38:46,422 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b12591a870a1dc3343ba82 HTTP/1.1" 200 None 2026-03-13 08:38:46,425 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 08:38:46,466 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b12a04a870a1dc3343bb25 HTTP/1.1" 200 None 2026-03-13 08:38:46,467 - lava_callback - ERROR - Error processing callback for node 69b12a04a870a1dc3343bb25: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:47872 - "GET / HTTP/1.0" 200 OK 2026-03-13 08:38:46,553 - lava_callback - INFO - Received callback for node 69b3ccbc1727ff69d6f221e6 INFO: 172.21.0.1:47876 - "POST /node/69b3ccbc1727ff69d6f221e6 HTTP/1.0" 202 Accepted 2026-03-13 08:38:46,570 - lava_callback - INFO - Starting async job submit for node 69b3ccbc1727ff69d6f221e6 2026-03-13 08:38:46,630 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 08:38:46,648 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-13 08:38:46,651 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm-broonie-69b3ccbb1727ff69d6f221e3/lava-logs.yaml 2026-03-13 08:38:46,657 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b3ccbc1727ff69d6f221e6 HTTP/1.1" 200 None 2026-03-13 08:38:46,658 - lava_callback - DEBUG - Processing node 69b3ccbc1727ff69d6f221e6: baseline-arm-broonie 2026-03-13 08:38:46,668 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-13 08:38:46,971 - lava_callback - INFO - Received callback for node 69b12a07a870a1dc3343bb5d INFO: 172.21.0.1:47882 - "POST /node/69b12a07a870a1dc3343bb5d HTTP/1.0" 202 Accepted 2026-03-13 08:38:47,001 - lava_callback - INFO - Starting async job submit for node 69b12a07a870a1dc3343bb5d 2026-03-13 08:38:47,014 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 08:38:47,064 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b12a07a870a1dc3343bb5d HTTP/1.1" 200 None 2026-03-13 08:38:47,066 - lava_callback - DEBUG - Processing node 69b12a07a870a1dc3343bb5d: baseline-arm-clabbe 2026-03-13 08:38:47,066 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b12a07a870a1dc3343bb5d 2026-03-13 08:38:47,078 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 08:38:47,140 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b12a07a870a1dc3343bb5d HTTP/1.1" 200 None 2026-03-13 08:38:47,148 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 08:38:47,196 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-13 08:38:47,210 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b12591a870a1dc3343ba82 HTTP/1.1" 200 None 2026-03-13 08:38:47,234 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 08:38:47,297 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b12a07a870a1dc3343bb5d HTTP/1.1" 200 None 2026-03-13 08:38:47,298 - lava_callback - ERROR - Error processing callback for node 69b12a07a870a1dc3343bb5d: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' 2026-03-13 08:38:47,481 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-13 08:38:47,483 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-broonie-69b3ccbb1727ff69d6f221e3/lava_callback.json.gz 2026-03-13 08:38:47,536 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 08:38:47,559 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b3ccbb1727ff69d6f221e3 HTTP/1.1" 200 None 2026-03-13 08:38:47,561 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 08:38:47,589 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b3c7f91727ff69d6f21d89 HTTP/1.1" 200 None 2026-03-13 08:38:47,592 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 08:38:47,671 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b3ccbb1727ff69d6f221e3 HTTP/1.1" 200 None 2026-03-13 08:38:47,673 - lava_callback - INFO - Completed processing callback for node 69b3ccbb1727ff69d6f221e3 2026-03-13 08:38:47,762 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-13 08:38:47,764 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-broonie-69b3ccbc1727ff69d6f221e6/log.txt.gz 2026-03-13 08:38:48,048 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-13 08:38:48,650 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-13 08:38:48,652 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm-broonie-69b3ccbc1727ff69d6f221e6/lava-logs.yaml 2026-03-13 08:38:48,662 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-13 08:38:49,156 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-13 08:38:49,158 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-broonie-69b3ccbc1727ff69d6f221e6/lava_callback.json.gz 2026-03-13 08:38:49,201 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 08:38:49,234 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b3ccbc1727ff69d6f221e6 HTTP/1.1" 200 None 2026-03-13 08:38:49,237 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 08:38:49,261 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b3c7f91727ff69d6f21d89 HTTP/1.1" 200 None 2026-03-13 08:38:49,263 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 08:38:49,335 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b3ccbc1727ff69d6f221e6 HTTP/1.1" 200 None 2026-03-13 08:38:49,337 - lava_callback - INFO - Completed processing callback for node 69b3ccbc1727ff69d6f221e6 2026-03-13 08:38:50,781 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 08:38:50,812 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 15 INFO: 172.21.0.1:38706 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57290 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39838 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:39842 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39856 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40804 - "GET / HTTP/1.0" 200 OK 2026-03-13 08:39:26,553 - lava_callback - INFO - Received callback for node 69b3ccb81727ff69d6f221dd INFO: 172.21.0.1:40818 - "POST /node/69b3ccb81727ff69d6f221dd HTTP/1.0" 202 Accepted 2026-03-13 08:39:26,564 - lava_callback - INFO - Starting async job submit for node 69b3ccb81727ff69d6f221dd 2026-03-13 08:39:26,601 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 08:39:26,630 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b3ccb81727ff69d6f221dd HTTP/1.1" 200 None 2026-03-13 08:39:26,631 - lava_callback - DEBUG - Processing node 69b3ccb81727ff69d6f221dd: baseline-arm-broonie 2026-03-13 08:39:27,025 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-13 08:39:27,275 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-13 08:39:27,278 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-broonie-69b3ccb81727ff69d6f221dd/log.txt.gz 2026-03-13 08:39:27,486 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-13 08:39:28,026 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-13 08:39:28,028 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm-broonie-69b3ccb81727ff69d6f221dd/lava-logs.yaml 2026-03-13 08:39:28,035 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-13 08:39:28,412 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-13 08:39:28,414 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-broonie-69b3ccb81727ff69d6f221dd/lava_callback.json.gz 2026-03-13 08:39:28,452 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 08:39:28,477 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b3ccb81727ff69d6f221dd HTTP/1.1" 200 None 2026-03-13 08:39:28,480 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 08:39:28,502 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b3c7f91727ff69d6f21d89 HTTP/1.1" 200 None 2026-03-13 08:39:28,504 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 08:39:28,568 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b3ccb81727ff69d6f221dd HTTP/1.1" 200 None 2026-03-13 08:39:28,570 - lava_callback - INFO - Completed processing callback for node 69b3ccb81727ff69d6f221dd 2026-03-13 08:39:30,956 - lava_callback - INFO - Received callback for node 69b3cd381727ff69d6f22326 INFO: 172.21.0.1:43556 - "POST /node/69b3cd381727ff69d6f22326 HTTP/1.0" 202 Accepted 2026-03-13 08:39:30,962 - lava_callback - INFO - Starting async job submit for node 69b3cd381727ff69d6f22326 2026-03-13 08:39:30,965 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 08:39:30,980 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b3cd381727ff69d6f22326 HTTP/1.1" 200 None 2026-03-13 08:39:30,981 - lava_callback - DEBUG - Processing node 69b3cd381727ff69d6f22326: baseline-arm 2026-03-13 08:39:30,986 - lava_callback - WARNING - Failed to upload log 2026-03-13 08:39:30,990 - lava_callback - INFO - Received callback for node 69b3ccc91727ff69d6f22235 2026-03-13 08:39:30,991 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 INFO: 172.21.0.1:43560 - "POST /node/69b3ccc91727ff69d6f22235 HTTP/1.0" 202 Accepted 2026-03-13 08:39:31,001 - lava_callback - INFO - Starting async job submit for node 69b3ccc91727ff69d6f22235 2026-03-13 08:39:31,028 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 08:39:31,047 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b3ccc91727ff69d6f22235 HTTP/1.1" 200 None 2026-03-13 08:39:31,048 - lava_callback - DEBUG - Processing node 69b3ccc91727ff69d6f22235: baseline-arm-kontron 2026-03-13 08:39:31,162 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-13 08:39:31,209 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm-69b3cd381727ff69d6f22326/lava-logs.yaml 2026-03-13 08:39:31,233 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-13 08:39:31,234 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-13 08:39:31,371 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-13 08:39:31,373 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-69b3cd381727ff69d6f22326/lava_callback.json.gz 2026-03-13 08:39:31,376 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 08:39:31,386 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-13 08:39:31,388 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-kontron-69b3ccc91727ff69d6f22235/log.txt.gz 2026-03-13 08:39:31,416 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b3cd381727ff69d6f22326 HTTP/1.1" 200 None 2026-03-13 08:39:31,441 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 08:39:31,505 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-13 08:39:31,507 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b3c7f91727ff69d6f21d89 HTTP/1.1" 200 None 2026-03-13 08:39:31,509 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 08:39:31,530 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b3cd381727ff69d6f22326 HTTP/1.1" 200 None 2026-03-13 08:39:31,549 - lava_callback - INFO - Completed processing callback for node 69b3cd381727ff69d6f22326 2026-03-13 08:39:31,774 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-13 08:39:31,776 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm-kontron-69b3ccc91727ff69d6f22235/lava-logs.yaml 2026-03-13 08:39:31,781 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-13 08:39:31,911 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-13 08:39:31,913 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-kontron-69b3ccc91727ff69d6f22235/lava_callback.json.gz 2026-03-13 08:39:31,936 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 08:39:31,950 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b3ccc91727ff69d6f22235 HTTP/1.1" 200 None 2026-03-13 08:39:31,952 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 08:39:31,965 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b3c7f91727ff69d6f21d89 HTTP/1.1" 200 None 2026-03-13 08:39:31,967 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 08:39:31,994 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b3ccc91727ff69d6f22235 HTTP/1.1" 200 None 2026-03-13 08:39:31,999 - lava_callback - INFO - Completed processing callback for node 69b3ccc91727ff69d6f22235 INFO: 172.21.0.1:43574 - "GET / HTTP/1.0" 200 OK 2026-03-13 08:39:45,294 - lava_callback - INFO - Received callback for node 69b3cccd1727ff69d6f22243 INFO: 172.21.0.1:45686 - "POST /node/69b3cccd1727ff69d6f22243 HTTP/1.0" 202 Accepted 2026-03-13 08:39:45,300 - lava_callback - INFO - Starting async job submit for node 69b3cccd1727ff69d6f22243 2026-03-13 08:39:45,322 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 08:39:45,336 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b3cccd1727ff69d6f22243 HTTP/1.1" 200 None 2026-03-13 08:39:45,337 - lava_callback - DEBUG - Processing node 69b3cccd1727ff69d6f22243: baseline-arm-pengutronix 2026-03-13 08:39:45,485 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-13 08:39:45,600 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-13 08:39:45,602 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-pengutronix-69b3cccd1727ff69d6f22243/log.txt.gz 2026-03-13 08:39:45,700 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-13 08:39:45,880 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-13 08:39:45,882 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm-pengutronix-69b3cccd1727ff69d6f22243/lava-logs.yaml 2026-03-13 08:39:45,886 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-13 08:39:46,006 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-13 08:39:46,008 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-pengutronix-69b3cccd1727ff69d6f22243/lava_callback.json.gz 2026-03-13 08:39:46,052 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 08:39:46,068 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b3cccd1727ff69d6f22243 HTTP/1.1" 200 None 2026-03-13 08:39:46,069 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 08:39:46,084 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b3c7f91727ff69d6f21d89 HTTP/1.1" 200 None 2026-03-13 08:39:46,086 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 08:39:46,113 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b3cccd1727ff69d6f22243 HTTP/1.1" 200 None 2026-03-13 08:39:46,154 - lava_callback - INFO - Completed processing callback for node 69b3cccd1727ff69d6f22243 INFO: 172.21.0.1:45700 - "GET / HTTP/1.0" 200 OK 2026-03-13 08:39:50,815 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 08:39:50,854 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 15 2026-03-13 08:39:50,856 - lava_callback - INFO - Received callback for node 69b3cce71727ff69d6f22284 INFO: 172.21.0.1:38216 - "POST /node/69b3cce71727ff69d6f22284 HTTP/1.0" 202 Accepted 2026-03-13 08:39:50,867 - lava_callback - INFO - Starting async job submit for node 69b3cce71727ff69d6f22284 2026-03-13 08:39:50,905 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 08:39:50,926 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b3cce71727ff69d6f22284 HTTP/1.1" 200 None 2026-03-13 08:39:50,927 - lava_callback - DEBUG - Processing node 69b3cce71727ff69d6f22284: ltp-dio 2026-03-13 08:39:51,542 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-13 08:39:51,750 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-13 08:39:51,753 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/ltp-dio-69b3cce71727ff69d6f22284/log.txt.gz 2026-03-13 08:39:52,090 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-13 08:39:52,524 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-13 08:39:52,526 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/ltp-dio-69b3cce71727ff69d6f22284/lava-logs.yaml 2026-03-13 08:39:52,535 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-13 08:39:52,914 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-13 08:39:52,916 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/ltp-dio-69b3cce71727ff69d6f22284/lava_callback.json.gz 2026-03-13 08:39:52,960 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 08:39:52,991 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b3cce71727ff69d6f22284 HTTP/1.1" 200 None 2026-03-13 08:39:52,993 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 08:39:53,023 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b3c7f91727ff69d6f21d89 HTTP/1.1" 200 None 2026-03-13 08:39:53,025 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 08:39:53,060 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b3cce71727ff69d6f22284 HTTP/1.1" 200 None 2026-03-13 08:39:53,062 - lava_callback - INFO - Completed processing callback for node 69b3cce71727ff69d6f22284 INFO: 172.21.0.1:38222 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59542 - "GET / HTTP/1.0" 200 OK 2026-03-13 08:40:09,055 - lava_callback - INFO - Received callback for node 69b3ccc21727ff69d6f221fa INFO: 172.21.0.1:59550 - "POST /node/69b3ccc21727ff69d6f221fa HTTP/1.0" 202 Accepted 2026-03-13 08:40:09,066 - lava_callback - INFO - Starting async job submit for node 69b3ccc21727ff69d6f221fa 2026-03-13 08:40:09,102 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 08:40:09,119 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b3ccc21727ff69d6f221fa HTTP/1.1" 200 None 2026-03-13 08:40:09,121 - lava_callback - DEBUG - Processing node 69b3ccc21727ff69d6f221fa: baseline-arm-clabbe 2026-03-13 08:40:09,388 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-13 08:40:09,712 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-13 08:40:09,714 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-clabbe-69b3ccc21727ff69d6f221fa/log.txt.gz 2026-03-13 08:40:09,847 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-13 08:40:10,333 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-13 08:40:10,335 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm-clabbe-69b3ccc21727ff69d6f221fa/lava-logs.yaml 2026-03-13 08:40:10,342 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-13 08:40:10,471 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-13 08:40:10,473 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-clabbe-69b3ccc21727ff69d6f221fa/lava_callback.json.gz 2026-03-13 08:40:10,496 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 08:40:10,511 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b3ccc21727ff69d6f221fa HTTP/1.1" 200 None 2026-03-13 08:40:10,512 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 08:40:10,530 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b3c7f91727ff69d6f21d89 HTTP/1.1" 200 None 2026-03-13 08:40:10,532 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 08:40:10,580 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b3ccc21727ff69d6f221fa HTTP/1.1" 200 None 2026-03-13 08:40:10,582 - lava_callback - INFO - Completed processing callback for node 69b3ccc21727ff69d6f221fa INFO: 172.21.0.1:48998 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:49008 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49018 - "GET / HTTP/1.0" 200 OK 2026-03-13 08:40:20,857 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 08:40:20,873 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:53358 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34984 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55038 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38222 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53392 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44100 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:44108 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44120 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56240 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52282 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36804 - "GET / HTTP/1.0" 200 OK 2026-03-13 08:41:46,845 - lava_callback - INFO - Received callback for node 69b3cce11727ff69d6f2226c INFO: 172.21.0.1:36814 - "POST /node/69b3cce11727ff69d6f2226c HTTP/1.0" 202 Accepted 2026-03-13 08:41:46,851 - lava_callback - INFO - Starting async job submit for node 69b3cce11727ff69d6f2226c 2026-03-13 08:41:46,876 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 08:41:46,918 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b3cce11727ff69d6f2226c HTTP/1.1" 200 None 2026-03-13 08:41:46,919 - lava_callback - DEBUG - Processing node 69b3cce11727ff69d6f2226c: ltp-containers 2026-03-13 08:41:47,290 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-13 08:41:47,492 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-13 08:41:47,494 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/ltp-containers-69b3cce11727ff69d6f2226c/log.txt.gz 2026-03-13 08:41:47,708 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-13 08:41:47,885 - lava_callback - INFO - Received callback for node 69b3ccc51727ff69d6f22227 INFO: 172.21.0.1:36824 - "POST /node/69b3ccc51727ff69d6f22227 HTTP/1.0" 202 Accepted 2026-03-13 08:41:47,894 - lava_callback - INFO - Starting async job submit for node 69b3ccc51727ff69d6f22227 2026-03-13 08:41:47,921 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 08:41:47,959 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b3ccc51727ff69d6f22227 HTTP/1.1" 200 None 2026-03-13 08:41:47,960 - lava_callback - DEBUG - Processing node 69b3ccc51727ff69d6f22227: baseline-arm-clabbe 2026-03-13 08:41:47,994 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-13 08:41:48,037 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/ltp-containers-69b3cce11727ff69d6f2226c/lava-logs.yaml 2026-03-13 08:41:48,128 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-13 08:41:48,177 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-13 08:41:48,347 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-13 08:41:48,349 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/ltp-containers-69b3cce11727ff69d6f2226c/lava_callback.json.gz 2026-03-13 08:41:48,384 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 08:41:48,398 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b3cce11727ff69d6f2226c HTTP/1.1" 200 None 2026-03-13 08:41:48,400 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 08:41:48,413 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-13 08:41:48,415 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-clabbe-69b3ccc51727ff69d6f22227/log.txt.gz 2026-03-13 08:41:48,429 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b3c7f91727ff69d6f21d89 HTTP/1.1" 200 None 2026-03-13 08:41:48,453 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 08:41:48,477 - lava_callback - INFO - Received callback for node 69b3cce51727ff69d6f22281 INFO: 172.21.0.1:36840 - "POST /node/69b3cce51727ff69d6f22281 HTTP/1.0" 202 Accepted 2026-03-13 08:41:48,502 - lava_callback - INFO - Starting async job submit for node 69b3cce51727ff69d6f22281 2026-03-13 08:41:48,561 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 08:41:48,587 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-13 08:41:48,598 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b3cce11727ff69d6f2226c HTTP/1.1" 200 None 2026-03-13 08:41:48,600 - lava_callback - INFO - Completed processing callback for node 69b3cce11727ff69d6f2226c 2026-03-13 08:41:48,629 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b3cce51727ff69d6f22281 HTTP/1.1" 200 None 2026-03-13 08:41:48,632 - lava_callback - DEBUG - Processing node 69b3cce51727ff69d6f22281: ltp-cve 2026-03-13 08:41:48,911 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-13 08:41:48,966 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm-clabbe-69b3ccc51727ff69d6f22227/lava-logs.yaml 2026-03-13 08:41:49,049 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-13 08:41:49,171 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-13 08:41:49,321 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-13 08:41:49,323 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-clabbe-69b3ccc51727ff69d6f22227/lava_callback.json.gz 2026-03-13 08:41:49,341 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-13 08:41:49,346 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 08:41:49,347 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/ltp-cve-69b3cce51727ff69d6f22281/log.txt.gz 2026-03-13 08:41:49,411 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b3ccc51727ff69d6f22227 HTTP/1.1" 200 None 2026-03-13 08:41:49,439 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 08:41:49,515 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b3c7f91727ff69d6f21d89 HTTP/1.1" 200 None 2026-03-13 08:41:49,538 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 08:41:49,588 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-13 08:41:49,602 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b3ccc51727ff69d6f22227 HTTP/1.1" 200 None 2026-03-13 08:41:49,608 - lava_callback - INFO - Completed processing callback for node 69b3ccc51727ff69d6f22227 2026-03-13 08:41:49,849 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-13 08:41:49,851 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/ltp-cve-69b3cce51727ff69d6f22281/lava-logs.yaml 2026-03-13 08:41:49,861 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-13 08:41:50,023 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-13 08:41:50,025 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/ltp-cve-69b3cce51727ff69d6f22281/lava_callback.json.gz 2026-03-13 08:41:50,050 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 08:41:50,064 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b3cce51727ff69d6f22281 HTTP/1.1" 200 None 2026-03-13 08:41:50,066 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 08:41:50,079 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b3c7f91727ff69d6f21d89 HTTP/1.1" 200 None 2026-03-13 08:41:50,081 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 08:41:50,108 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b3cce51727ff69d6f22281 HTTP/1.1" 200 None 2026-03-13 08:41:50,110 - lava_callback - INFO - Completed processing callback for node 69b3cce51727ff69d6f22281 2026-03-13 08:41:50,875 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 08:41:50,895 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:60798 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42926 - "GET / HTTP/1.0" 200 OK 2026-03-13 08:42:07,392 - lava_callback - INFO - Received callback for node 69b3ccf31727ff69d6f222a8 INFO: 172.21.0.1:42938 - "POST /node/69b3ccf31727ff69d6f222a8 HTTP/1.0" 202 Accepted 2026-03-13 08:42:07,400 - lava_callback - INFO - Starting async job submit for node 69b3ccf31727ff69d6f222a8 2026-03-13 08:42:07,424 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 08:42:07,443 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b3ccf31727ff69d6f222a8 HTTP/1.1" 200 None 2026-03-13 08:42:07,444 - lava_callback - DEBUG - Processing node 69b3ccf31727ff69d6f222a8: ltp-syscalls 2026-03-13 08:42:08,167 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-13 08:42:08,312 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-13 08:42:08,314 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/ltp-syscalls-69b3ccf31727ff69d6f222a8/log.txt.gz 2026-03-13 08:42:08,738 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-13 08:42:08,945 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-13 08:42:08,947 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/ltp-syscalls-69b3ccf31727ff69d6f222a8/lava-logs.yaml 2026-03-13 08:42:08,964 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-13 08:42:09,144 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-13 08:42:09,146 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/ltp-syscalls-69b3ccf31727ff69d6f222a8/lava_callback.json.gz 2026-03-13 08:42:09,171 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 08:42:09,185 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b3ccf31727ff69d6f222a8 HTTP/1.1" 200 None 2026-03-13 08:42:09,187 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 08:42:09,200 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b3c7f91727ff69d6f21d89 HTTP/1.1" 200 None 2026-03-13 08:42:09,202 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 08:42:09,226 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b3ccf31727ff69d6f222a8 HTTP/1.1" 200 None 2026-03-13 08:42:09,232 - lava_callback - INFO - Completed processing callback for node 69b3ccf31727ff69d6f222a8 INFO: 172.21.0.1:32842 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:32858 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:32862 - "GET / HTTP/1.0" 200 OK 2026-03-13 08:42:20,897 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 08:42:20,914 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:60892 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46484 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51368 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39914 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45316 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33820 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:33834 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33836 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39754 - "GET / HTTP/1.0" 200 OK 2026-03-13 08:43:26,961 - lava_callback - INFO - Received callback for node 69b3ccc61727ff69d6f2222a INFO: 172.21.0.1:39770 - "POST /node/69b3ccc61727ff69d6f2222a HTTP/1.0" 202 Accepted 2026-03-13 08:43:26,967 - lava_callback - INFO - Starting async job submit for node 69b3ccc61727ff69d6f2222a 2026-03-13 08:43:26,987 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 08:43:27,001 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b3ccc61727ff69d6f2222a HTTP/1.1" 200 None 2026-03-13 08:43:27,002 - lava_callback - DEBUG - Processing node 69b3ccc61727ff69d6f2222a: baseline-arm-clabbe 2026-03-13 08:43:27,232 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-13 08:43:27,394 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-13 08:43:27,395 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-clabbe-69b3ccc61727ff69d6f2222a/log.txt.gz 2026-03-13 08:43:27,524 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-13 08:43:27,739 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-13 08:43:27,741 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm-clabbe-69b3ccc61727ff69d6f2222a/lava-logs.yaml 2026-03-13 08:43:27,747 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-13 08:43:27,942 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-13 08:43:27,944 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-clabbe-69b3ccc61727ff69d6f2222a/lava_callback.json.gz 2026-03-13 08:43:27,965 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 08:43:27,990 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b3ccc61727ff69d6f2222a HTTP/1.1" 200 None 2026-03-13 08:43:27,992 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 08:43:28,007 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b3c7f91727ff69d6f21d89 HTTP/1.1" 200 None 2026-03-13 08:43:28,008 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 08:43:28,033 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b3ccc61727ff69d6f2222a HTTP/1.1" 200 None 2026-03-13 08:43:28,036 - lava_callback - INFO - Completed processing callback for node 69b3ccc61727ff69d6f2222a INFO: 172.21.0.1:53530 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58738 - "GET / HTTP/1.0" 200 OK 2026-03-13 08:43:50,917 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 08:43:50,933 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:43520 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55388 - "GET / HTTP/1.0" 200 OK 2026-03-13 08:44:07,078 - lava_callback - INFO - Received callback for node 69b3cce21727ff69d6f2227e INFO: 172.21.0.1:55392 - "POST /node/69b3cce21727ff69d6f2227e HTTP/1.0" 202 Accepted 2026-03-13 08:44:07,084 - lava_callback - INFO - Starting async job submit for node 69b3cce21727ff69d6f2227e 2026-03-13 08:44:07,108 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 08:44:07,122 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b3cce21727ff69d6f2227e HTTP/1.1" 200 None 2026-03-13 08:44:07,123 - lava_callback - DEBUG - Processing node 69b3cce21727ff69d6f2227e: ltp-controllers 2026-03-13 08:44:07,554 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-13 08:44:07,717 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-13 08:44:07,719 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/ltp-controllers-69b3cce21727ff69d6f2227e/log.txt.gz 2026-03-13 08:44:07,985 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-13 08:44:08,224 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-13 08:44:08,227 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/ltp-controllers-69b3cce21727ff69d6f2227e/lava-logs.yaml 2026-03-13 08:44:08,238 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-13 08:44:08,393 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-13 08:44:08,394 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/ltp-controllers-69b3cce21727ff69d6f2227e/lava_callback.json.gz 2026-03-13 08:44:08,421 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 08:44:08,435 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b3cce21727ff69d6f2227e HTTP/1.1" 200 None 2026-03-13 08:44:08,437 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 08:44:08,450 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b3c7f91727ff69d6f21d89 HTTP/1.1" 200 None 2026-03-13 08:44:08,452 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 08:44:08,484 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b3cce21727ff69d6f2227e HTTP/1.1" 200 None 2026-03-13 08:44:08,486 - lava_callback - INFO - Completed processing callback for node 69b3cce21727ff69d6f2227e 2026-03-13 08:44:09,004 - lava_callback - INFO - Received callback for node 69b3cce81727ff69d6f22289 INFO: 172.21.0.1:55400 - "POST /node/69b3cce81727ff69d6f22289 HTTP/1.0" 202 Accepted 2026-03-13 08:44:09,011 - lava_callback - INFO - Starting async job submit for node 69b3cce81727ff69d6f22289 2026-03-13 08:44:09,053 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 08:44:09,068 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b3cce81727ff69d6f22289 HTTP/1.1" 200 None 2026-03-13 08:44:09,069 - lava_callback - DEBUG - Processing node 69b3cce81727ff69d6f22289: ltp-fs_bind 2026-03-13 08:44:09,461 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-13 08:44:09,627 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-13 08:44:09,629 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/ltp-fs_bind-69b3cce81727ff69d6f22289/log.txt.gz 2026-03-13 08:44:09,857 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-13 08:44:10,080 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-13 08:44:10,083 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/ltp-fs_bind-69b3cce81727ff69d6f22289/lava-logs.yaml 2026-03-13 08:44:10,092 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-13 08:44:10,267 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-13 08:44:10,269 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/ltp-fs_bind-69b3cce81727ff69d6f22289/lava_callback.json.gz 2026-03-13 08:44:10,293 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 08:44:10,308 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b3cce81727ff69d6f22289 HTTP/1.1" 200 None 2026-03-13 08:44:10,310 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 08:44:10,324 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b3c7f91727ff69d6f21d89 HTTP/1.1" 200 None 2026-03-13 08:44:10,326 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 08:44:10,359 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b3cce81727ff69d6f22289 HTTP/1.1" 200 None 2026-03-13 08:44:10,361 - lava_callback - INFO - Completed processing callback for node 69b3cce81727ff69d6f22289 INFO: 172.21.0.1:57758 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:57772 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57788 - "GET / HTTP/1.0" 200 OK 2026-03-13 08:44:20,935 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 08:44:20,951 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:36884 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49666 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41746 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46238 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56172 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48754 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:48756 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48766 - "GET / HTTP/1.0" 200 OK 2026-03-13 08:45:22,212 - lava_callback - INFO - Received callback for node 69b3cce01727ff69d6f22269 INFO: 172.21.0.1:47314 - "POST /node/69b3cce01727ff69d6f22269 HTTP/1.0" 202 Accepted 2026-03-13 08:45:22,218 - lava_callback - INFO - Starting async job submit for node 69b3cce01727ff69d6f22269 2026-03-13 08:45:22,253 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 08:45:22,269 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b3cce01727ff69d6f22269 HTTP/1.1" 200 None 2026-03-13 08:45:22,270 - lava_callback - DEBUG - Processing node 69b3cce01727ff69d6f22269: ltp-cap_bounds 2026-03-13 08:45:22,696 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-13 08:45:22,852 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-13 08:45:22,854 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/ltp-cap_bounds-69b3cce01727ff69d6f22269/log.txt.gz 2026-03-13 08:45:23,102 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-13 08:45:23,356 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-13 08:45:23,359 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/ltp-cap_bounds-69b3cce01727ff69d6f22269/lava-logs.yaml 2026-03-13 08:45:23,368 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-13 08:45:23,631 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-13 08:45:23,633 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/ltp-cap_bounds-69b3cce01727ff69d6f22269/lava_callback.json.gz 2026-03-13 08:45:23,669 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 08:45:23,684 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b3cce01727ff69d6f22269 HTTP/1.1" 200 None 2026-03-13 08:45:23,686 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 08:45:23,701 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b3c7f91727ff69d6f21d89 HTTP/1.1" 200 None 2026-03-13 08:45:23,703 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 08:45:23,729 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b3cce01727ff69d6f22269 HTTP/1.1" 200 None 2026-03-13 08:45:23,731 - lava_callback - INFO - Completed processing callback for node 69b3cce01727ff69d6f22269 INFO: 172.21.0.1:47322 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59462 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46540 - "GET / HTTP/1.0" 200 OK 2026-03-13 08:45:47,366 - lava_callback - INFO - Received callback for node 69b3ccea1727ff69d6f2228e INFO: 172.21.0.1:46556 - "POST /node/69b3ccea1727ff69d6f2228e HTTP/1.0" 202 Accepted 2026-03-13 08:45:47,373 - lava_callback - INFO - Starting async job submit for node 69b3ccea1727ff69d6f2228e 2026-03-13 08:45:47,397 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 08:45:47,411 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b3ccea1727ff69d6f2228e HTTP/1.1" 200 None 2026-03-13 08:45:47,412 - lava_callback - DEBUG - Processing node 69b3ccea1727ff69d6f2228e: ltp-fsx 2026-03-13 08:45:47,756 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-13 08:45:47,869 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-13 08:45:47,871 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/ltp-fsx-69b3ccea1727ff69d6f2228e/log.txt.gz 2026-03-13 08:45:48,075 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-13 08:45:48,309 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-13 08:45:48,311 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/ltp-fsx-69b3ccea1727ff69d6f2228e/lava-logs.yaml 2026-03-13 08:45:48,320 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-13 08:45:48,493 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-13 08:45:48,495 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/ltp-fsx-69b3ccea1727ff69d6f2228e/lava_callback.json.gz 2026-03-13 08:45:48,541 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 08:45:48,556 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b3ccea1727ff69d6f2228e HTTP/1.1" 200 None 2026-03-13 08:45:48,558 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 08:45:48,577 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b3c7f91727ff69d6f21d89 HTTP/1.1" 200 None 2026-03-13 08:45:48,579 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 08:45:48,622 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b3ccea1727ff69d6f2228e HTTP/1.1" 200 None 2026-03-13 08:45:48,624 - lava_callback - INFO - Completed processing callback for node 69b3ccea1727ff69d6f2228e 2026-03-13 08:45:49,191 - lava_callback - INFO - Received callback for node 69b3cceb1727ff69d6f22291 INFO: 172.21.0.1:46558 - "POST /node/69b3cceb1727ff69d6f22291 HTTP/1.0" 202 Accepted 2026-03-13 08:45:49,198 - lava_callback - INFO - Starting async job submit for node 69b3cceb1727ff69d6f22291 2026-03-13 08:45:49,223 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 08:45:49,238 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b3cceb1727ff69d6f22291 HTTP/1.1" 200 None 2026-03-13 08:45:49,239 - lava_callback - DEBUG - Processing node 69b3cceb1727ff69d6f22291: ltp-input 2026-03-13 08:45:49,579 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-13 08:45:49,702 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-13 08:45:49,704 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/ltp-input-69b3cceb1727ff69d6f22291/log.txt.gz 2026-03-13 08:45:49,911 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-13 08:45:50,108 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-13 08:45:50,110 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/ltp-input-69b3cceb1727ff69d6f22291/lava-logs.yaml 2026-03-13 08:45:50,119 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-13 08:45:50,363 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-13 08:45:50,364 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/ltp-input-69b3cceb1727ff69d6f22291/lava_callback.json.gz 2026-03-13 08:45:50,390 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 08:45:50,407 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b3cceb1727ff69d6f22291 HTTP/1.1" 200 None 2026-03-13 08:45:50,409 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 08:45:50,430 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b3c7f91727ff69d6f21d89 HTTP/1.1" 200 None 2026-03-13 08:45:50,432 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 08:45:50,456 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b3cceb1727ff69d6f22291 HTTP/1.1" 200 None 2026-03-13 08:45:50,465 - lava_callback - INFO - Completed processing callback for node 69b3cceb1727ff69d6f22291 2026-03-13 08:45:50,954 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 08:45:50,981 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:52808 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35886 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39598 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:39602 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39610 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35454 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41006 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37416 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53524 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42046 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47154 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:47170 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47184 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41982 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33406 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36202 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43182 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47244 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44178 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:44192 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44204 - "GET / HTTP/1.0" 200 OK 2026-03-13 08:48:22,500 - lava_callback - INFO - Received callback for node 69b3cf391727ff69d6f22427 INFO: 172.21.0.1:51700 - "POST /node/69b3cf391727ff69d6f22427 HTTP/1.0" 202 Accepted 2026-03-13 08:48:22,506 - lava_callback - INFO - Starting async job submit for node 69b3cf391727ff69d6f22427 2026-03-13 08:48:22,509 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 08:48:22,530 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b3cf391727ff69d6f22427 HTTP/1.1" 200 None 2026-03-13 08:48:22,531 - lava_callback - DEBUG - Processing node 69b3cf391727ff69d6f22427: baseline-arm 2026-03-13 08:48:22,537 - lava_callback - WARNING - Failed to upload log 2026-03-13 08:48:22,541 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-13 08:48:22,917 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-13 08:48:22,919 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm-69b3cf391727ff69d6f22427/lava-logs.yaml 2026-03-13 08:48:22,921 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-13 08:48:23,074 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-13 08:48:23,076 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-69b3cf391727ff69d6f22427/lava_callback.json.gz 2026-03-13 08:48:23,080 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 08:48:23,095 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b3cf391727ff69d6f22427 HTTP/1.1" 200 None 2026-03-13 08:48:23,097 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 08:48:23,141 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b3c7f91727ff69d6f21d89 HTTP/1.1" 200 None 2026-03-13 08:48:23,143 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 08:48:23,164 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b3cf391727ff69d6f22427 HTTP/1.1" 200 None 2026-03-13 08:48:23,175 - lava_callback - INFO - Completed processing callback for node 69b3cf391727ff69d6f22427 INFO: 172.21.0.1:51706 - "GET / HTTP/1.0" 200 OK 2026-03-13 08:48:27,138 - lava_callback - INFO - Received callback for node 69b3cced1727ff69d6f22294 INFO: 172.21.0.1:51714 - "POST /node/69b3cced1727ff69d6f22294 HTTP/1.0" 202 Accepted 2026-03-13 08:48:27,149 - lava_callback - INFO - Starting async job submit for node 69b3cced1727ff69d6f22294 2026-03-13 08:48:27,192 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 08:48:27,219 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b3cced1727ff69d6f22294 HTTP/1.1" 200 None 2026-03-13 08:48:27,220 - lava_callback - DEBUG - Processing node 69b3cced1727ff69d6f22294: ltp-ipc 2026-03-13 08:48:27,744 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-13 08:48:27,984 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-13 08:48:27,986 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/ltp-ipc-69b3cced1727ff69d6f22294/log.txt.gz 2026-03-13 08:48:28,221 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-13 08:48:28,693 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-13 08:48:28,695 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/ltp-ipc-69b3cced1727ff69d6f22294/lava-logs.yaml 2026-03-13 08:48:28,705 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-13 08:48:28,859 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-13 08:48:28,861 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/ltp-ipc-69b3cced1727ff69d6f22294/lava_callback.json.gz 2026-03-13 08:48:28,888 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 08:48:28,909 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b3cced1727ff69d6f22294 HTTP/1.1" 200 None 2026-03-13 08:48:28,911 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 08:48:28,932 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b3c7f91727ff69d6f21d89 HTTP/1.1" 200 None 2026-03-13 08:48:28,935 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 08:48:28,977 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b3cced1727ff69d6f22294 HTTP/1.1" 200 None 2026-03-13 08:48:28,979 - lava_callback - INFO - Completed processing callback for node 69b3cced1727ff69d6f22294 INFO: 172.21.0.1:34340 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39178 - "GET / HTTP/1.0" 200 OK 2026-03-13 08:48:50,984 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 08:48:51,012 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:58046 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42826 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41962 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:41972 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41986 - "GET / HTTP/1.0" 200 OK 2026-03-13 08:49:22,322 - lava_callback - INFO - Received callback for node 69b3caed1727ff69d6f22177 INFO: 172.21.0.1:37512 - "POST /node/69b3caed1727ff69d6f22177 HTTP/1.0" 202 Accepted 2026-03-13 08:49:22,334 - lava_callback - INFO - Starting async job submit for node 69b3caed1727ff69d6f22177 2026-03-13 08:49:22,451 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 08:49:22,477 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b3caed1727ff69d6f22177 HTTP/1.1" 200 None 2026-03-13 08:49:22,478 - lava_callback - DEBUG - Processing node 69b3caed1727ff69d6f22177: ltp-smoke 2026-03-13 08:49:23,162 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-13 08:49:23,488 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-13 08:49:23,490 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/ltp-smoke-69b3caed1727ff69d6f22177/log.txt.gz 2026-03-13 08:49:23,805 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-13 08:49:23,972 - lava_callback - INFO - Received callback for node 69b3ccef1727ff69d6f2229e INFO: 172.21.0.1:37522 - "POST /node/69b3ccef1727ff69d6f2229e HTTP/1.0" 202 Accepted 2026-03-13 08:49:23,982 - lava_callback - INFO - Starting async job submit for node 69b3ccef1727ff69d6f2229e 2026-03-13 08:49:24,040 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 08:49:24,066 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b3ccef1727ff69d6f2229e HTTP/1.1" 200 None 2026-03-13 08:49:24,067 - lava_callback - DEBUG - Processing node 69b3ccef1727ff69d6f2229e: ltp-sched 2026-03-13 08:49:24,381 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-13 08:49:24,424 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/ltp-smoke-69b3caed1727ff69d6f22177/lava-logs.yaml 2026-03-13 08:49:24,524 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-13 08:49:24,543 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-13 08:49:24,991 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-13 08:49:24,994 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/ltp-sched-69b3ccef1727ff69d6f2229e/log.txt.gz 2026-03-13 08:49:25,030 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-13 08:49:25,062 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/ltp-smoke-69b3caed1727ff69d6f22177/lava_callback.json.gz 2026-03-13 08:49:25,340 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 08:49:25,405 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b3caed1727ff69d6f22177 HTTP/1.1" 200 None 2026-03-13 08:49:25,407 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 08:49:25,419 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-13 08:49:25,467 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b3c7ff1727ff69d6f21d8f HTTP/1.1" 200 None 2026-03-13 08:49:25,470 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 08:49:25,515 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b3caed1727ff69d6f22177 HTTP/1.1" 200 None 2026-03-13 08:49:25,723 - lava_callback - INFO - Completed processing callback for node 69b3caed1727ff69d6f22177 2026-03-13 08:49:26,078 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-13 08:49:26,080 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/ltp-sched-69b3ccef1727ff69d6f2229e/lava-logs.yaml 2026-03-13 08:49:26,089 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-13 08:49:26,229 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-13 08:49:26,230 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/ltp-sched-69b3ccef1727ff69d6f2229e/lava_callback.json.gz 2026-03-13 08:49:26,256 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 08:49:26,270 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b3ccef1727ff69d6f2229e HTTP/1.1" 200 None 2026-03-13 08:49:26,271 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 08:49:26,285 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b3c7f91727ff69d6f21d89 HTTP/1.1" 200 None 2026-03-13 08:49:26,286 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 08:49:26,327 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b3ccef1727ff69d6f2229e HTTP/1.1" 200 None 2026-03-13 08:49:26,331 - lava_callback - INFO - Completed processing callback for node 69b3ccef1727ff69d6f2229e INFO: 172.21.0.1:37538 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47268 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34172 - "GET / HTTP/1.0" 200 OK 2026-03-13 08:49:47,170 - lava_callback - INFO - Received callback for node 69b3ccf11727ff69d6f222a5 INFO: 172.21.0.1:34188 - "POST /node/69b3ccf11727ff69d6f222a5 HTTP/1.0" 202 Accepted 2026-03-13 08:49:47,178 - lava_callback - INFO - Starting async job submit for node 69b3ccf11727ff69d6f222a5 2026-03-13 08:49:47,204 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 08:49:47,239 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b3ccf11727ff69d6f222a5 HTTP/1.1" 200 None 2026-03-13 08:49:47,240 - lava_callback - DEBUG - Processing node 69b3ccf11727ff69d6f222a5: ltp-smoke 2026-03-13 08:49:47,809 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-13 08:49:47,944 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-13 08:49:47,945 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/ltp-smoke-69b3ccf11727ff69d6f222a5/log.txt.gz 2026-03-13 08:49:48,250 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-13 08:49:48,548 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-13 08:49:48,550 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/ltp-smoke-69b3ccf11727ff69d6f222a5/lava-logs.yaml 2026-03-13 08:49:48,559 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-13 08:49:48,698 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-13 08:49:48,700 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/ltp-smoke-69b3ccf11727ff69d6f222a5/lava_callback.json.gz 2026-03-13 08:49:48,725 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 08:49:48,740 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b3ccf11727ff69d6f222a5 HTTP/1.1" 200 None 2026-03-13 08:49:48,741 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 08:49:48,755 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b3c7f91727ff69d6f21d89 HTTP/1.1" 200 None 2026-03-13 08:49:48,756 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 08:49:48,761 - lava_callback - INFO - Received callback for node 69b3ccf51727ff69d6f222af INFO: 172.21.0.1:34200 - "POST /node/69b3ccf51727ff69d6f222af HTTP/1.0" 202 Accepted 2026-03-13 08:49:48,768 - lava_callback - INFO - Starting async job submit for node 69b3ccf51727ff69d6f222af 2026-03-13 08:49:48,796 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 08:49:48,816 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b3ccf11727ff69d6f222a5 HTTP/1.1" 200 None 2026-03-13 08:49:48,818 - lava_callback - INFO - Completed processing callback for node 69b3ccf11727ff69d6f222a5 2026-03-13 08:49:48,865 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b3ccf51727ff69d6f222af HTTP/1.1" 200 None 2026-03-13 08:49:48,868 - lava_callback - DEBUG - Processing node 69b3ccf51727ff69d6f222af: ltp-syscalls-ipc 2026-03-13 08:49:49,587 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-13 08:49:49,711 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-13 08:49:49,712 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/ltp-syscalls-ipc-69b3ccf51727ff69d6f222af/log.txt.gz 2026-03-13 08:49:50,058 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-13 08:49:50,350 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-13 08:49:50,352 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/ltp-syscalls-ipc-69b3ccf51727ff69d6f222af/lava-logs.yaml 2026-03-13 08:49:50,361 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-13 08:49:50,507 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-13 08:49:50,509 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/ltp-syscalls-ipc-69b3ccf51727ff69d6f222af/lava_callback.json.gz 2026-03-13 08:49:50,535 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 08:49:50,552 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b3ccf51727ff69d6f222af HTTP/1.1" 200 None 2026-03-13 08:49:50,554 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 08:49:50,568 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b3c7f91727ff69d6f21d89 HTTP/1.1" 200 None 2026-03-13 08:49:50,570 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 08:49:50,596 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b3ccf51727ff69d6f222af HTTP/1.1" 200 None 2026-03-13 08:49:50,597 - lava_callback - INFO - Completed processing callback for node 69b3ccf51727ff69d6f222af 2026-03-13 08:49:51,015 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 08:49:51,043 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 15 INFO: 172.21.0.1:46338 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52692 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58162 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:58174 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58178 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40384 - "GET / HTTP/1.0" 200 OK 2026-03-13 08:50:26,736 - lava_callback - INFO - Received callback for node 69b3cfbf1727ff69d6f2248e INFO: 172.21.0.1:40390 - "POST /node/69b3cfbf1727ff69d6f2248e HTTP/1.0" 202 Accepted 2026-03-13 08:50:26,746 - lava_callback - INFO - Starting async job submit for node 69b3cfbf1727ff69d6f2248e 2026-03-13 08:50:26,751 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 08:50:26,782 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b3cfbf1727ff69d6f2248e HTTP/1.1" 200 None 2026-03-13 08:50:26,783 - lava_callback - DEBUG - Processing node 69b3cfbf1727ff69d6f2248e: baseline-arm64 2026-03-13 08:50:26,791 - lava_callback - WARNING - Failed to upload log 2026-03-13 08:50:26,796 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-13 08:50:27,095 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-13 08:50:27,098 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69b3cfbf1727ff69d6f2248e/lava-logs.yaml 2026-03-13 08:50:27,100 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-13 08:50:27,480 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-13 08:50:27,482 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69b3cfbf1727ff69d6f2248e/lava_callback.json.gz 2026-03-13 08:50:27,488 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 08:50:27,522 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b3cfbf1727ff69d6f2248e HTTP/1.1" 200 None 2026-03-13 08:50:27,528 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 08:50:27,564 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b3c8061727ff69d6f21d98 HTTP/1.1" 200 None 2026-03-13 08:50:27,566 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 08:50:27,616 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b3cfbf1727ff69d6f2248e HTTP/1.1" 200 None 2026-03-13 08:50:27,621 - lava_callback - INFO - Completed processing callback for node 69b3cfbf1727ff69d6f2248e INFO: 172.21.0.1:41376 - "GET / HTTP/1.0" 200 OK 2026-03-13 08:50:44,037 - lava_callback - INFO - Received callback for node 69b3cf691727ff69d6f2243a INFO: 172.21.0.1:32798 - "POST /node/69b3cf691727ff69d6f2243a HTTP/1.0" 202 Accepted 2026-03-13 08:50:44,047 - lava_callback - INFO - Starting async job submit for node 69b3cf691727ff69d6f2243a 2026-03-13 08:50:44,084 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 08:50:44,111 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b3cf691727ff69d6f2243a HTTP/1.1" 200 None 2026-03-13 08:50:44,113 - lava_callback - DEBUG - Processing node 69b3cf691727ff69d6f2243a: baseline-arm-pengutronix 2026-03-13 08:50:44,333 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-13 08:50:44,882 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-13 08:50:44,884 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-pengutronix-69b3cf691727ff69d6f2243a/log.txt.gz 2026-03-13 08:50:45,093 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-13 08:50:45,685 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-13 08:50:45,688 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm-pengutronix-69b3cf691727ff69d6f2243a/lava-logs.yaml 2026-03-13 08:50:45,694 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-13 08:50:46,456 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-13 08:50:46,458 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-pengutronix-69b3cf691727ff69d6f2243a/lava_callback.json.gz INFO: 172.21.0.1:32806 - "GET / HTTP/1.0" 200 OK 2026-03-13 08:50:46,537 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 08:50:46,560 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b3cf691727ff69d6f2243a HTTP/1.1" 200 None 2026-03-13 08:50:46,562 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 08:50:46,586 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b3c7f91727ff69d6f21d89 HTTP/1.1" 200 None 2026-03-13 08:50:46,589 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 08:50:46,647 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b3cf691727ff69d6f2243a HTTP/1.1" 200 None 2026-03-13 08:50:46,753 - lava_callback - INFO - Completed processing callback for node 69b3cf691727ff69d6f2243a 2026-03-13 08:50:51,046 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 08:50:51,062 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:32830 - "GET / HTTP/1.0" 200 OK 2026-03-13 08:50:57,262 - lava_callback - INFO - Received callback for node 69b3cfdf1727ff69d6f224f9 INFO: 172.21.0.1:32834 - "POST /node/69b3cfdf1727ff69d6f224f9 HTTP/1.0" 202 Accepted 2026-03-13 08:50:57,272 - lava_callback - INFO - Starting async job submit for node 69b3cfdf1727ff69d6f224f9 2026-03-13 08:50:57,276 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 08:50:57,298 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b3cfdf1727ff69d6f224f9 HTTP/1.1" 200 None 2026-03-13 08:50:57,299 - lava_callback - DEBUG - Processing node 69b3cfdf1727ff69d6f224f9: baseline-nfs-arm64 2026-03-13 08:50:57,302 - lava_callback - WARNING - Failed to upload log 2026-03-13 08:50:57,304 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-13 08:50:57,880 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-13 08:50:57,882 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69b3cfdf1727ff69d6f224f9/lava-logs.yaml 2026-03-13 08:50:57,884 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-13 08:50:58,534 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-13 08:50:58,536 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69b3cfdf1727ff69d6f224f9/lava_callback.json.gz 2026-03-13 08:50:58,539 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 08:50:58,556 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b3cfdf1727ff69d6f224f9 HTTP/1.1" 200 None 2026-03-13 08:50:58,558 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 08:50:58,597 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b3c8061727ff69d6f21d98 HTTP/1.1" 200 None 2026-03-13 08:50:58,599 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 08:50:58,640 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b3cfdf1727ff69d6f224f9 HTTP/1.1" 200 None 2026-03-13 08:50:58,644 - lava_callback - INFO - Completed processing callback for node 69b3cfdf1727ff69d6f224f9 2026-03-13 08:51:01,794 - lava_callback - INFO - Received callback for node 69b3cfcc1727ff69d6f224af INFO: 172.21.0.1:33554 - "POST /node/69b3cfcc1727ff69d6f224af HTTP/1.0" 202 Accepted 2026-03-13 08:51:01,804 - lava_callback - INFO - Starting async job submit for node 69b3cfcc1727ff69d6f224af 2026-03-13 08:51:01,840 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 08:51:01,867 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b3cfcc1727ff69d6f224af HTTP/1.1" 200 None 2026-03-13 08:51:01,869 - lava_callback - DEBUG - Processing node 69b3cfcc1727ff69d6f224af: baseline-arm64 2026-03-13 08:51:02,127 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-13 08:51:02,997 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-13 08:51:02,999 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-69b3cfcc1727ff69d6f224af/log.txt.gz 2026-03-13 08:51:03,141 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-13 08:51:03,899 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-13 08:51:03,901 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69b3cfcc1727ff69d6f224af/lava-logs.yaml 2026-03-13 08:51:03,907 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-13 08:51:04,602 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-13 08:51:04,604 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69b3cfcc1727ff69d6f224af/lava_callback.json.gz 2026-03-13 08:51:04,636 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 08:51:04,652 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b3cfcc1727ff69d6f224af HTTP/1.1" 200 None 2026-03-13 08:51:04,654 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 08:51:04,668 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b3c8061727ff69d6f21d98 HTTP/1.1" 200 None 2026-03-13 08:51:04,670 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 08:51:04,717 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b3cfcc1727ff69d6f224af HTTP/1.1" 200 None 2026-03-13 08:51:04,721 - lava_callback - INFO - Completed processing callback for node 69b3cfcc1727ff69d6f224af INFO: 172.21.0.1:33566 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51094 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:51106 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51112 - "GET / HTTP/1.0" 200 OK 2026-03-13 08:51:21,065 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 08:51:21,086 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:50844 - "GET / HTTP/1.0" 200 OK 2026-03-13 08:51:28,207 - lava_callback - INFO - Received callback for node 69b3cfc01727ff69d6f22494 INFO: 172.21.0.1:50856 - "POST /node/69b3cfc01727ff69d6f22494 HTTP/1.0" 202 Accepted 2026-03-13 08:51:28,218 - lava_callback - INFO - Starting async job submit for node 69b3cfc01727ff69d6f22494 2026-03-13 08:51:28,260 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 08:51:28,290 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b3cfc01727ff69d6f22494 HTTP/1.1" 200 None 2026-03-13 08:51:28,291 - lava_callback - DEBUG - Processing node 69b3cfc01727ff69d6f22494: baseline-arm64 2026-03-13 08:51:28,812 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-13 08:51:29,381 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-13 08:51:29,383 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-69b3cfc01727ff69d6f22494/log.txt.gz 2026-03-13 08:51:29,625 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-13 08:51:30,430 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-13 08:51:30,433 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69b3cfc01727ff69d6f22494/lava-logs.yaml 2026-03-13 08:51:30,441 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-13 08:51:30,978 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-13 08:51:30,980 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69b3cfc01727ff69d6f22494/lava_callback.json.gz 2026-03-13 08:51:31,019 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 08:51:31,041 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b3cfc01727ff69d6f22494 HTTP/1.1" 200 None 2026-03-13 08:51:31,044 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 08:51:31,065 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b3c8061727ff69d6f21d98 HTTP/1.1" 200 None 2026-03-13 08:51:31,068 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 08:51:31,104 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b3cfc01727ff69d6f22494 HTTP/1.1" 200 None 2026-03-13 08:51:31,106 - lava_callback - INFO - Completed processing callback for node 69b3cfc01727ff69d6f22494 INFO: 172.21.0.1:38580 - "GET / HTTP/1.0" 200 OK 2026-03-13 08:51:43,269 - lava_callback - INFO - Received callback for node 69b3cfc41727ff69d6f2249d INFO: 172.21.0.1:53084 - "POST /node/69b3cfc41727ff69d6f2249d HTTP/1.0" 202 Accepted 2026-03-13 08:51:43,280 - lava_callback - INFO - Starting async job submit for node 69b3cfc41727ff69d6f2249d 2026-03-13 08:51:43,332 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 08:51:43,353 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b3cfc41727ff69d6f2249d HTTP/1.1" 200 None 2026-03-13 08:51:43,354 - lava_callback - DEBUG - Processing node 69b3cfc41727ff69d6f2249d: baseline-arm64 2026-03-13 08:51:43,620 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-13 08:51:44,134 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-13 08:51:44,136 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-69b3cfc41727ff69d6f2249d/log.txt.gz 2026-03-13 08:51:44,266 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-13 08:51:44,966 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-13 08:51:44,968 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69b3cfc41727ff69d6f2249d/lava-logs.yaml 2026-03-13 08:51:44,973 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-13 08:51:45,483 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-13 08:51:45,485 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69b3cfc41727ff69d6f2249d/lava_callback.json.gz 2026-03-13 08:51:45,534 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 08:51:45,563 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b3cfc41727ff69d6f2249d HTTP/1.1" 200 None 2026-03-13 08:51:45,565 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 08:51:45,584 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b3c8061727ff69d6f21d98 HTTP/1.1" 200 None 2026-03-13 08:51:45,588 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 08:51:45,618 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b3cfc41727ff69d6f2249d HTTP/1.1" 200 None 2026-03-13 08:51:45,690 - lava_callback - INFO - Completed processing callback for node 69b3cfc41727ff69d6f2249d 2026-03-13 08:51:45,988 - lava_callback - INFO - Received callback for node 69b3cfc01727ff69d6f22491 INFO: 172.21.0.1:53090 - "POST /node/69b3cfc01727ff69d6f22491 HTTP/1.0" 202 Accepted 2026-03-13 08:51:45,999 - lava_callback - INFO - Starting async job submit for node 69b3cfc01727ff69d6f22491 2026-03-13 08:51:46,036 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 08:51:46,053 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b3cfc01727ff69d6f22491 HTTP/1.1" 200 None 2026-03-13 08:51:46,055 - lava_callback - DEBUG - Processing node 69b3cfc01727ff69d6f22491: baseline-arm64 2026-03-13 08:51:46,442 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 INFO: 172.21.0.1:53106 - "GET / HTTP/1.0" 200 OK 2026-03-13 08:51:47,008 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-13 08:51:47,010 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-69b3cfc01727ff69d6f22491/log.txt.gz 2026-03-13 08:51:47,288 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-13 08:51:47,834 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-13 08:51:47,837 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69b3cfc01727ff69d6f22491/lava-logs.yaml 2026-03-13 08:51:47,843 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-13 08:51:48,429 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-13 08:51:48,431 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69b3cfc01727ff69d6f22491/lava_callback.json.gz 2026-03-13 08:51:48,467 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 08:51:48,483 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b3cfc01727ff69d6f22491 HTTP/1.1" 200 None 2026-03-13 08:51:48,486 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 08:51:48,504 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b3c8061727ff69d6f21d98 HTTP/1.1" 200 None 2026-03-13 08:51:48,506 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 08:51:48,542 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b3cfc01727ff69d6f22491 HTTP/1.1" 200 None 2026-03-13 08:51:48,544 - lava_callback - INFO - Completed processing callback for node 69b3cfc01727ff69d6f22491 2026-03-13 08:51:50,072 - lava_callback - INFO - Received callback for node 69b3cfc61727ff69d6f224a3 INFO: 172.21.0.1:52254 - "POST /node/69b3cfc61727ff69d6f224a3 HTTP/1.0" 202 Accepted 2026-03-13 08:51:50,082 - lava_callback - INFO - Starting async job submit for node 69b3cfc61727ff69d6f224a3 2026-03-13 08:51:50,136 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 08:51:50,167 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b3cfc61727ff69d6f224a3 HTTP/1.1" 200 None 2026-03-13 08:51:50,169 - lava_callback - DEBUG - Processing node 69b3cfc61727ff69d6f224a3: baseline-arm64 2026-03-13 08:51:50,595 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-13 08:51:51,089 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 08:51:51,117 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 2026-03-13 08:51:51,250 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-13 08:51:51,252 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-69b3cfc61727ff69d6f224a3/log.txt.gz 2026-03-13 08:51:51,466 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-13 08:51:52,083 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-13 08:51:52,086 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69b3cfc61727ff69d6f224a3/lava-logs.yaml 2026-03-13 08:51:52,095 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-13 08:51:52,585 - lava_callback - INFO - Received callback for node 69b3cfcd1727ff69d6f224b2 INFO: 172.21.0.1:52266 - "POST /node/69b3cfcd1727ff69d6f224b2 HTTP/1.0" 202 Accepted 2026-03-13 08:51:52,597 - lava_callback - INFO - Starting async job submit for node 69b3cfcd1727ff69d6f224b2 2026-03-13 08:51:52,605 - lava_callback - INFO - Received callback for node 69b12d1fa870a1dc3343bdb3 INFO: 172.21.0.1:52270 - "POST /node/69b12d1fa870a1dc3343bdb3 HTTP/1.0" 202 Accepted 2026-03-13 08:51:52,620 - lava_callback - INFO - Starting async job submit for node 69b12d1fa870a1dc3343bdb3 2026-03-13 08:51:52,632 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 08:51:52,646 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 08:51:52,664 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b12d1fa870a1dc3343bdb3 HTTP/1.1" 200 None 2026-03-13 08:51:52,666 - lava_callback - DEBUG - Processing node 69b12d1fa870a1dc3343bdb3: baseline-arm-baylibre 2026-03-13 08:51:52,666 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b12d1fa870a1dc3343bdb3 2026-03-13 08:51:52,667 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 08:51:52,667 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b3cfcd1727ff69d6f224b2 HTTP/1.1" 200 None 2026-03-13 08:51:52,669 - lava_callback - DEBUG - Processing node 69b3cfcd1727ff69d6f224b2: baseline-arm64 2026-03-13 08:51:52,746 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b12d1fa870a1dc3343bdb3 HTTP/1.1" 200 None 2026-03-13 08:51:52,772 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 08:51:52,838 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-13 08:51:52,857 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ae8223c660ead8a389aafd HTTP/1.1" 200 None 2026-03-13 08:51:52,901 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69b3cfc61727ff69d6f224a3/lava_callback.json.gz 2026-03-13 08:51:52,934 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 08:51:53,020 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 08:51:53,055 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b12d1fa870a1dc3343bdb3 HTTP/1.1" 200 None 2026-03-13 08:51:53,077 - lava_callback - ERROR - Error processing callback for node 69b12d1fa870a1dc3343bdb3: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' 2026-03-13 08:51:53,124 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b3cfc61727ff69d6f224a3 HTTP/1.1" 200 None 2026-03-13 08:51:53,128 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 08:51:53,152 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-13 08:51:53,188 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b3c8061727ff69d6f21d98 HTTP/1.1" 200 None 2026-03-13 08:51:53,191 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 08:51:53,243 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b3cfc61727ff69d6f224a3 HTTP/1.1" 200 None 2026-03-13 08:51:53,245 - lava_callback - INFO - Completed processing callback for node 69b3cfc61727ff69d6f224a3 2026-03-13 08:51:53,885 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-13 08:51:53,887 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-69b3cfcd1727ff69d6f224b2/log.txt.gz 2026-03-13 08:51:54,113 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-13 08:51:54,910 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-13 08:51:54,913 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69b3cfcd1727ff69d6f224b2/lava-logs.yaml 2026-03-13 08:51:54,920 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-13 08:51:55,387 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-13 08:51:55,389 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69b3cfcd1727ff69d6f224b2/lava_callback.json.gz 2026-03-13 08:51:55,429 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 08:51:55,449 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b3cfcd1727ff69d6f224b2 HTTP/1.1" 200 None 2026-03-13 08:51:55,451 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 08:51:55,465 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b3c8061727ff69d6f21d98 HTTP/1.1" 200 None 2026-03-13 08:51:55,467 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 08:51:55,495 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b3cfcd1727ff69d6f224b2 HTTP/1.1" 200 None 2026-03-13 08:51:55,497 - lava_callback - INFO - Completed processing callback for node 69b3cfcd1727ff69d6f224b2 INFO: 172.21.0.1:52286 - "GET / HTTP/1.0" 200 OK 2026-03-13 08:52:00,606 - lava_callback - INFO - Received callback for node 69b3cfd01727ff69d6f224b8 INFO: 172.21.0.1:44570 - "POST /node/69b3cfd01727ff69d6f224b8 HTTP/1.0" 202 Accepted 2026-03-13 08:52:00,614 - lava_callback - INFO - Starting async job submit for node 69b3cfd01727ff69d6f224b8 2026-03-13 08:52:00,651 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 08:52:00,667 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b3cfd01727ff69d6f224b8 HTTP/1.1" 200 None 2026-03-13 08:52:00,668 - lava_callback - DEBUG - Processing node 69b3cfd01727ff69d6f224b8: baseline-arm64 2026-03-13 08:52:01,063 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-13 08:52:01,513 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-13 08:52:01,515 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-69b3cfd01727ff69d6f224b8/log.txt.gz 2026-03-13 08:52:01,717 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-13 08:52:02,256 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-13 08:52:02,259 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69b3cfd01727ff69d6f224b8/lava-logs.yaml 2026-03-13 08:52:02,266 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-13 08:52:02,554 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-13 08:52:02,556 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69b3cfd01727ff69d6f224b8/lava_callback.json.gz 2026-03-13 08:52:02,592 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 08:52:02,616 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b3cfd01727ff69d6f224b8 HTTP/1.1" 200 None 2026-03-13 08:52:02,619 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 08:52:02,633 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b3c8061727ff69d6f21d98 HTTP/1.1" 200 None 2026-03-13 08:52:02,635 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 08:52:02,667 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b3cfd01727ff69d6f224b8 HTTP/1.1" 200 None 2026-03-13 08:52:02,668 - lava_callback - INFO - Completed processing callback for node 69b3cfd01727ff69d6f224b8 INFO: 172.21.0.1:44580 - "GET / HTTP/1.0" 200 OK 2026-03-13 08:52:11,424 - lava_callback - INFO - Received callback for node 69b3cfc31727ff69d6f2249a INFO: 172.21.0.1:55116 - "POST /node/69b3cfc31727ff69d6f2249a HTTP/1.0" 202 Accepted 2026-03-13 08:52:11,431 - lava_callback - INFO - Starting async job submit for node 69b3cfc31727ff69d6f2249a 2026-03-13 08:52:11,464 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 08:52:11,479 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b3cfc31727ff69d6f2249a HTTP/1.1" 200 None 2026-03-13 08:52:11,480 - lava_callback - DEBUG - Processing node 69b3cfc31727ff69d6f2249a: baseline-arm64 2026-03-13 08:52:11,617 - lava_callback - WARNING - Failed to upload log 2026-03-13 08:52:11,692 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-13 08:52:11,853 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-13 08:52:11,855 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69b3cfc31727ff69d6f2249a/lava-logs.yaml 2026-03-13 08:52:11,858 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-13 08:52:11,977 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-13 08:52:11,978 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69b3cfc31727ff69d6f2249a/lava_callback.json.gz 2026-03-13 08:52:12,007 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 08:52:12,043 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b3cfc31727ff69d6f2249a HTTP/1.1" 200 None 2026-03-13 08:52:12,045 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 08:52:12,069 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b3c8061727ff69d6f21d98 HTTP/1.1" 200 None 2026-03-13 08:52:12,071 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 08:52:12,076 - lava_callback - INFO - Received callback for node 69b3cfc91727ff69d6f224a9 INFO: 172.21.0.1:55128 - "POST /node/69b3cfc91727ff69d6f224a9 HTTP/1.0" 202 Accepted 2026-03-13 08:52:12,087 - lava_callback - INFO - Starting async job submit for node 69b3cfc91727ff69d6f224a9 2026-03-13 08:52:12,111 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 08:52:12,125 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b3cfc31727ff69d6f2249a HTTP/1.1" 200 None 2026-03-13 08:52:12,169 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b3cfc91727ff69d6f224a9 HTTP/1.1" 200 None 2026-03-13 08:52:12,171 - lava_callback - DEBUG - Processing node 69b3cfc91727ff69d6f224a9: baseline-arm64 2026-03-13 08:52:12,241 - lava_callback - INFO - Completed processing callback for node 69b3cfc31727ff69d6f2249a 2026-03-13 08:52:12,617 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-13 08:52:12,774 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-13 08:52:12,776 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-69b3cfc91727ff69d6f224a9/log.txt.gz 2026-03-13 08:52:13,013 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-13 08:52:13,225 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-13 08:52:13,227 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69b3cfc91727ff69d6f224a9/lava-logs.yaml 2026-03-13 08:52:13,235 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-13 08:52:13,366 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-13 08:52:13,368 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69b3cfc91727ff69d6f224a9/lava_callback.json.gz 2026-03-13 08:52:13,388 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 08:52:13,408 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b3cfc91727ff69d6f224a9 HTTP/1.1" 200 None 2026-03-13 08:52:13,410 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 08:52:13,439 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b3c8061727ff69d6f21d98 HTTP/1.1" 200 None 2026-03-13 08:52:13,441 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 08:52:13,473 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b3cfc91727ff69d6f224a9 HTTP/1.1" 200 None 2026-03-13 08:52:13,487 - lava_callback - INFO - Completed processing callback for node 69b3cfc91727ff69d6f224a9 2026-03-13 08:52:13,841 - lava_callback - INFO - Received callback for node 69b3cfe41727ff69d6f22502 INFO: 172.21.0.1:55144 - "POST /node/69b3cfe41727ff69d6f22502 HTTP/1.0" 202 Accepted 2026-03-13 08:52:13,848 - lava_callback - INFO - Starting async job submit for node 69b3cfe41727ff69d6f22502 2026-03-13 08:52:13,872 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 08:52:13,886 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b3cfe41727ff69d6f22502 HTTP/1.1" 200 None 2026-03-13 08:52:13,887 - lava_callback - DEBUG - Processing node 69b3cfe41727ff69d6f22502: baseline-nfs-arm64 2026-03-13 08:52:14,265 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-13 08:52:14,423 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-13 08:52:14,425 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69b3cfe41727ff69d6f22502/log.txt.gz 2026-03-13 08:52:14,642 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-13 08:52:14,835 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-13 08:52:14,838 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69b3cfe41727ff69d6f22502/lava-logs.yaml 2026-03-13 08:52:14,846 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-13 08:52:14,998 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-13 08:52:15,000 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69b3cfe41727ff69d6f22502/lava_callback.json.gz 2026-03-13 08:52:15,025 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 08:52:15,040 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b3cfe41727ff69d6f22502 HTTP/1.1" 200 None 2026-03-13 08:52:15,041 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 08:52:15,061 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b3c8061727ff69d6f21d98 HTTP/1.1" 200 None 2026-03-13 08:52:15,063 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 08:52:15,087 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b3cfe41727ff69d6f22502 HTTP/1.1" 200 None 2026-03-13 08:52:15,092 - lava_callback - INFO - Completed processing callback for node 69b3cfe41727ff69d6f22502 INFO: 172.21.0.1:55146 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:55158 - "GET / HTTP/1.0" 200 OK 2026-03-13 08:52:15,760 - lava_callback - INFO - Received callback for node 69b3cfc11727ff69d6f22497 INFO: 172.21.0.1:55168 - "POST /node/69b3cfc11727ff69d6f22497 HTTP/1.0" 202 Accepted 2026-03-13 08:52:15,766 - lava_callback - INFO - Starting async job submit for node 69b3cfc11727ff69d6f22497 2026-03-13 08:52:15,789 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 08:52:15,802 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b3cfc11727ff69d6f22497 HTTP/1.1" 200 None 2026-03-13 08:52:15,803 - lava_callback - DEBUG - Processing node 69b3cfc11727ff69d6f22497: baseline-arm64 2026-03-13 08:52:16,052 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-13 08:52:16,173 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-13 08:52:16,174 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-69b3cfc11727ff69d6f22497/log.txt.gz 2026-03-13 08:52:16,344 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 INFO: 172.21.0.1:55182 - "GET / HTTP/1.0" 200 OK 2026-03-13 08:52:16,545 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-13 08:52:16,547 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69b3cfc11727ff69d6f22497/lava-logs.yaml 2026-03-13 08:52:16,554 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-13 08:52:16,699 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-13 08:52:16,701 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69b3cfc11727ff69d6f22497/lava_callback.json.gz 2026-03-13 08:52:16,725 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 08:52:16,760 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b3cfc11727ff69d6f22497 HTTP/1.1" 200 None 2026-03-13 08:52:16,762 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 08:52:16,777 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b3c8061727ff69d6f21d98 HTTP/1.1" 200 None 2026-03-13 08:52:16,779 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 08:52:16,803 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b3cfc11727ff69d6f22497 HTTP/1.1" 200 None 2026-03-13 08:52:16,809 - lava_callback - INFO - Completed processing callback for node 69b3cfc11727ff69d6f22497 2026-03-13 08:52:16,890 - lava_callback - INFO - Received callback for node 69b3cfc81727ff69d6f224a6 INFO: 172.21.0.1:55194 - "POST /node/69b3cfc81727ff69d6f224a6 HTTP/1.0" 202 Accepted 2026-03-13 08:52:16,900 - lava_callback - INFO - Starting async job submit for node 69b3cfc81727ff69d6f224a6 2026-03-13 08:52:16,936 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 08:52:16,956 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b3cfc81727ff69d6f224a6 HTTP/1.1" 200 None 2026-03-13 08:52:16,957 - lava_callback - DEBUG - Processing node 69b3cfc81727ff69d6f224a6: baseline-arm64 2026-03-13 08:52:17,363 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-13 08:52:17,477 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-13 08:52:17,479 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-69b3cfc81727ff69d6f224a6/log.txt.gz 2026-03-13 08:52:17,699 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-13 08:52:17,888 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-13 08:52:17,890 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69b3cfc81727ff69d6f224a6/lava-logs.yaml 2026-03-13 08:52:17,898 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-13 08:52:18,047 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-13 08:52:18,049 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69b3cfc81727ff69d6f224a6/lava_callback.json.gz 2026-03-13 08:52:18,071 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 08:52:18,093 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b3cfc81727ff69d6f224a6 HTTP/1.1" 200 None 2026-03-13 08:52:18,095 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 08:52:18,112 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b3c8061727ff69d6f21d98 HTTP/1.1" 200 None 2026-03-13 08:52:18,114 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 08:52:18,140 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b3cfc81727ff69d6f224a6 HTTP/1.1" 200 None 2026-03-13 08:52:18,142 - lava_callback - INFO - Completed processing callback for node 69b3cfc81727ff69d6f224a6 2026-03-13 08:52:21,120 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 08:52:21,150 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 15 2026-03-13 08:52:22,297 - lava_callback - INFO - Received callback for node 69b3cfe11727ff69d6f224fc INFO: 172.21.0.1:55900 - "POST /node/69b3cfe11727ff69d6f224fc HTTP/1.0" 202 Accepted 2026-03-13 08:52:22,303 - lava_callback - INFO - Starting async job submit for node 69b3cfe11727ff69d6f224fc 2026-03-13 08:52:22,326 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 08:52:22,344 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b3cfe11727ff69d6f224fc HTTP/1.1" 200 None 2026-03-13 08:52:22,344 - lava_callback - DEBUG - Processing node 69b3cfe11727ff69d6f224fc: baseline-nfs-arm64 2026-03-13 08:52:22,699 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-13 08:52:22,818 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-13 08:52:22,820 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69b3cfe11727ff69d6f224fc/log.txt.gz 2026-03-13 08:52:23,013 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-13 08:52:23,203 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-13 08:52:23,206 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69b3cfe11727ff69d6f224fc/lava-logs.yaml 2026-03-13 08:52:23,213 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-13 08:52:23,345 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-13 08:52:23,347 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69b3cfe11727ff69d6f224fc/lava_callback.json.gz 2026-03-13 08:52:23,373 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 08:52:23,387 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b3cfe11727ff69d6f224fc HTTP/1.1" 200 None 2026-03-13 08:52:23,389 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 08:52:23,412 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b3c8061727ff69d6f21d98 HTTP/1.1" 200 None 2026-03-13 08:52:23,414 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 08:52:23,440 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b3cfe11727ff69d6f224fc HTTP/1.1" 200 None 2026-03-13 08:52:23,441 - lava_callback - INFO - Completed processing callback for node 69b3cfe11727ff69d6f224fc 2026-03-13 08:52:24,730 - lava_callback - INFO - Received callback for node 69b3cfcf1727ff69d6f224b5 INFO: 172.21.0.1:55908 - "POST /node/69b3cfcf1727ff69d6f224b5 HTTP/1.0" 202 Accepted 2026-03-13 08:52:24,738 - lava_callback - INFO - Starting async job submit for node 69b3cfcf1727ff69d6f224b5 2026-03-13 08:52:24,758 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 08:52:24,772 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b3cfcf1727ff69d6f224b5 HTTP/1.1" 200 None 2026-03-13 08:52:24,773 - lava_callback - DEBUG - Processing node 69b3cfcf1727ff69d6f224b5: baseline-arm64 2026-03-13 08:52:25,184 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-13 08:52:25,331 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-13 08:52:25,333 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-69b3cfcf1727ff69d6f224b5/log.txt.gz 2026-03-13 08:52:25,538 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-13 08:52:25,752 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-13 08:52:25,754 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69b3cfcf1727ff69d6f224b5/lava-logs.yaml 2026-03-13 08:52:25,763 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-13 08:52:25,953 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-13 08:52:25,955 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69b3cfcf1727ff69d6f224b5/lava_callback.json.gz 2026-03-13 08:52:25,976 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 08:52:26,001 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b3cfcf1727ff69d6f224b5 HTTP/1.1" 200 None 2026-03-13 08:52:26,003 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 08:52:26,018 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b3c8061727ff69d6f21d98 HTTP/1.1" 200 None 2026-03-13 08:52:26,019 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 08:52:26,044 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b3cfcf1727ff69d6f224b5 HTTP/1.1" 200 None 2026-03-13 08:52:26,046 - lava_callback - INFO - Completed processing callback for node 69b3cfcf1727ff69d6f224b5 2026-03-13 08:52:26,186 - lava_callback - INFO - Received callback for node 69b3cfde1727ff69d6f224f6 INFO: 172.21.0.1:55912 - "POST /node/69b3cfde1727ff69d6f224f6 HTTP/1.0" 202 Accepted 2026-03-13 08:52:26,198 - lava_callback - INFO - Starting async job submit for node 69b3cfde1727ff69d6f224f6 2026-03-13 08:52:26,234 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 08:52:26,252 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b3cfde1727ff69d6f224f6 HTTP/1.1" 200 None 2026-03-13 08:52:26,254 - lava_callback - DEBUG - Processing node 69b3cfde1727ff69d6f224f6: baseline-nfs-arm64 INFO: 172.21.0.1:55914 - "GET / HTTP/1.0" 200 OK 2026-03-13 08:52:26,873 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-13 08:52:27,000 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-13 08:52:27,002 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69b3cfde1727ff69d6f224f6/log.txt.gz 2026-03-13 08:52:27,306 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-13 08:52:27,501 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-13 08:52:27,503 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69b3cfde1727ff69d6f224f6/lava-logs.yaml 2026-03-13 08:52:27,515 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-13 08:52:27,669 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-13 08:52:27,671 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69b3cfde1727ff69d6f224f6/lava_callback.json.gz 2026-03-13 08:52:27,694 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 08:52:27,730 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b3cfde1727ff69d6f224f6 HTTP/1.1" 200 None 2026-03-13 08:52:27,731 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 08:52:27,745 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b3c8061727ff69d6f21d98 HTTP/1.1" 200 None 2026-03-13 08:52:27,747 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 08:52:27,780 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b3cfde1727ff69d6f224f6 HTTP/1.1" 200 None 2026-03-13 08:52:27,782 - lava_callback - INFO - Completed processing callback for node 69b3cfde1727ff69d6f224f6 2026-03-13 08:52:32,539 - lava_callback - INFO - Received callback for node 69b12d47a870a1dc3343bdc6 INFO: 172.21.0.1:36742 - "POST /node/69b12d47a870a1dc3343bdc6 HTTP/1.0" 202 Accepted 2026-03-13 08:52:32,545 - lava_callback - INFO - Starting async job submit for node 69b12d47a870a1dc3343bdc6 2026-03-13 08:52:32,546 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 08:52:32,561 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b12d47a870a1dc3343bdc6 HTTP/1.1" 200 None 2026-03-13 08:52:32,562 - lava_callback - DEBUG - Processing node 69b12d47a870a1dc3343bdc6: baseline-arm-baylibre 2026-03-13 08:52:32,562 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b12d47a870a1dc3343bdc6 2026-03-13 08:52:32,562 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 08:52:32,599 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b12d47a870a1dc3343bdc6 HTTP/1.1" 200 None 2026-03-13 08:52:32,601 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 08:52:32,620 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ae8223c660ead8a389aafd HTTP/1.1" 200 None 2026-03-13 08:52:32,622 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 08:52:32,649 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b12d47a870a1dc3343bdc6 HTTP/1.1" 200 None 2026-03-13 08:52:32,650 - lava_callback - ERROR - Error processing callback for node 69b12d47a870a1dc3343bdc6: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' 2026-03-13 08:52:33,189 - lava_callback - INFO - Received callback for node 69b3cfe81727ff69d6f2250d INFO: 172.21.0.1:36758 - "POST /node/69b3cfe81727ff69d6f2250d HTTP/1.0" 202 Accepted 2026-03-13 08:52:33,196 - lava_callback - INFO - Starting async job submit for node 69b3cfe81727ff69d6f2250d 2026-03-13 08:52:33,221 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 08:52:33,239 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b3cfe81727ff69d6f2250d HTTP/1.1" 200 None 2026-03-13 08:52:33,240 - lava_callback - DEBUG - Processing node 69b3cfe81727ff69d6f2250d: baseline-nfs-arm64 2026-03-13 08:52:33,647 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-13 08:52:33,812 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-13 08:52:33,814 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69b3cfe81727ff69d6f2250d/log.txt.gz 2026-03-13 08:52:34,056 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-13 08:52:34,275 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-13 08:52:34,277 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69b3cfe81727ff69d6f2250d/lava-logs.yaml 2026-03-13 08:52:34,286 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-13 08:52:34,471 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-13 08:52:34,473 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69b3cfe81727ff69d6f2250d/lava_callback.json.gz 2026-03-13 08:52:34,496 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 08:52:34,512 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b3cfe81727ff69d6f2250d HTTP/1.1" 200 None 2026-03-13 08:52:34,513 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 08:52:34,528 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b3c8061727ff69d6f21d98 HTTP/1.1" 200 None 2026-03-13 08:52:34,530 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 08:52:34,555 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b3cfe81727ff69d6f2250d HTTP/1.1" 200 None 2026-03-13 08:52:34,561 - lava_callback - INFO - Completed processing callback for node 69b3cfe81727ff69d6f2250d INFO: 172.21.0.1:36766 - "GET / HTTP/1.0" 200 OK 2026-03-13 08:52:37,285 - lava_callback - INFO - Received callback for node 69b3cfd31727ff69d6f224d8 INFO: 172.21.0.1:36776 - "POST /node/69b3cfd31727ff69d6f224d8 HTTP/1.0" 202 Accepted 2026-03-13 08:52:37,291 - lava_callback - INFO - Starting async job submit for node 69b3cfd31727ff69d6f224d8 2026-03-13 08:52:37,312 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 08:52:37,326 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b3cfd31727ff69d6f224d8 HTTP/1.1" 200 None 2026-03-13 08:52:37,327 - lava_callback - DEBUG - Processing node 69b3cfd31727ff69d6f224d8: baseline-arm64 2026-03-13 08:52:37,635 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-13 08:52:37,759 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-13 08:52:37,761 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-69b3cfd31727ff69d6f224d8/log.txt.gz 2026-03-13 08:52:37,947 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-13 08:52:38,181 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-13 08:52:38,183 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69b3cfd31727ff69d6f224d8/lava-logs.yaml 2026-03-13 08:52:38,191 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-13 08:52:38,359 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-13 08:52:38,361 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69b3cfd31727ff69d6f224d8/lava_callback.json.gz 2026-03-13 08:52:38,383 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 08:52:38,397 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b3cfd31727ff69d6f224d8 HTTP/1.1" 200 None 2026-03-13 08:52:38,399 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 08:52:38,417 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b3c8061727ff69d6f21d98 HTTP/1.1" 200 None 2026-03-13 08:52:38,419 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 08:52:38,445 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b3cfd31727ff69d6f224d8 HTTP/1.1" 200 None 2026-03-13 08:52:38,450 - lava_callback - INFO - Completed processing callback for node 69b3cfd31727ff69d6f224d8 2026-03-13 08:52:38,965 - lava_callback - INFO - Received callback for node 69b3cfe61727ff69d6f2250a INFO: 172.21.0.1:36786 - "POST /node/69b3cfe61727ff69d6f2250a HTTP/1.0" 202 Accepted 2026-03-13 08:52:38,972 - lava_callback - INFO - Starting async job submit for node 69b3cfe61727ff69d6f2250a 2026-03-13 08:52:38,999 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 08:52:39,017 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b3cfe61727ff69d6f2250a HTTP/1.1" 200 None 2026-03-13 08:52:39,018 - lava_callback - DEBUG - Processing node 69b3cfe61727ff69d6f2250a: baseline-nfs-arm64 2026-03-13 08:52:39,387 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-13 08:52:39,525 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-13 08:52:39,527 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69b3cfe61727ff69d6f2250a/log.txt.gz 2026-03-13 08:52:39,727 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-13 08:52:39,936 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-13 08:52:39,938 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69b3cfe61727ff69d6f2250a/lava-logs.yaml 2026-03-13 08:52:39,946 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-13 08:52:40,088 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-13 08:52:40,090 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69b3cfe61727ff69d6f2250a/lava_callback.json.gz 2026-03-13 08:52:40,113 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 08:52:40,130 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b3cfe61727ff69d6f2250a HTTP/1.1" 200 None 2026-03-13 08:52:40,132 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 08:52:40,147 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b3c8061727ff69d6f21d98 HTTP/1.1" 200 None 2026-03-13 08:52:40,148 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 08:52:40,173 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b3cfe61727ff69d6f2250a HTTP/1.1" 200 None 2026-03-13 08:52:40,175 - lava_callback - INFO - Completed processing callback for node 69b3cfe61727ff69d6f2250a 2026-03-13 08:52:43,129 - lava_callback - INFO - Received callback for node 69b3d0071727ff69d6f22560 INFO: 172.21.0.1:60534 - "POST /node/69b3d0071727ff69d6f22560 HTTP/1.0" 202 Accepted 2026-03-13 08:52:43,137 - lava_callback - INFO - Starting async job submit for node 69b3d0071727ff69d6f22560 2026-03-13 08:52:43,163 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 08:52:43,177 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b3d0071727ff69d6f22560 HTTP/1.1" 200 None 2026-03-13 08:52:43,178 - lava_callback - DEBUG - Processing node 69b3d0071727ff69d6f22560: baseline-arm64-broonie 2026-03-13 08:52:43,498 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-13 08:52:43,637 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-13 08:52:43,639 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69b3d0071727ff69d6f22560/log.txt.gz 2026-03-13 08:52:43,848 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-13 08:52:44,088 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-13 08:52:44,091 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69b3d0071727ff69d6f22560/lava-logs.yaml 2026-03-13 08:52:44,099 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-13 08:52:44,251 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-13 08:52:44,253 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69b3d0071727ff69d6f22560/lava_callback.json.gz 2026-03-13 08:52:44,281 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 08:52:44,295 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b3d0071727ff69d6f22560 HTTP/1.1" 200 None 2026-03-13 08:52:44,296 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 08:52:44,310 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b3c8061727ff69d6f21d98 HTTP/1.1" 200 None 2026-03-13 08:52:44,312 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 08:52:44,348 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b3d0071727ff69d6f22560 HTTP/1.1" 200 None 2026-03-13 08:52:44,350 - lava_callback - INFO - Completed processing callback for node 69b3d0071727ff69d6f22560 INFO: 172.21.0.1:60550 - "GET / HTTP/1.0" 200 OK 2026-03-13 08:52:47,552 - lava_callback - INFO - Received callback for node 69b3ccf61727ff69d6f222b2 INFO: 172.21.0.1:60556 - "POST /node/69b3ccf61727ff69d6f222b2 HTTP/1.0" 202 Accepted 2026-03-13 08:52:47,558 - lava_callback - INFO - Starting async job submit for node 69b3ccf61727ff69d6f222b2 2026-03-13 08:52:47,583 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 08:52:47,606 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b3ccf61727ff69d6f222b2 HTTP/1.1" 200 None 2026-03-13 08:52:47,607 - lava_callback - DEBUG - Processing node 69b3ccf61727ff69d6f222b2: ltp-timers 2026-03-13 08:52:48,135 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-13 08:52:48,282 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-13 08:52:48,284 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/ltp-timers-69b3ccf61727ff69d6f222b2/log.txt.gz 2026-03-13 08:52:48,511 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-13 08:52:48,713 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-13 08:52:48,715 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/ltp-timers-69b3ccf61727ff69d6f222b2/lava-logs.yaml 2026-03-13 08:52:48,724 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-13 08:52:48,904 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-13 08:52:48,906 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/ltp-timers-69b3ccf61727ff69d6f222b2/lava_callback.json.gz 2026-03-13 08:52:48,932 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 08:52:48,946 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b3ccf61727ff69d6f222b2 HTTP/1.1" 200 None 2026-03-13 08:52:48,948 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 08:52:48,961 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b3c7f91727ff69d6f21d89 HTTP/1.1" 200 None 2026-03-13 08:52:48,963 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 08:52:48,987 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b3ccf61727ff69d6f222b2 HTTP/1.1" 200 None 2026-03-13 08:52:48,993 - lava_callback - INFO - Completed processing callback for node 69b3ccf61727ff69d6f222b2 2026-03-13 08:52:51,152 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 08:52:51,169 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 15 2026-03-13 08:52:54,615 - lava_callback - INFO - Received callback for node 69b3cfd21727ff69d6f224d4 INFO: 172.21.0.1:45882 - "POST /node/69b3cfd21727ff69d6f224d4 HTTP/1.0" 202 Accepted 2026-03-13 08:52:54,621 - lava_callback - INFO - Starting async job submit for node 69b3cfd21727ff69d6f224d4 2026-03-13 08:52:54,642 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 08:52:54,656 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b3cfd21727ff69d6f224d4 HTTP/1.1" 200 None 2026-03-13 08:52:54,657 - lava_callback - DEBUG - Processing node 69b3cfd21727ff69d6f224d4: baseline-arm64 2026-03-13 08:52:54,911 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-13 08:52:55,021 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-13 08:52:55,023 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-69b3cfd21727ff69d6f224d4/log.txt.gz 2026-03-13 08:52:55,175 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-13 08:52:55,383 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-13 08:52:55,385 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69b3cfd21727ff69d6f224d4/lava-logs.yaml 2026-03-13 08:52:55,391 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-13 08:52:55,541 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-13 08:52:55,543 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69b3cfd21727ff69d6f224d4/lava_callback.json.gz 2026-03-13 08:52:55,565 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 08:52:55,579 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b3cfd21727ff69d6f224d4 HTTP/1.1" 200 None 2026-03-13 08:52:55,581 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 08:52:55,594 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b3c8061727ff69d6f21d98 HTTP/1.1" 200 None 2026-03-13 08:52:55,596 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 08:52:55,619 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b3cfd21727ff69d6f224d4 HTTP/1.1" 200 None 2026-03-13 08:52:55,627 - lava_callback - INFO - Completed processing callback for node 69b3cfd21727ff69d6f224d4 2026-03-13 08:52:55,674 - lava_callback - INFO - Received callback for node 69b3d0201727ff69d6f225a8 INFO: 172.21.0.1:45898 - "POST /node/69b3d0201727ff69d6f225a8 HTTP/1.0" 202 Accepted 2026-03-13 08:52:55,685 - lava_callback - INFO - Starting async job submit for node 69b3d0201727ff69d6f225a8 2026-03-13 08:52:55,721 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 08:52:55,750 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b3d0201727ff69d6f225a8 HTTP/1.1" 200 None 2026-03-13 08:52:55,751 - lava_callback - DEBUG - Processing node 69b3d0201727ff69d6f225a8: baseline-arm64-foundriesio 2026-03-13 08:52:56,025 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-13 08:52:56,158 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-13 08:52:56,160 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-foundriesio-69b3d0201727ff69d6f225a8/log.txt.gz 2026-03-13 08:52:56,286 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-13 08:52:56,463 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-13 08:52:56,465 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-foundriesio-69b3d0201727ff69d6f225a8/lava-logs.yaml 2026-03-13 08:52:56,470 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 INFO: 172.21.0.1:45910 - "GET / HTTP/1.0" 200 OK 2026-03-13 08:52:56,638 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-13 08:52:56,640 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-foundriesio-69b3d0201727ff69d6f225a8/lava_callback.json.gz 2026-03-13 08:52:56,690 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 08:52:56,703 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b3d0201727ff69d6f225a8 HTTP/1.1" 200 None 2026-03-13 08:52:56,705 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 08:52:56,718 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b3c8061727ff69d6f21d98 HTTP/1.1" 200 None 2026-03-13 08:52:56,719 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 08:52:56,745 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b3d0201727ff69d6f225a8 HTTP/1.1" 200 None 2026-03-13 08:52:56,787 - lava_callback - INFO - Completed processing callback for node 69b3d0201727ff69d6f225a8 2026-03-13 08:53:01,255 - lava_callback - INFO - Received callback for node 69b3d01b1727ff69d6f2259f INFO: 172.21.0.1:40522 - "POST /node/69b3d01b1727ff69d6f2259f HTTP/1.0" 202 Accepted 2026-03-13 08:53:01,261 - lava_callback - INFO - Starting async job submit for node 69b3d01b1727ff69d6f2259f 2026-03-13 08:53:01,280 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 08:53:01,295 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b3d01b1727ff69d6f2259f HTTP/1.1" 200 None 2026-03-13 08:53:01,296 - lava_callback - DEBUG - Processing node 69b3d01b1727ff69d6f2259f: baseline-arm64-pengutronix 2026-03-13 08:53:01,470 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-13 08:53:01,592 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-13 08:53:01,594 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-pengutronix-69b3d01b1727ff69d6f2259f/log.txt.gz 2026-03-13 08:53:01,702 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-13 08:53:01,885 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-13 08:53:01,888 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-pengutronix-69b3d01b1727ff69d6f2259f/lava-logs.yaml 2026-03-13 08:53:01,893 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-13 08:53:02,027 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-13 08:53:02,029 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-pengutronix-69b3d01b1727ff69d6f2259f/lava_callback.json.gz 2026-03-13 08:53:02,049 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 08:53:02,064 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b3d01b1727ff69d6f2259f HTTP/1.1" 200 None 2026-03-13 08:53:02,066 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 08:53:02,107 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b3c8061727ff69d6f21d98 HTTP/1.1" 200 None 2026-03-13 08:53:02,109 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 08:53:02,139 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b3d01b1727ff69d6f2259f HTTP/1.1" 200 None 2026-03-13 08:53:02,143 - lava_callback - INFO - Completed processing callback for node 69b3d01b1727ff69d6f2259f 2026-03-13 08:53:04,365 - lava_callback - INFO - Received callback for node 69b3cfd91727ff69d6f224ed INFO: 172.21.0.1:40534 - "POST /node/69b3cfd91727ff69d6f224ed HTTP/1.0" 202 Accepted 2026-03-13 08:53:04,371 - lava_callback - INFO - Starting async job submit for node 69b3cfd91727ff69d6f224ed 2026-03-13 08:53:04,393 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 08:53:04,408 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b3cfd91727ff69d6f224ed HTTP/1.1" 200 None 2026-03-13 08:53:04,408 - lava_callback - DEBUG - Processing node 69b3cfd91727ff69d6f224ed: baseline-nfs-arm64 2026-03-13 08:53:04,727 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-13 08:53:04,864 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-13 08:53:04,865 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69b3cfd91727ff69d6f224ed/log.txt.gz 2026-03-13 08:53:05,071 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-13 08:53:05,284 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-13 08:53:05,286 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69b3cfd91727ff69d6f224ed/lava-logs.yaml 2026-03-13 08:53:05,294 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-13 08:53:05,428 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-13 08:53:05,429 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69b3cfd91727ff69d6f224ed/lava_callback.json.gz 2026-03-13 08:53:05,453 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 08:53:05,470 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b3cfd91727ff69d6f224ed HTTP/1.1" 200 None 2026-03-13 08:53:05,472 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 08:53:05,472 - lava_callback - INFO - Received callback for node 69b3d01d1727ff69d6f225a2 INFO: 172.21.0.1:40546 - "POST /node/69b3d01d1727ff69d6f225a2 HTTP/1.0" 202 Accepted 2026-03-13 08:53:05,479 - lava_callback - INFO - Starting async job submit for node 69b3d01d1727ff69d6f225a2 2026-03-13 08:53:05,503 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 08:53:05,511 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b3c8061727ff69d6f21d98 HTTP/1.1" 200 None 2026-03-13 08:53:05,512 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 08:53:05,528 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b3d01d1727ff69d6f225a2 HTTP/1.1" 200 None 2026-03-13 08:53:05,529 - lava_callback - DEBUG - Processing node 69b3d01d1727ff69d6f225a2: baseline-arm64-pengutronix 2026-03-13 08:53:05,564 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b3cfd91727ff69d6f224ed HTTP/1.1" 200 None 2026-03-13 08:53:05,566 - lava_callback - INFO - Completed processing callback for node 69b3cfd91727ff69d6f224ed 2026-03-13 08:53:05,850 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-13 08:53:05,906 - lava_callback - INFO - Received callback for node 69b3cfcb1727ff69d6f224ac INFO: 172.21.0.1:40562 - "POST /node/69b3cfcb1727ff69d6f224ac HTTP/1.0" 202 Accepted 2026-03-13 08:53:05,914 - lava_callback - INFO - Starting async job submit for node 69b3cfcb1727ff69d6f224ac 2026-03-13 08:53:05,938 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 08:53:05,951 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b3cfcb1727ff69d6f224ac HTTP/1.1" 200 None 2026-03-13 08:53:05,952 - lava_callback - DEBUG - Processing node 69b3cfcb1727ff69d6f224ac: baseline-arm64 2026-03-13 08:53:05,984 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-13 08:53:06,031 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-pengutronix-69b3d01d1727ff69d6f225a2/log.txt.gz 2026-03-13 08:53:06,347 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 INFO: 172.21.0.1:40578 - "GET / HTTP/1.0" 200 OK 2026-03-13 08:53:06,601 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-13 08:53:06,647 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-13 08:53:06,649 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-pengutronix-69b3d01d1727ff69d6f225a2/lava-logs.yaml 2026-03-13 08:53:06,655 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-13 08:53:06,764 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-13 08:53:06,766 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-69b3cfcb1727ff69d6f224ac/log.txt.gz 2026-03-13 08:53:06,809 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-13 08:53:06,844 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-pengutronix-69b3d01d1727ff69d6f225a2/lava_callback.json.gz 2026-03-13 08:53:06,889 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 08:53:06,966 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b3d01d1727ff69d6f225a2 HTTP/1.1" 200 None 2026-03-13 08:53:06,996 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 08:53:07,051 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b3c8061727ff69d6f21d98 HTTP/1.1" 200 None 2026-03-13 08:53:07,068 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 08:53:07,068 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-13 08:53:07,108 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b3d01d1727ff69d6f225a2 HTTP/1.1" 200 None 2026-03-13 08:53:07,109 - lava_callback - INFO - Completed processing callback for node 69b3d01d1727ff69d6f225a2 2026-03-13 08:53:07,137 - lava_callback - INFO - Received callback for node 69b3d0021727ff69d6f22557 INFO: 172.21.0.1:40584 - "POST /node/69b3d0021727ff69d6f22557 HTTP/1.0" 202 Accepted 2026-03-13 08:53:07,147 - lava_callback - INFO - Starting async job submit for node 69b3d0021727ff69d6f22557 2026-03-13 08:53:07,194 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 08:53:07,220 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b3d0021727ff69d6f22557 HTTP/1.1" 200 None 2026-03-13 08:53:07,221 - lava_callback - DEBUG - Processing node 69b3d0021727ff69d6f22557: baseline-arm64-broonie 2026-03-13 08:53:07,361 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-13 08:53:07,399 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69b3cfcb1727ff69d6f224ac/lava-logs.yaml 2026-03-13 08:53:07,482 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-13 08:53:07,604 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-13 08:53:07,692 - lava_callback - INFO - Received callback for node 69b3d0221727ff69d6f225ad INFO: 172.21.0.1:40590 - "POST /node/69b3d0221727ff69d6f225ad HTTP/1.0" 202 Accepted 2026-03-13 08:53:07,700 - lava_callback - INFO - Starting async job submit for node 69b3d0221727ff69d6f225ad 2026-03-13 08:53:07,720 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-13 08:53:07,736 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 08:53:07,737 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69b3cfcb1727ff69d6f224ac/lava_callback.json.gz 2026-03-13 08:53:07,764 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-13 08:53:07,787 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69b3d0021727ff69d6f22557/log.txt.gz 2026-03-13 08:53:07,810 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b3d0221727ff69d6f225ad HTTP/1.1" 200 None 2026-03-13 08:53:07,822 - lava_callback - DEBUG - Processing node 69b3d0221727ff69d6f225ad: baseline-arm64-foundriesio 2026-03-13 08:53:07,838 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 08:53:08,103 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b3cfcb1727ff69d6f224ac HTTP/1.1" 200 None 2026-03-13 08:53:08,169 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 08:53:08,169 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-13 08:53:08,302 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b3c8061727ff69d6f21d98 HTTP/1.1" 200 None 2026-03-13 08:53:08,330 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 08:53:08,428 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b3cfcb1727ff69d6f224ac HTTP/1.1" 200 None 2026-03-13 08:53:08,528 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-13 08:53:08,531 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69b3d0021727ff69d6f22557/lava-logs.yaml 2026-03-13 08:53:08,533 - lava_callback - INFO - Completed processing callback for node 69b3cfcb1727ff69d6f224ac 2026-03-13 08:53:08,544 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-13 08:53:08,545 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-13 08:53:08,639 - lava_callback - INFO - Received callback for node 69b3d0041727ff69d6f2255a INFO: 172.21.0.1:40596 - "POST /node/69b3d0041727ff69d6f2255a HTTP/1.0" 202 Accepted 2026-03-13 08:53:08,648 - lava_callback - INFO - Starting async job submit for node 69b3d0041727ff69d6f2255a 2026-03-13 08:53:08,682 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 08:53:08,697 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b3d0041727ff69d6f2255a HTTP/1.1" 200 None 2026-03-13 08:53:08,698 - lava_callback - DEBUG - Processing node 69b3d0041727ff69d6f2255a: baseline-arm64-broonie 2026-03-13 08:53:08,723 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-13 08:53:08,750 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-13 08:53:08,772 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-foundriesio-69b3d0221727ff69d6f225ad/log.txt.gz 2026-03-13 08:53:08,798 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69b3d0021727ff69d6f22557/lava_callback.json.gz 2026-03-13 08:53:08,909 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 08:53:09,192 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b3d0021727ff69d6f22557 HTTP/1.1" 200 None 2026-03-13 08:53:09,204 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 08:53:09,234 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-13 08:53:09,270 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b3c8061727ff69d6f21d98 HTTP/1.1" 200 None 2026-03-13 08:53:09,284 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 08:53:09,285 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-13 08:53:09,318 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b3d0021727ff69d6f22557 HTTP/1.1" 200 None 2026-03-13 08:53:09,329 - lava_callback - INFO - Completed processing callback for node 69b3d0021727ff69d6f22557 2026-03-13 08:53:09,489 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-13 08:53:09,491 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69b3d0041727ff69d6f2255a/log.txt.gz 2026-03-13 08:53:09,604 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-13 08:53:09,641 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-foundriesio-69b3d0221727ff69d6f225ad/lava-logs.yaml 2026-03-13 08:53:09,712 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-13 08:53:09,712 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-13 08:53:09,918 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-13 08:53:09,920 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-foundriesio-69b3d0221727ff69d6f225ad/lava_callback.json.gz 2026-03-13 08:53:09,950 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 08:53:09,956 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-13 08:53:09,959 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69b3d0041727ff69d6f2255a/lava-logs.yaml 2026-03-13 08:53:09,966 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b3d0221727ff69d6f225ad HTTP/1.1" 200 None 2026-03-13 08:53:09,968 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 08:53:09,968 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-13 08:53:09,986 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b3c8061727ff69d6f21d98 HTTP/1.1" 200 None 2026-03-13 08:53:09,988 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 08:53:10,020 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b3d0221727ff69d6f225ad HTTP/1.1" 200 None 2026-03-13 08:53:10,027 - lava_callback - INFO - Completed processing callback for node 69b3d0221727ff69d6f225ad 2026-03-13 08:53:10,077 - lava_callback - INFO - Received callback for node 69b3d0091727ff69d6f22567 INFO: 172.21.0.1:41854 - "POST /node/69b3d0091727ff69d6f22567 HTTP/1.0" 202 Accepted 2026-03-13 08:53:10,090 - lava_callback - INFO - Starting async job submit for node 69b3d0091727ff69d6f22567 2026-03-13 08:53:10,143 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 08:53:10,158 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b3d0091727ff69d6f22567 HTTP/1.1" 200 None 2026-03-13 08:53:10,159 - lava_callback - DEBUG - Processing node 69b3d0091727ff69d6f22567: baseline-arm64-broonie 2026-03-13 08:53:10,181 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-13 08:53:10,224 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69b3d0041727ff69d6f2255a/lava_callback.json.gz 2026-03-13 08:53:10,280 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 08:53:10,352 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b3d0041727ff69d6f2255a HTTP/1.1" 200 None 2026-03-13 08:53:10,379 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 08:53:10,462 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b3c8061727ff69d6f21d98 HTTP/1.1" 200 None 2026-03-13 08:53:10,472 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 08:53:10,474 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-13 08:53:10,509 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b3d0041727ff69d6f2255a HTTP/1.1" 200 None 2026-03-13 08:53:10,525 - lava_callback - INFO - Completed processing callback for node 69b3d0041727ff69d6f2255a 2026-03-13 08:53:10,635 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-13 08:53:10,637 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69b3d0091727ff69d6f22567/log.txt.gz 2026-03-13 08:53:10,809 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-13 08:53:11,046 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-13 08:53:11,049 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69b3d0091727ff69d6f22567/lava-logs.yaml 2026-03-13 08:53:11,057 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-13 08:53:11,231 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-13 08:53:11,233 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69b3d0091727ff69d6f22567/lava_callback.json.gz 2026-03-13 08:53:11,267 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 08:53:11,282 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b3d0091727ff69d6f22567 HTTP/1.1" 200 None 2026-03-13 08:53:11,283 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 08:53:11,298 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b3c8061727ff69d6f21d98 HTTP/1.1" 200 None 2026-03-13 08:53:11,299 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 08:53:11,344 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b3d0091727ff69d6f22567 HTTP/1.1" 200 None 2026-03-13 08:53:11,345 - lava_callback - INFO - Completed processing callback for node 69b3d0091727ff69d6f22567 2026-03-13 08:53:11,501 - lava_callback - INFO - Received callback for node 69b3d00c1727ff69d6f2256a INFO: 172.21.0.1:41862 - "POST /node/69b3d00c1727ff69d6f2256a HTTP/1.0" 202 Accepted 2026-03-13 08:53:11,508 - lava_callback - INFO - Starting async job submit for node 69b3d00c1727ff69d6f2256a 2026-03-13 08:53:11,541 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 08:53:11,555 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b3d00c1727ff69d6f2256a HTTP/1.1" 200 None 2026-03-13 08:53:11,555 - lava_callback - DEBUG - Processing node 69b3d00c1727ff69d6f2256a: baseline-arm64-broonie 2026-03-13 08:53:11,656 - lava_callback - INFO - Received callback for node 69b3d01f1727ff69d6f225a5 INFO: 172.21.0.1:41864 - "POST /node/69b3d01f1727ff69d6f225a5 HTTP/1.0" 202 Accepted 2026-03-13 08:53:11,689 - lava_callback - INFO - Starting async job submit for node 69b3d01f1727ff69d6f225a5 2026-03-13 08:53:11,730 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 08:53:11,802 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b3d01f1727ff69d6f225a5 HTTP/1.1" 200 None 2026-03-13 08:53:11,818 - lava_callback - DEBUG - Processing node 69b3d01f1727ff69d6f225a5: baseline-arm64-pengutronix 2026-03-13 08:53:11,963 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-13 08:53:12,084 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-13 08:53:12,171 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-13 08:53:12,173 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69b3d00c1727ff69d6f2256a/log.txt.gz 2026-03-13 08:53:12,237 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-13 08:53:12,275 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-pengutronix-69b3d01f1727ff69d6f225a5/log.txt.gz 2026-03-13 08:53:12,407 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-13 08:53:12,458 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-13 08:53:12,626 - lava_callback - INFO - Received callback for node 69b12d6da870a1dc3343bdd6 INFO: 172.21.0.1:41874 - "POST /node/69b12d6da870a1dc3343bdd6 HTTP/1.0" 202 Accepted 2026-03-13 08:53:12,636 - lava_callback - INFO - Starting async job submit for node 69b12d6da870a1dc3343bdd6 2026-03-13 08:53:12,637 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 08:53:12,639 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-13 08:53:12,641 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69b3d00c1727ff69d6f2256a/lava-logs.yaml 2026-03-13 08:53:12,649 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-13 08:53:12,668 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b12d6da870a1dc3343bdd6 HTTP/1.1" 200 None 2026-03-13 08:53:12,670 - lava_callback - DEBUG - Processing node 69b12d6da870a1dc3343bdd6: baseline-arm-baylibre 2026-03-13 08:53:12,670 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b12d6da870a1dc3343bdd6 2026-03-13 08:53:12,671 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 08:53:12,693 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b12d6da870a1dc3343bdd6 HTTP/1.1" 200 None 2026-03-13 08:53:12,695 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 08:53:12,712 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-13 08:53:12,714 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-pengutronix-69b3d01f1727ff69d6f225a5/lava-logs.yaml 2026-03-13 08:53:12,722 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-13 08:53:12,736 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ae8223c660ead8a389aafd HTTP/1.1" 200 None 2026-03-13 08:53:12,738 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 08:53:12,792 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b12d6da870a1dc3343bdd6 HTTP/1.1" 200 None 2026-03-13 08:53:12,793 - lava_callback - ERROR - Error processing callback for node 69b12d6da870a1dc3343bdd6: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' 2026-03-13 08:53:12,944 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-13 08:53:12,946 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69b3d00c1727ff69d6f2256a/lava_callback.json.gz 2026-03-13 08:53:12,993 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 08:53:13,020 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b3d00c1727ff69d6f2256a HTTP/1.1" 200 None 2026-03-13 08:53:13,022 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 08:53:13,037 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b3c8061727ff69d6f21d98 HTTP/1.1" 200 None 2026-03-13 08:53:13,039 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 08:53:13,048 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-13 08:53:13,050 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-pengutronix-69b3d01f1727ff69d6f225a5/lava_callback.json.gz 2026-03-13 08:53:13,075 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 08:53:13,102 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b3d00c1727ff69d6f2256a HTTP/1.1" 200 None 2026-03-13 08:53:13,104 - lava_callback - INFO - Completed processing callback for node 69b3d00c1727ff69d6f2256a 2026-03-13 08:53:13,104 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b3d01f1727ff69d6f225a5 HTTP/1.1" 200 None 2026-03-13 08:53:13,108 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 08:53:13,165 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b3c8061727ff69d6f21d98 HTTP/1.1" 200 None 2026-03-13 08:53:13,167 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 08:53:13,218 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b3d01f1727ff69d6f225a5 HTTP/1.1" 200 None 2026-03-13 08:53:13,220 - lava_callback - INFO - Completed processing callback for node 69b3d01f1727ff69d6f225a5 INFO: 172.21.0.1:41886 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:41902 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41918 - "GET / HTTP/1.0" 200 OK 2026-03-13 08:53:18,079 - lava_callback - INFO - Received callback for node 69b3cfd61727ff69d6f224e5 INFO: 172.21.0.1:41920 - "POST /node/69b3cfd61727ff69d6f224e5 HTTP/1.0" 202 Accepted 2026-03-13 08:53:18,086 - lava_callback - INFO - Starting async job submit for node 69b3cfd61727ff69d6f224e5 2026-03-13 08:53:18,118 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 08:53:18,135 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b3cfd61727ff69d6f224e5 HTTP/1.1" 200 None 2026-03-13 08:53:18,136 - lava_callback - DEBUG - Processing node 69b3cfd61727ff69d6f224e5: baseline-nfs-arm64 2026-03-13 08:53:18,448 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-13 08:53:18,569 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-13 08:53:18,570 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69b3cfd61727ff69d6f224e5/log.txt.gz 2026-03-13 08:53:18,759 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-13 08:53:18,982 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-13 08:53:18,985 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69b3cfd61727ff69d6f224e5/lava-logs.yaml 2026-03-13 08:53:18,993 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-13 08:53:19,136 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-13 08:53:19,138 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69b3cfd61727ff69d6f224e5/lava_callback.json.gz 2026-03-13 08:53:19,164 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 08:53:19,180 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b3cfd61727ff69d6f224e5 HTTP/1.1" 200 None 2026-03-13 08:53:19,181 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 08:53:19,203 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b3c8061727ff69d6f21d98 HTTP/1.1" 200 None 2026-03-13 08:53:19,204 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 08:53:19,229 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b3cfd61727ff69d6f224e5 HTTP/1.1" 200 None 2026-03-13 08:53:19,235 - lava_callback - INFO - Completed processing callback for node 69b3cfd61727ff69d6f224e5 2026-03-13 08:53:21,171 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 08:53:21,190 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 15 2026-03-13 08:53:22,094 - lava_callback - INFO - Received callback for node 69b3d00e1727ff69d6f22582 INFO: 172.21.0.1:37358 - "POST /node/69b3d00e1727ff69d6f22582 HTTP/1.0" 202 Accepted 2026-03-13 08:53:22,100 - lava_callback - INFO - Starting async job submit for node 69b3d00e1727ff69d6f22582 2026-03-13 08:53:22,122 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 08:53:22,136 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b3d00e1727ff69d6f22582 HTTP/1.1" 200 None 2026-03-13 08:53:22,137 - lava_callback - DEBUG - Processing node 69b3d00e1727ff69d6f22582: baseline-arm64-broonie 2026-03-13 08:53:22,407 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-13 08:53:22,515 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-13 08:53:22,517 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69b3d00e1727ff69d6f22582/log.txt.gz 2026-03-13 08:53:22,667 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-13 08:53:22,847 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-13 08:53:22,849 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69b3d00e1727ff69d6f22582/lava-logs.yaml 2026-03-13 08:53:22,855 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-13 08:53:22,989 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-13 08:53:22,991 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69b3d00e1727ff69d6f22582/lava_callback.json.gz 2026-03-13 08:53:23,016 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 08:53:23,029 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b3d00e1727ff69d6f22582 HTTP/1.1" 200 None 2026-03-13 08:53:23,030 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 08:53:23,043 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b3c8061727ff69d6f21d98 HTTP/1.1" 200 None 2026-03-13 08:53:23,045 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 08:53:23,068 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b3d00e1727ff69d6f22582 HTTP/1.1" 200 None 2026-03-13 08:53:23,073 - lava_callback - INFO - Completed processing callback for node 69b3d00e1727ff69d6f22582 INFO: 172.21.0.1:37360 - "GET / HTTP/1.0" 200 OK 2026-03-13 08:53:31,637 - lava_callback - INFO - Received callback for node 69b3cfe21727ff69d6f224ff INFO: 172.21.0.1:50644 - "POST /node/69b3cfe21727ff69d6f224ff HTTP/1.0" 202 Accepted 2026-03-13 08:53:31,648 - lava_callback - INFO - Starting async job submit for node 69b3cfe21727ff69d6f224ff 2026-03-13 08:53:31,710 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 08:53:31,737 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b3cfe21727ff69d6f224ff HTTP/1.1" 200 None 2026-03-13 08:53:31,739 - lava_callback - DEBUG - Processing node 69b3cfe21727ff69d6f224ff: baseline-nfs-arm64 2026-03-13 08:53:32,489 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-13 08:53:32,629 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-13 08:53:32,631 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69b3cfe21727ff69d6f224ff/log.txt.gz 2026-03-13 08:53:33,041 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-13 08:53:33,270 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-13 08:53:33,272 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69b3cfe21727ff69d6f224ff/lava-logs.yaml 2026-03-13 08:53:33,286 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-13 08:53:33,435 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-13 08:53:33,437 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69b3cfe21727ff69d6f224ff/lava_callback.json.gz 2026-03-13 08:53:33,458 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 08:53:33,474 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b3cfe21727ff69d6f224ff HTTP/1.1" 200 None 2026-03-13 08:53:33,476 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 08:53:33,500 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b3c8061727ff69d6f21d98 HTTP/1.1" 200 None 2026-03-13 08:53:33,502 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 08:53:33,530 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b3cfe21727ff69d6f224ff HTTP/1.1" 200 None 2026-03-13 08:53:33,532 - lava_callback - INFO - Completed processing callback for node 69b3cfe21727ff69d6f224ff INFO: 172.21.0.1:50660 - "GET / HTTP/1.0" 200 OK 2026-03-13 08:53:38,402 - lava_callback - INFO - Received callback for node 69b3cfdc1727ff69d6f224f3 INFO: 172.21.0.1:50676 - "POST /node/69b3cfdc1727ff69d6f224f3 HTTP/1.0" 202 Accepted 2026-03-13 08:53:38,409 - lava_callback - INFO - Starting async job submit for node 69b3cfdc1727ff69d6f224f3 2026-03-13 08:53:38,433 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 08:53:38,452 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b3cfdc1727ff69d6f224f3 HTTP/1.1" 200 None 2026-03-13 08:53:38,453 - lava_callback - DEBUG - Processing node 69b3cfdc1727ff69d6f224f3: baseline-nfs-arm64 2026-03-13 08:53:38,904 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-13 08:53:39,055 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-13 08:53:39,057 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69b3cfdc1727ff69d6f224f3/log.txt.gz 2026-03-13 08:53:39,343 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-13 08:53:39,561 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-13 08:53:39,563 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69b3cfdc1727ff69d6f224f3/lava-logs.yaml 2026-03-13 08:53:39,573 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-13 08:53:39,736 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-13 08:53:39,737 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69b3cfdc1727ff69d6f224f3/lava_callback.json.gz 2026-03-13 08:53:39,783 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 08:53:39,806 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b3cfdc1727ff69d6f224f3 HTTP/1.1" 200 None 2026-03-13 08:53:39,808 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 08:53:39,822 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b3c8061727ff69d6f21d98 HTTP/1.1" 200 None 2026-03-13 08:53:39,823 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 08:53:39,848 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b3cfdc1727ff69d6f224f3 HTTP/1.1" 200 None 2026-03-13 08:53:39,910 - lava_callback - INFO - Completed processing callback for node 69b3cfdc1727ff69d6f224f3 2026-03-13 08:53:42,204 - lava_callback - INFO - Received callback for node 69b3ccf81727ff69d6f222b5 INFO: 172.21.0.1:55646 - "POST /node/69b3ccf81727ff69d6f222b5 HTTP/1.0" 202 Accepted 2026-03-13 08:53:42,210 - lava_callback - INFO - Starting async job submit for node 69b3ccf81727ff69d6f222b5 2026-03-13 08:53:42,234 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 08:53:42,248 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b3ccf81727ff69d6f222b5 HTTP/1.1" 200 None 2026-03-13 08:53:42,249 - lava_callback - DEBUG - Processing node 69b3ccf81727ff69d6f222b5: ltp-watchqueue 2026-03-13 08:53:42,588 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-13 08:53:42,700 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-13 08:53:42,702 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/ltp-watchqueue-69b3ccf81727ff69d6f222b5/log.txt.gz 2026-03-13 08:53:42,909 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-13 08:53:43,104 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-13 08:53:43,106 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/ltp-watchqueue-69b3ccf81727ff69d6f222b5/lava-logs.yaml 2026-03-13 08:53:43,115 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-13 08:53:43,266 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-13 08:53:43,268 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/ltp-watchqueue-69b3ccf81727ff69d6f222b5/lava_callback.json.gz 2026-03-13 08:53:43,294 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 08:53:43,318 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b3ccf81727ff69d6f222b5 HTTP/1.1" 200 None 2026-03-13 08:53:43,319 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 08:53:43,333 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b3c7f91727ff69d6f21d89 HTTP/1.1" 200 None 2026-03-13 08:53:43,335 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 08:53:43,370 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b3ccf81727ff69d6f222b5 HTTP/1.1" 200 None 2026-03-13 08:53:43,372 - lava_callback - INFO - Completed processing callback for node 69b3ccf81727ff69d6f222b5 INFO: 172.21.0.1:55648 - "GET / HTTP/1.0" 200 OK 2026-03-13 08:53:51,193 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 08:53:51,209 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 15 2026-03-13 08:53:52,613 - lava_callback - INFO - Received callback for node 69b12d93a870a1dc3343bdeb INFO: 172.21.0.1:38590 - "POST /node/69b12d93a870a1dc3343bdeb HTTP/1.0" 202 Accepted 2026-03-13 08:53:52,618 - lava_callback - INFO - Starting async job submit for node 69b12d93a870a1dc3343bdeb 2026-03-13 08:53:52,619 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 08:53:52,639 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b12d93a870a1dc3343bdeb HTTP/1.1" 200 None 2026-03-13 08:53:52,640 - lava_callback - DEBUG - Processing node 69b12d93a870a1dc3343bdeb: baseline-arm-baylibre 2026-03-13 08:53:52,640 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b12d93a870a1dc3343bdeb 2026-03-13 08:53:52,641 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 08:53:52,661 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b12d93a870a1dc3343bdeb HTTP/1.1" 200 None 2026-03-13 08:53:52,662 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 08:53:52,678 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ae8223c660ead8a389aafd HTTP/1.1" 200 None 2026-03-13 08:53:52,679 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 08:53:52,700 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b12d93a870a1dc3343bdeb HTTP/1.1" 200 None 2026-03-13 08:53:52,705 - lava_callback - ERROR - Error processing callback for node 69b12d93a870a1dc3343bdeb: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:38598 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39974 - "GET / HTTP/1.0" 200 OK 2026-03-13 08:54:11,499 - lava_callback - INFO - Received callback for node 69b3d0a11727ff69d6f226d6 INFO: 172.21.0.1:41536 - "POST /node/69b3d0a11727ff69d6f226d6 HTTP/1.0" 202 Accepted 2026-03-13 08:54:11,506 - lava_callback - INFO - Starting async job submit for node 69b3d0a11727ff69d6f226d6 2026-03-13 08:54:11,509 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 08:54:11,534 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b3d0a11727ff69d6f226d6 HTTP/1.1" 200 None 2026-03-13 08:54:11,535 - lava_callback - DEBUG - Processing node 69b3d0a11727ff69d6f226d6: baseline-arm 2026-03-13 08:54:11,540 - lava_callback - WARNING - Failed to upload log 2026-03-13 08:54:11,543 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-13 08:54:11,689 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-13 08:54:11,691 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm-69b3d0a11727ff69d6f226d6/lava-logs.yaml 2026-03-13 08:54:11,692 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-13 08:54:11,804 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-13 08:54:11,806 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-69b3d0a11727ff69d6f226d6/lava_callback.json.gz 2026-03-13 08:54:11,809 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 08:54:11,830 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b3d0a11727ff69d6f226d6 HTTP/1.1" 200 None 2026-03-13 08:54:11,831 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 08:54:11,845 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b3c7f91727ff69d6f21d89 HTTP/1.1" 200 None 2026-03-13 08:54:11,847 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 08:54:11,873 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b3d0a11727ff69d6f226d6 HTTP/1.1" 200 None 2026-03-13 08:54:11,883 - lava_callback - INFO - Completed processing callback for node 69b3d0a11727ff69d6f226d6 2026-03-13 08:54:15,085 - lava_callback - INFO - Received callback for node 69b3cfc51727ff69d6f224a0 INFO: 172.21.0.1:41552 - "POST /node/69b3cfc51727ff69d6f224a0 HTTP/1.0" 202 Accepted 2026-03-13 08:54:15,090 - lava_callback - INFO - Starting async job submit for node 69b3cfc51727ff69d6f224a0 2026-03-13 08:54:15,107 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 08:54:15,121 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b3cfc51727ff69d6f224a0 HTTP/1.1" 200 None 2026-03-13 08:54:15,122 - lava_callback - DEBUG - Processing node 69b3cfc51727ff69d6f224a0: baseline-arm64 INFO: 172.21.0.1:41564 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:41572 - "GET / HTTP/1.0" 200 OK 2026-03-13 08:54:15,476 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-13 08:54:15,641 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-13 08:54:15,643 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-69b3cfc51727ff69d6f224a0/log.txt.gz 2026-03-13 08:54:15,835 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-13 08:54:16,061 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-13 08:54:16,064 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69b3cfc51727ff69d6f224a0/lava-logs.yaml 2026-03-13 08:54:16,072 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-13 08:54:16,231 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-13 08:54:16,233 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69b3cfc51727ff69d6f224a0/lava_callback.json.gz 2026-03-13 08:54:16,251 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 08:54:16,266 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b3cfc51727ff69d6f224a0 HTTP/1.1" 200 None 2026-03-13 08:54:16,267 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 08:54:16,289 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b3c8061727ff69d6f21d98 HTTP/1.1" 200 None 2026-03-13 08:54:16,291 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 08:54:16,319 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b3cfc51727ff69d6f224a0 HTTP/1.1" 200 None 2026-03-13 08:54:16,321 - lava_callback - INFO - Completed processing callback for node 69b3cfc51727ff69d6f224a0 INFO: 172.21.0.1:41586 - "GET / HTTP/1.0" 200 OK 2026-03-13 08:54:21,211 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 08:54:21,231 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:38446 - "GET / HTTP/1.0" 200 OK 2026-03-13 08:54:32,644 - lava_callback - INFO - Received callback for node 69b12db9a870a1dc3343bdfa INFO: 172.21.0.1:48402 - "POST /node/69b12db9a870a1dc3343bdfa HTTP/1.0" 202 Accepted 2026-03-13 08:54:32,649 - lava_callback - INFO - Starting async job submit for node 69b12db9a870a1dc3343bdfa 2026-03-13 08:54:32,650 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 08:54:32,665 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b12db9a870a1dc3343bdfa HTTP/1.1" 200 None 2026-03-13 08:54:32,666 - lava_callback - DEBUG - Processing node 69b12db9a870a1dc3343bdfa: baseline-arm-baylibre 2026-03-13 08:54:32,666 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b12db9a870a1dc3343bdfa 2026-03-13 08:54:32,666 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 08:54:32,681 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b12db9a870a1dc3343bdfa HTTP/1.1" 200 None 2026-03-13 08:54:32,682 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 08:54:32,696 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69abdf2740deb775998f3ba4 HTTP/1.1" 200 None 2026-03-13 08:54:32,698 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 08:54:32,718 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b12db9a870a1dc3343bdfa HTTP/1.1" 200 None 2026-03-13 08:54:32,722 - lava_callback - ERROR - Error processing callback for node 69b12db9a870a1dc3343bdfa: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:48418 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34262 - "GET / HTTP/1.0" 200 OK 2026-03-13 08:54:48,749 - lava_callback - INFO - Received callback for node 69b3ccaa1727ff69d6f221bb INFO: 172.21.0.1:34266 - "POST /node/69b3ccaa1727ff69d6f221bb HTTP/1.0" 202 Accepted 2026-03-13 08:54:48,756 - lava_callback - INFO - Starting async job submit for node 69b3ccaa1727ff69d6f221bb 2026-03-13 08:54:48,808 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 08:54:48,823 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b3ccaa1727ff69d6f221bb HTTP/1.1" 200 None 2026-03-13 08:54:48,824 - lava_callback - DEBUG - Processing node 69b3ccaa1727ff69d6f221bb: baseline-arm 2026-03-13 08:54:49,446 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-13 08:54:49,586 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-13 08:54:49,588 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-69b3ccaa1727ff69d6f221bb/log.txt.gz 2026-03-13 08:54:49,937 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-13 08:54:50,155 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-13 08:54:50,157 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm-69b3ccaa1727ff69d6f221bb/lava-logs.yaml 2026-03-13 08:54:50,172 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-13 08:54:50,372 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-13 08:54:50,374 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-69b3ccaa1727ff69d6f221bb/lava_callback.json.gz DEBUG: Setup failed for 69b3ccaa1727ff69d6f221bb. Transitting job node result: incomplete -> fail 2026-03-13 08:54:50,481 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 08:54:50,496 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b3ccaa1727ff69d6f221bb HTTP/1.1" 200 None 2026-03-13 08:54:50,497 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 08:54:50,529 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b3c7f91727ff69d6f21d89 HTTP/1.1" 200 None 2026-03-13 08:54:50,531 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 08:54:50,555 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b3ccaa1727ff69d6f221bb HTTP/1.1" 200 None 2026-03-13 08:54:50,676 - lava_callback - INFO - Completed processing callback for node 69b3ccaa1727ff69d6f221bb 2026-03-13 08:54:51,233 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 08:54:51,248 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:48958 - "GET / HTTP/1.0" 200 OK 2026-03-13 08:55:02,147 - lava_callback - INFO - Received callback for node 69b3d0051727ff69d6f2255d INFO: 172.21.0.1:33186 - "POST /node/69b3d0051727ff69d6f2255d HTTP/1.0" 202 Accepted 2026-03-13 08:55:02,153 - lava_callback - INFO - Starting async job submit for node 69b3d0051727ff69d6f2255d 2026-03-13 08:55:02,174 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 08:55:02,189 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b3d0051727ff69d6f2255d HTTP/1.1" 200 None 2026-03-13 08:55:02,190 - lava_callback - DEBUG - Processing node 69b3d0051727ff69d6f2255d: baseline-arm64-broonie 2026-03-13 08:55:02,456 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-13 08:55:02,600 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-13 08:55:02,602 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69b3d0051727ff69d6f2255d/log.txt.gz 2026-03-13 08:55:02,760 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-13 08:55:02,938 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-13 08:55:02,940 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69b3d0051727ff69d6f2255d/lava-logs.yaml 2026-03-13 08:55:02,946 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-13 08:55:03,160 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-13 08:55:03,162 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69b3d0051727ff69d6f2255d/lava_callback.json.gz 2026-03-13 08:55:03,185 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 08:55:03,199 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b3d0051727ff69d6f2255d HTTP/1.1" 200 None 2026-03-13 08:55:03,201 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 08:55:03,214 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b3c8061727ff69d6f21d98 HTTP/1.1" 200 None 2026-03-13 08:55:03,216 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 08:55:03,240 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b3d0051727ff69d6f2255d HTTP/1.1" 200 None 2026-03-13 08:55:03,245 - lava_callback - INFO - Completed processing callback for node 69b3d0051727ff69d6f2255d INFO: 172.21.0.1:33200 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33204 - "GET / HTTP/1.0" 200 OK 2026-03-13 08:55:12,663 - lava_callback - INFO - Received callback for node 69b12de5a870a1dc3343be13 INFO: 172.21.0.1:39702 - "POST /node/69b12de5a870a1dc3343be13 HTTP/1.0" 202 Accepted 2026-03-13 08:55:12,672 - lava_callback - INFO - Starting async job submit for node 69b12de5a870a1dc3343be13 2026-03-13 08:55:12,673 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 08:55:12,706 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b12de5a870a1dc3343be13 HTTP/1.1" 200 None 2026-03-13 08:55:12,708 - lava_callback - DEBUG - Processing node 69b12de5a870a1dc3343be13: baseline-arm-baylibre 2026-03-13 08:55:12,708 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b12de5a870a1dc3343be13 2026-03-13 08:55:12,709 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 08:55:12,769 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b12de5a870a1dc3343be13 HTTP/1.1" 200 None 2026-03-13 08:55:12,771 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 08:55:12,795 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ae8223c660ead8a389aafd HTTP/1.1" 200 None 2026-03-13 08:55:12,798 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 08:55:12,842 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b12de5a870a1dc3343be13 HTTP/1.1" 200 None 2026-03-13 08:55:12,844 - lava_callback - ERROR - Error processing callback for node 69b12de5a870a1dc3343be13: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:39704 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:39708 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39710 - "GET / HTTP/1.0" 200 OK 2026-03-13 08:55:21,250 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 08:55:21,277 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 2026-03-13 08:55:21,467 - lava_callback - INFO - Received callback for node 69b3cfd81727ff69d6f224ea INFO: 172.21.0.1:55406 - "POST /node/69b3cfd81727ff69d6f224ea HTTP/1.0" 202 Accepted 2026-03-13 08:55:21,475 - lava_callback - INFO - Starting async job submit for node 69b3cfd81727ff69d6f224ea 2026-03-13 08:55:21,519 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 08:55:21,543 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b3cfd81727ff69d6f224ea HTTP/1.1" 200 None 2026-03-13 08:55:21,545 - lava_callback - DEBUG - Processing node 69b3cfd81727ff69d6f224ea: baseline-nfs-arm64 2026-03-13 08:55:22,118 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-13 08:55:22,279 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-13 08:55:22,281 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69b3cfd81727ff69d6f224ea/log.txt.gz 2026-03-13 08:55:22,659 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-13 08:55:22,908 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-13 08:55:22,911 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69b3cfd81727ff69d6f224ea/lava-logs.yaml 2026-03-13 08:55:22,922 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-13 08:55:23,230 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-13 08:55:23,232 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69b3cfd81727ff69d6f224ea/lava_callback.json.gz 2026-03-13 08:55:23,260 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 08:55:23,280 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b3cfd81727ff69d6f224ea HTTP/1.1" 200 None 2026-03-13 08:55:23,282 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 08:55:23,298 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b3c8061727ff69d6f21d98 HTTP/1.1" 200 None 2026-03-13 08:55:23,300 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 08:55:23,341 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b3cfd81727ff69d6f224ea HTTP/1.1" 200 None 2026-03-13 08:55:23,343 - lava_callback - INFO - Completed processing callback for node 69b3cfd81727ff69d6f224ea INFO: 172.21.0.1:55420 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42986 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58204 - "GET / HTTP/1.0" 200 OK 2026-03-13 08:55:51,279 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 08:55:51,299 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 2026-03-13 08:55:52,754 - lava_callback - INFO - Received callback for node 69b12e0ba870a1dc3343be24 INFO: 172.21.0.1:60978 - "POST /node/69b12e0ba870a1dc3343be24 HTTP/1.0" 202 Accepted 2026-03-13 08:55:52,764 - lava_callback - INFO - Starting async job submit for node 69b12e0ba870a1dc3343be24 2026-03-13 08:55:52,765 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 08:55:52,797 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b12e0ba870a1dc3343be24 HTTP/1.1" 200 None 2026-03-13 08:55:52,799 - lava_callback - DEBUG - Processing node 69b12e0ba870a1dc3343be24: baseline-arm-baylibre 2026-03-13 08:55:52,800 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b12e0ba870a1dc3343be24 2026-03-13 08:55:52,801 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 08:55:52,830 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b12e0ba870a1dc3343be24 HTTP/1.1" 200 None 2026-03-13 08:55:52,833 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 08:55:52,857 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ae8223c660ead8a389aafd HTTP/1.1" 200 None 2026-03-13 08:55:52,860 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 08:55:52,900 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b12e0ba870a1dc3343be24 HTTP/1.1" 200 None 2026-03-13 08:55:52,902 - lava_callback - ERROR - Error processing callback for node 69b12e0ba870a1dc3343be24: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:60992 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60188 - "GET / HTTP/1.0" 200 OK 2026-03-13 08:56:11,903 - lava_callback - INFO - Received callback for node 69b3d10c1727ff69d6f2271c INFO: 172.21.0.1:50226 - "POST /node/69b3d10c1727ff69d6f2271c HTTP/1.0" 202 Accepted 2026-03-13 08:56:11,913 - lava_callback - INFO - Starting async job submit for node 69b3d10c1727ff69d6f2271c 2026-03-13 08:56:11,948 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 08:56:11,989 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b3d10c1727ff69d6f2271c HTTP/1.1" 200 None 2026-03-13 08:56:11,991 - lava_callback - DEBUG - Processing node 69b3d10c1727ff69d6f2271c: baseline-arm64 2026-03-13 08:56:12,196 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-13 08:56:12,340 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-13 08:56:12,341 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-69b3d10c1727ff69d6f2271c/log.txt.gz 2026-03-13 08:56:12,476 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-13 08:56:12,858 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-13 08:56:12,860 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69b3d10c1727ff69d6f2271c/lava-logs.yaml 2026-03-13 08:56:12,866 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-13 08:56:13,021 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-13 08:56:13,023 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69b3d10c1727ff69d6f2271c/lava_callback.json.gz 2026-03-13 08:56:13,042 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 08:56:13,056 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b3d10c1727ff69d6f2271c HTTP/1.1" 200 None 2026-03-13 08:56:13,058 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 08:56:13,071 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b3c8061727ff69d6f21d98 HTTP/1.1" 200 None 2026-03-13 08:56:13,073 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 08:56:13,107 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b3d10c1727ff69d6f2271c HTTP/1.1" 200 None 2026-03-13 08:56:13,109 - lava_callback - INFO - Completed processing callback for node 69b3d10c1727ff69d6f2271c INFO: 172.21.0.1:50236 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:50248 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50258 - "GET / HTTP/1.0" 200 OK 2026-03-13 08:56:21,019 - lava_callback - INFO - Received callback for node 69b3d1101727ff69d6f2271f INFO: 172.21.0.1:51350 - "POST /node/69b3d1101727ff69d6f2271f HTTP/1.0" 202 Accepted 2026-03-13 08:56:21,029 - lava_callback - INFO - Starting async job submit for node 69b3d1101727ff69d6f2271f 2026-03-13 08:56:21,056 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 08:56:21,074 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b3d1101727ff69d6f2271f HTTP/1.1" 200 None 2026-03-13 08:56:21,075 - lava_callback - DEBUG - Processing node 69b3d1101727ff69d6f2271f: baseline-arm64 2026-03-13 08:56:21,257 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-13 08:56:21,301 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 08:56:21,324 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 2026-03-13 08:56:21,648 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-13 08:56:21,650 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-69b3d1101727ff69d6f2271f/log.txt.gz 2026-03-13 08:56:21,792 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-13 08:56:21,972 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-13 08:56:21,975 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69b3d1101727ff69d6f2271f/lava-logs.yaml 2026-03-13 08:56:21,980 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-13 08:56:22,388 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-13 08:56:22,390 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69b3d1101727ff69d6f2271f/lava_callback.json.gz 2026-03-13 08:56:22,421 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 08:56:22,444 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b3d1101727ff69d6f2271f HTTP/1.1" 200 None 2026-03-13 08:56:22,447 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 08:56:22,468 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b3c8061727ff69d6f21d98 HTTP/1.1" 200 None 2026-03-13 08:56:22,471 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 08:56:22,503 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b3d1101727ff69d6f2271f HTTP/1.1" 200 None 2026-03-13 08:56:22,505 - lava_callback - INFO - Completed processing callback for node 69b3d1101727ff69d6f2271f 2026-03-13 08:56:25,186 - lava_callback - INFO - Received callback for node 69b12e34a870a1dc3343be32 INFO: 172.21.0.1:51356 - "POST /node/69b12e34a870a1dc3343be32 HTTP/1.0" 202 Accepted 2026-03-13 08:56:25,195 - lava_callback - INFO - Starting async job submit for node 69b12e34a870a1dc3343be32 2026-03-13 08:56:25,196 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 08:56:25,232 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b12e34a870a1dc3343be32 HTTP/1.1" 200 None 2026-03-13 08:56:25,234 - lava_callback - DEBUG - Processing node 69b12e34a870a1dc3343be32: baseline-arm-clabbe 2026-03-13 08:56:25,234 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b12e34a870a1dc3343be32 2026-03-13 08:56:25,235 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 08:56:25,259 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b12e34a870a1dc3343be32 HTTP/1.1" 200 None 2026-03-13 08:56:25,262 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 08:56:25,289 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ae8223c660ead8a389aafd HTTP/1.1" 200 None 2026-03-13 08:56:25,292 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 08:56:25,324 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b12e34a870a1dc3343be32 HTTP/1.1" 200 None 2026-03-13 08:56:25,326 - lava_callback - ERROR - Error processing callback for node 69b12e34a870a1dc3343be32: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:51360 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33238 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38468 - "GET / HTTP/1.0" 200 OK 2026-03-13 08:56:51,327 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 08:56:51,355 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:44040 - "GET / HTTP/1.0" 200 OK 2026-03-13 08:57:04,894 - lava_callback - INFO - Received callback for node 69b12e5ba870a1dc3343be44 INFO: 172.21.0.1:50524 - "POST /node/69b12e5ba870a1dc3343be44 HTTP/1.0" 202 Accepted 2026-03-13 08:57:04,900 - lava_callback - INFO - Starting async job submit for node 69b12e5ba870a1dc3343be44 2026-03-13 08:57:04,901 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 08:57:04,915 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b12e5ba870a1dc3343be44 HTTP/1.1" 200 None 2026-03-13 08:57:04,916 - lava_callback - DEBUG - Processing node 69b12e5ba870a1dc3343be44: baseline-arm-clabbe 2026-03-13 08:57:04,917 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b12e5ba870a1dc3343be44 2026-03-13 08:57:04,917 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 08:57:04,931 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b12e5ba870a1dc3343be44 HTTP/1.1" 200 None 2026-03-13 08:57:04,932 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 08:57:04,967 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ae8223c660ead8a389aafd HTTP/1.1" 200 None 2026-03-13 08:57:04,969 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 08:57:04,998 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b12e5ba870a1dc3343be44 HTTP/1.1" 200 None 2026-03-13 08:57:05,000 - lava_callback - ERROR - Error processing callback for node 69b12e5ba870a1dc3343be44: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:50528 - "GET / HTTP/1.0" 200 OK 2026-03-13 08:57:08,132 - lava_callback - INFO - Received callback for node 69b3ccce1727ff69d6f22246 INFO: 172.21.0.1:50532 - "POST /node/69b3ccce1727ff69d6f22246 HTTP/1.0" 202 Accepted 2026-03-13 08:57:08,181 - lava_callback - INFO - Starting async job submit for node 69b3ccce1727ff69d6f22246 2026-03-13 08:57:08,207 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 08:57:08,222 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b3ccce1727ff69d6f22246 HTTP/1.1" 200 None 2026-03-13 08:57:08,223 - lava_callback - DEBUG - Processing node 69b3ccce1727ff69d6f22246: baseline-arm-pengutronix 2026-03-13 08:57:08,336 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-13 08:57:08,809 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-13 08:57:08,810 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-pengutronix-69b3ccce1727ff69d6f22246/log.txt.gz 2026-03-13 08:57:08,870 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-13 08:57:09,331 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-13 08:57:09,334 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm-pengutronix-69b3ccce1727ff69d6f22246/lava-logs.yaml 2026-03-13 08:57:09,338 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-13 08:57:09,481 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-13 08:57:09,483 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-pengutronix-69b3ccce1727ff69d6f22246/lava_callback.json.gz DEBUG: Setup failed for 69b3ccce1727ff69d6f22246. Transitting job node result: incomplete -> fail 2026-03-13 08:57:09,532 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 08:57:09,546 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b3ccce1727ff69d6f22246 HTTP/1.1" 200 None 2026-03-13 08:57:09,547 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 08:57:09,562 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b3c7f91727ff69d6f21d89 HTTP/1.1" 200 None 2026-03-13 08:57:09,564 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 08:57:09,602 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b3ccce1727ff69d6f22246 HTTP/1.1" 200 None 2026-03-13 08:57:09,669 - lava_callback - INFO - Completed processing callback for node 69b3ccce1727ff69d6f22246 INFO: 172.21.0.1:34954 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:34964 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34968 - "GET / HTTP/1.0" 200 OK 2026-03-13 08:57:21,358 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 08:57:21,381 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:57242 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43390 - "GET / HTTP/1.0" 200 OK 2026-03-13 08:57:45,057 - lava_callback - INFO - Received callback for node 69b12e82a870a1dc3343be67 INFO: 172.21.0.1:43878 - "POST /node/69b12e82a870a1dc3343be67 HTTP/1.0" 202 Accepted 2026-03-13 08:57:45,063 - lava_callback - INFO - Starting async job submit for node 69b12e82a870a1dc3343be67 2026-03-13 08:57:45,064 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 08:57:45,083 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b12e82a870a1dc3343be67 HTTP/1.1" 200 None 2026-03-13 08:57:45,084 - lava_callback - DEBUG - Processing node 69b12e82a870a1dc3343be67: baseline-arm-clabbe 2026-03-13 08:57:45,084 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b12e82a870a1dc3343be67 2026-03-13 08:57:45,085 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 08:57:45,099 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b12e82a870a1dc3343be67 HTTP/1.1" 200 None 2026-03-13 08:57:45,101 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 08:57:45,114 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ae8223c660ead8a389aafd HTTP/1.1" 200 None 2026-03-13 08:57:45,116 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 08:57:45,144 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b12e82a870a1dc3343be67 HTTP/1.1" 200 None 2026-03-13 08:57:45,146 - lava_callback - ERROR - Error processing callback for node 69b12e82a870a1dc3343be67: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:43882 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59098 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52742 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37892 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:37904 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37918 - "GET / HTTP/1.0" 200 OK 2026-03-13 08:58:25,046 - lava_callback - INFO - Received callback for node 69b12eaaa870a1dc3343be7c INFO: 172.21.0.1:35320 - "POST /node/69b12eaaa870a1dc3343be7c HTTP/1.0" 202 Accepted 2026-03-13 08:58:25,052 - lava_callback - INFO - Starting async job submit for node 69b12eaaa870a1dc3343be7c 2026-03-13 08:58:25,052 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 08:58:25,068 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b12eaaa870a1dc3343be7c HTTP/1.1" 200 None 2026-03-13 08:58:25,069 - lava_callback - DEBUG - Processing node 69b12eaaa870a1dc3343be7c: baseline-arm-clabbe 2026-03-13 08:58:25,069 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b12eaaa870a1dc3343be7c 2026-03-13 08:58:25,070 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 08:58:25,083 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b12eaaa870a1dc3343be7c HTTP/1.1" 200 None 2026-03-13 08:58:25,085 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 08:58:25,100 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ae8223c660ead8a389aafd HTTP/1.1" 200 None 2026-03-13 08:58:25,102 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 08:58:25,122 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b12eaaa870a1dc3343be7c HTTP/1.1" 200 None 2026-03-13 08:58:25,124 - lava_callback - ERROR - Error processing callback for node 69b12eaaa870a1dc3343be7c: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:35330 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57730 - "GET / HTTP/1.0" 200 OK 2026-03-13 08:58:37,630 - lava_callback - INFO - Received callback for node 69b3d1ad1727ff69d6f22763 INFO: 172.21.0.1:57740 - "POST /node/69b3d1ad1727ff69d6f22763 HTTP/1.0" 202 Accepted 2026-03-13 08:58:37,636 - lava_callback - INFO - Starting async job submit for node 69b3d1ad1727ff69d6f22763 2026-03-13 08:58:37,638 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 08:58:37,653 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b3d1ad1727ff69d6f22763 HTTP/1.1" 200 None 2026-03-13 08:58:37,653 - lava_callback - DEBUG - Processing node 69b3d1ad1727ff69d6f22763: baseline-nfs-arm64 2026-03-13 08:58:37,655 - lava_callback - WARNING - Failed to upload log 2026-03-13 08:58:37,656 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-13 08:58:37,819 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-13 08:58:37,821 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69b3d1ad1727ff69d6f22763/lava-logs.yaml 2026-03-13 08:58:37,822 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-13 08:58:37,975 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-13 08:58:37,977 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69b3d1ad1727ff69d6f22763/lava_callback.json.gz 2026-03-13 08:58:37,979 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 08:58:37,993 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b3d1ad1727ff69d6f22763 HTTP/1.1" 200 None 2026-03-13 08:58:37,994 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 08:58:38,008 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b3c8061727ff69d6f21d98 HTTP/1.1" 200 None 2026-03-13 08:58:38,010 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 08:58:38,047 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b3d1ad1727ff69d6f22763 HTTP/1.1" 200 None 2026-03-13 08:58:38,052 - lava_callback - INFO - Completed processing callback for node 69b3d1ad1727ff69d6f22763 2026-03-13 08:58:44,852 - lava_callback - INFO - Received callback for node 69b3d18b1727ff69d6f2275a INFO: 172.21.0.1:50338 - "POST /node/69b3d18b1727ff69d6f2275a HTTP/1.0" 202 Accepted 2026-03-13 08:58:44,858 - lava_callback - INFO - Starting async job submit for node 69b3d18b1727ff69d6f2275a 2026-03-13 08:58:44,875 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 08:58:44,890 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b3d18b1727ff69d6f2275a HTTP/1.1" 200 None 2026-03-13 08:58:44,891 - lava_callback - DEBUG - Processing node 69b3d18b1727ff69d6f2275a: baseline-arm-pengutronix 2026-03-13 08:58:45,038 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-13 08:58:45,197 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-13 08:58:45,199 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-pengutronix-69b3d18b1727ff69d6f2275a/log.txt.gz 2026-03-13 08:58:45,302 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-13 08:58:45,499 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-13 08:58:45,501 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm-pengutronix-69b3d18b1727ff69d6f2275a/lava-logs.yaml 2026-03-13 08:58:45,505 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-13 08:58:45,674 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-13 08:58:45,675 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-pengutronix-69b3d18b1727ff69d6f2275a/lava_callback.json.gz 2026-03-13 08:58:45,694 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 08:58:45,713 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b3d18b1727ff69d6f2275a HTTP/1.1" 200 None 2026-03-13 08:58:45,714 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 08:58:45,751 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b3c7f91727ff69d6f21d89 HTTP/1.1" 200 None 2026-03-13 08:58:45,752 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 08:58:45,780 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b3d18b1727ff69d6f2275a HTTP/1.1" 200 None 2026-03-13 08:58:45,788 - lava_callback - INFO - Completed processing callback for node 69b3d18b1727ff69d6f2275a INFO: 172.21.0.1:50350 - "GET / HTTP/1.0" 200 OK 2026-03-13 08:58:49,001 - lava_callback - INFO - Received callback for node 69b3cfd51727ff69d6f224dc INFO: 172.21.0.1:50364 - "POST /node/69b3cfd51727ff69d6f224dc HTTP/1.0" 202 Accepted 2026-03-13 08:58:49,008 - lava_callback - INFO - Starting async job submit for node 69b3cfd51727ff69d6f224dc 2026-03-13 08:58:49,042 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 08:58:49,057 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b3cfd51727ff69d6f224dc HTTP/1.1" 200 None 2026-03-13 08:58:49,058 - lava_callback - DEBUG - Processing node 69b3cfd51727ff69d6f224dc: baseline-arm64 2026-03-13 08:58:49,442 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-13 08:58:49,584 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-13 08:58:49,586 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-69b3cfd51727ff69d6f224dc/log.txt.gz 2026-03-13 08:58:49,806 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-13 08:58:50,031 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-13 08:58:50,034 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69b3cfd51727ff69d6f224dc/lava-logs.yaml 2026-03-13 08:58:50,043 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-13 08:58:50,186 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-13 08:58:50,189 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69b3cfd51727ff69d6f224dc/lava_callback.json.gz DEBUG: Setup failed for 69b3cfd51727ff69d6f224dc. Transitting job node result: incomplete -> fail 2026-03-13 08:58:50,263 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 08:58:50,283 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b3cfd51727ff69d6f224dc HTTP/1.1" 200 None 2026-03-13 08:58:50,285 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 08:58:50,306 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b3c8061727ff69d6f21d98 HTTP/1.1" 200 None 2026-03-13 08:58:50,308 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 08:58:50,340 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b3cfd51727ff69d6f224dc HTTP/1.1" 200 None 2026-03-13 08:58:50,428 - lava_callback - INFO - Completed processing callback for node 69b3cfd51727ff69d6f224dc 2026-03-13 08:58:51,383 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 08:58:51,399 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:46446 - "GET / HTTP/1.0" 200 OK 2026-03-13 08:59:05,013 - lava_callback - INFO - Received callback for node 69b12ed0a870a1dc3343be8f INFO: 172.21.0.1:45114 - "POST /node/69b12ed0a870a1dc3343be8f HTTP/1.0" 202 Accepted 2026-03-13 08:59:05,019 - lava_callback - INFO - Starting async job submit for node 69b12ed0a870a1dc3343be8f 2026-03-13 08:59:05,019 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 08:59:05,034 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b12ed0a870a1dc3343be8f HTTP/1.1" 200 None 2026-03-13 08:59:05,035 - lava_callback - DEBUG - Processing node 69b12ed0a870a1dc3343be8f: baseline-arm-clabbe 2026-03-13 08:59:05,035 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b12ed0a870a1dc3343be8f 2026-03-13 08:59:05,036 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 08:59:05,049 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b12ed0a870a1dc3343be8f HTTP/1.1" 200 None 2026-03-13 08:59:05,051 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 08:59:05,064 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ae8223c660ead8a389aafd HTTP/1.1" 200 None 2026-03-13 08:59:05,066 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 08:59:05,088 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b12ed0a870a1dc3343be8f HTTP/1.1" 200 None 2026-03-13 08:59:05,089 - lava_callback - ERROR - Error processing callback for node 69b12ed0a870a1dc3343be8f: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:45116 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55568 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:55580 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55590 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56620 - "GET / HTTP/1.0" 200 OK 2026-03-13 08:59:32,979 - lava_callback - INFO - Received callback for node 69b12ef1a870a1dc3343be99 INFO: 172.21.0.1:42422 - "POST /node/69b12ef1a870a1dc3343be99 HTTP/1.0" 202 Accepted 2026-03-13 08:59:32,985 - lava_callback - INFO - Starting async job submit for node 69b12ef1a870a1dc3343be99 2026-03-13 08:59:32,986 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 08:59:33,006 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b12ef1a870a1dc3343be99 HTTP/1.1" 200 None 2026-03-13 08:59:33,007 - lava_callback - DEBUG - Processing node 69b12ef1a870a1dc3343be99: baseline-arm-baylibre 2026-03-13 08:59:33,007 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b12ef1a870a1dc3343be99 2026-03-13 08:59:33,008 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 08:59:33,021 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b12ef1a870a1dc3343be99 HTTP/1.1" 200 None 2026-03-13 08:59:33,023 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 08:59:33,218 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69abdf2740deb775998f3ba4 HTTP/1.1" 200 None 2026-03-13 08:59:33,220 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 08:59:33,240 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b12ef1a870a1dc3343be99 HTTP/1.1" 200 None 2026-03-13 08:59:33,247 - lava_callback - ERROR - Error processing callback for node 69b12ef1a870a1dc3343be99: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:42426 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52228 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44852 - "GET / HTTP/1.0" 200 OK 2026-03-13 09:00:01,097 - lava_callback - INFO - Received callback for node 69b3d0161727ff69d6f22596 INFO: 172.21.0.1:38014 - "POST /node/69b3d0161727ff69d6f22596 HTTP/1.0" 202 Accepted 2026-03-13 09:00:01,104 - lava_callback - INFO - Starting async job submit for node 69b3d0161727ff69d6f22596 2026-03-13 09:00:01,133 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 09:00:01,148 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b3d0161727ff69d6f22596 HTTP/1.1" 200 None 2026-03-13 09:00:01,149 - lava_callback - DEBUG - Processing node 69b3d0161727ff69d6f22596: baseline-arm64-clabbe 2026-03-13 09:00:01,538 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-13 09:00:01,763 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-13 09:00:01,765 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-clabbe-69b3d0161727ff69d6f22596/log.txt.gz 2026-03-13 09:00:02,033 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-13 09:00:02,293 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-13 09:00:02,295 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-clabbe-69b3d0161727ff69d6f22596/lava-logs.yaml 2026-03-13 09:00:02,304 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-13 09:00:02,519 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-13 09:00:02,520 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-clabbe-69b3d0161727ff69d6f22596/lava_callback.json.gz 2026-03-13 09:00:02,551 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 09:00:02,566 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b3d0161727ff69d6f22596 HTTP/1.1" 200 None 2026-03-13 09:00:02,567 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 09:00:02,583 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b3c8061727ff69d6f21d98 HTTP/1.1" 200 None 2026-03-13 09:00:02,585 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 09:00:02,611 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b3d0161727ff69d6f22596 HTTP/1.1" 200 None 2026-03-13 09:00:02,613 - lava_callback - INFO - Completed processing callback for node 69b3d0161727ff69d6f22596 INFO: 172.21.0.1:38026 - "GET / HTTP/1.0" 200 OK 2026-03-13 09:00:12,959 - lava_callback - INFO - Received callback for node 69b12f17a870a1dc3343bea4 INFO: 172.21.0.1:39040 - "POST /node/69b12f17a870a1dc3343bea4 HTTP/1.0" 202 Accepted 2026-03-13 09:00:12,965 - lava_callback - INFO - Starting async job submit for node 69b12f17a870a1dc3343bea4 2026-03-13 09:00:12,965 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 09:00:12,980 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b12f17a870a1dc3343bea4 HTTP/1.1" 200 None 2026-03-13 09:00:12,981 - lava_callback - DEBUG - Processing node 69b12f17a870a1dc3343bea4: baseline-arm-baylibre 2026-03-13 09:00:12,981 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b12f17a870a1dc3343bea4 2026-03-13 09:00:12,981 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 09:00:13,002 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b12f17a870a1dc3343bea4 HTTP/1.1" 200 None 2026-03-13 09:00:13,004 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 09:00:13,018 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69abdf2740deb775998f3ba4 HTTP/1.1" 200 None 2026-03-13 09:00:13,020 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 09:00:13,045 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b12f17a870a1dc3343bea4 HTTP/1.1" 200 None 2026-03-13 09:00:13,047 - lava_callback - ERROR - Error processing callback for node 69b12f17a870a1dc3343bea4: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:39048 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:39052 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39066 - "GET / HTTP/1.0" 200 OK 2026-03-13 09:00:21,402 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 09:00:21,421 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:59216 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51948 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38310 - "GET / HTTP/1.0" 200 OK 2026-03-13 09:00:52,970 - lava_callback - INFO - Received callback for node 69b12f3ea870a1dc3343beb0 INFO: 172.21.0.1:33156 - "POST /node/69b12f3ea870a1dc3343beb0 HTTP/1.0" 202 Accepted 2026-03-13 09:00:52,975 - lava_callback - INFO - Starting async job submit for node 69b12f3ea870a1dc3343beb0 2026-03-13 09:00:52,976 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 09:00:52,999 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b12f3ea870a1dc3343beb0 HTTP/1.1" 200 None 2026-03-13 09:00:53,000 - lava_callback - DEBUG - Processing node 69b12f3ea870a1dc3343beb0: baseline-arm-baylibre 2026-03-13 09:00:53,001 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b12f3ea870a1dc3343beb0 2026-03-13 09:00:53,001 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 09:00:53,015 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b12f3ea870a1dc3343beb0 HTTP/1.1" 200 None 2026-03-13 09:00:53,017 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 09:00:53,031 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69abdf2740deb775998f3ba4 HTTP/1.1" 200 None 2026-03-13 09:00:53,033 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 09:00:53,054 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b12f3ea870a1dc3343beb0 HTTP/1.1" 200 None 2026-03-13 09:00:53,056 - lava_callback - ERROR - Error processing callback for node 69b12f3ea870a1dc3343beb0: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:33164 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36034 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41302 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:41318 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41330 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46320 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47438 - "GET / HTTP/1.0" 200 OK 2026-03-13 09:01:45,204 - lava_callback - INFO - Received callback for node 69b12f6aa870a1dc3343bec1 INFO: 172.21.0.1:34910 - "POST /node/69b12f6aa870a1dc3343bec1 HTTP/1.0" 202 Accepted 2026-03-13 09:01:45,209 - lava_callback - INFO - Starting async job submit for node 69b12f6aa870a1dc3343bec1 2026-03-13 09:01:45,210 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 09:01:45,224 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b12f6aa870a1dc3343bec1 HTTP/1.1" 200 None 2026-03-13 09:01:45,224 - lava_callback - DEBUG - Processing node 69b12f6aa870a1dc3343bec1: baseline-arm-clabbe 2026-03-13 09:01:45,225 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b12f6aa870a1dc3343bec1 2026-03-13 09:01:45,225 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 09:01:45,239 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b12f6aa870a1dc3343bec1 HTTP/1.1" 200 None 2026-03-13 09:01:45,240 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 09:01:45,254 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69abdf2740deb775998f3ba4 HTTP/1.1" 200 None 2026-03-13 09:01:45,255 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 09:01:45,278 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b12f6aa870a1dc3343bec1 HTTP/1.1" 200 None 2026-03-13 09:01:45,279 - lava_callback - ERROR - Error processing callback for node 69b12f6aa870a1dc3343bec1: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:34916 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41850 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44270 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36088 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:36098 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36104 - "GET / HTTP/1.0" 200 OK 2026-03-13 09:02:25,353 - lava_callback - INFO - Received callback for node 69b12f92a870a1dc3343bed1 INFO: 172.21.0.1:41416 - "POST /node/69b12f92a870a1dc3343bed1 HTTP/1.0" 202 Accepted 2026-03-13 09:02:25,360 - lava_callback - INFO - Starting async job submit for node 69b12f92a870a1dc3343bed1 2026-03-13 09:02:25,361 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 09:02:25,376 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b12f92a870a1dc3343bed1 HTTP/1.1" 200 None 2026-03-13 09:02:25,377 - lava_callback - DEBUG - Processing node 69b12f92a870a1dc3343bed1: baseline-arm-clabbe 2026-03-13 09:02:25,377 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b12f92a870a1dc3343bed1 2026-03-13 09:02:25,378 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 09:02:25,395 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b12f92a870a1dc3343bed1 HTTP/1.1" 200 None 2026-03-13 09:02:25,396 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 09:02:25,409 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69abdf2740deb775998f3ba4 HTTP/1.1" 200 None 2026-03-13 09:02:25,411 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 09:02:25,431 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b12f92a870a1dc3343bed1 HTTP/1.1" 200 None 2026-03-13 09:02:25,433 - lava_callback - ERROR - Error processing callback for node 69b12f92a870a1dc3343bed1: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:41422 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33334 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52830 - "GET / HTTP/1.0" 200 OK 2026-03-13 09:02:52,550 - lava_callback - INFO - Received callback for node 69b3d2671727ff69d6f227a1 INFO: 172.21.0.1:38678 - "POST /node/69b3d2671727ff69d6f227a1 HTTP/1.0" 202 Accepted 2026-03-13 09:02:52,557 - lava_callback - INFO - Starting async job submit for node 69b3d2671727ff69d6f227a1 2026-03-13 09:02:52,587 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 09:02:52,602 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b3d2671727ff69d6f227a1 HTTP/1.1" 200 None 2026-03-13 09:02:52,603 - lava_callback - DEBUG - Processing node 69b3d2671727ff69d6f227a1: baseline-arm64 2026-03-13 09:02:52,797 - lava_callback - WARNING - Failed to upload log 2026-03-13 09:02:52,899 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-13 09:02:53,122 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-13 09:02:53,124 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69b3d2671727ff69d6f227a1/lava-logs.yaml 2026-03-13 09:02:53,128 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-13 09:02:53,144 - lava_callback - INFO - Received callback for node 69b12fb7a870a1dc3343bedf INFO: 172.21.0.1:38688 - "POST /node/69b12fb7a870a1dc3343bedf HTTP/1.0" 202 Accepted 2026-03-13 09:02:53,150 - lava_callback - INFO - Starting async job submit for node 69b12fb7a870a1dc3343bedf 2026-03-13 09:02:53,150 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 09:02:53,172 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b12fb7a870a1dc3343bedf HTTP/1.1" 200 None 2026-03-13 09:02:53,173 - lava_callback - DEBUG - Processing node 69b12fb7a870a1dc3343bedf: baseline-arm-baylibre 2026-03-13 09:02:53,173 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b12fb7a870a1dc3343bedf 2026-03-13 09:02:53,173 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 09:02:53,188 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b12fb7a870a1dc3343bedf HTTP/1.1" 200 None 2026-03-13 09:02:53,189 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 09:02:53,203 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69abdf2740deb775998f3ba4 HTTP/1.1" 200 None 2026-03-13 09:02:53,204 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 09:02:53,260 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b12fb7a870a1dc3343bedf HTTP/1.1" 200 None 2026-03-13 09:02:53,262 - lava_callback - ERROR - Error processing callback for node 69b12fb7a870a1dc3343bedf: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' 2026-03-13 09:02:53,317 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-13 09:02:53,319 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69b3d2671727ff69d6f227a1/lava_callback.json.gz 2026-03-13 09:02:53,381 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 09:02:53,419 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b3d2671727ff69d6f227a1 HTTP/1.1" 200 None 2026-03-13 09:02:53,421 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 09:02:53,441 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b3c8061727ff69d6f21d98 HTTP/1.1" 200 None 2026-03-13 09:02:53,444 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 09:02:53,478 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b3d2671727ff69d6f227a1 HTTP/1.1" 200 None 2026-03-13 09:02:53,558 - lava_callback - INFO - Completed processing callback for node 69b3d2671727ff69d6f227a1 INFO: 172.21.0.1:38696 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38792 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58204 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:58220 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58222 - "GET / HTTP/1.0" 200 OK 2026-03-13 09:03:21,424 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 09:03:21,441 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:50206 - "GET / HTTP/1.0" 200 OK 2026-03-13 09:03:33,090 - lava_callback - INFO - Received callback for node 69b12fdda870a1dc3343bef8 INFO: 172.21.0.1:54216 - "POST /node/69b12fdda870a1dc3343bef8 HTTP/1.0" 202 Accepted 2026-03-13 09:03:33,095 - lava_callback - INFO - Starting async job submit for node 69b12fdda870a1dc3343bef8 2026-03-13 09:03:33,096 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 09:03:33,111 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b12fdda870a1dc3343bef8 HTTP/1.1" 200 None 2026-03-13 09:03:33,112 - lava_callback - DEBUG - Processing node 69b12fdda870a1dc3343bef8: baseline-arm-baylibre 2026-03-13 09:03:33,112 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b12fdda870a1dc3343bef8 2026-03-13 09:03:33,112 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 09:03:33,125 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b12fdda870a1dc3343bef8 HTTP/1.1" 200 None 2026-03-13 09:03:33,127 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 09:03:33,141 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69abdf2740deb775998f3ba4 HTTP/1.1" 200 None 2026-03-13 09:03:33,142 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 09:03:33,168 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b12fdda870a1dc3343bef8 HTTP/1.1" 200 None 2026-03-13 09:03:33,175 - lava_callback - ERROR - Error processing callback for node 69b12fdda870a1dc3343bef8: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:54222 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59720 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59262 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47738 - "GET / HTTP/1.0" 200 OK 2026-03-13 09:04:08,695 - lava_callback - INFO - Received callback for node 69b3d2db1727ff69d6f227bc INFO: 172.21.0.1:47754 - "POST /node/69b3d2db1727ff69d6f227bc HTTP/1.0" 202 Accepted 2026-03-13 09:04:08,702 - lava_callback - INFO - Starting async job submit for node 69b3d2db1727ff69d6f227bc 2026-03-13 09:04:08,730 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 09:04:08,751 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b3d2db1727ff69d6f227bc HTTP/1.1" 200 None 2026-03-13 09:04:08,751 - lava_callback - DEBUG - Processing node 69b3d2db1727ff69d6f227bc: baseline-arm64 2026-03-13 09:04:08,888 - lava_callback - WARNING - Failed to upload log 2026-03-13 09:04:08,959 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-13 09:04:09,235 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-13 09:04:09,237 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69b3d2db1727ff69d6f227bc/lava-logs.yaml 2026-03-13 09:04:09,240 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-13 09:04:09,375 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-13 09:04:09,377 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69b3d2db1727ff69d6f227bc/lava_callback.json.gz 2026-03-13 09:04:09,406 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 09:04:09,424 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b3d2db1727ff69d6f227bc HTTP/1.1" 200 None 2026-03-13 09:04:09,425 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 09:04:09,438 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b3c8061727ff69d6f21d98 HTTP/1.1" 200 None 2026-03-13 09:04:09,439 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 09:04:09,466 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b3d2db1727ff69d6f227bc HTTP/1.1" 200 None 2026-03-13 09:04:09,530 - lava_callback - INFO - Completed processing callback for node 69b3d2db1727ff69d6f227bc INFO: 172.21.0.1:55746 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:55754 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55766 - "GET / HTTP/1.0" 200 OK 2026-03-13 09:04:21,443 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 09:04:21,460 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:35044 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45124 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47872 - "GET / HTTP/1.0" 200 OK 2026-03-13 09:04:53,384 - lava_callback - INFO - Received callback for node 69b1302ea870a1dc3343bf26 INFO: 172.21.0.1:42234 - "POST /node/69b1302ea870a1dc3343bf26 HTTP/1.0" 202 Accepted 2026-03-13 09:04:53,390 - lava_callback - INFO - Starting async job submit for node 69b1302ea870a1dc3343bf26 2026-03-13 09:04:53,390 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 09:04:53,404 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b1302ea870a1dc3343bf26 HTTP/1.1" 200 None 2026-03-13 09:04:53,405 - lava_callback - DEBUG - Processing node 69b1302ea870a1dc3343bf26: baseline-arm64-baylibre 2026-03-13 09:04:53,405 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b1302ea870a1dc3343bf26 2026-03-13 09:04:53,406 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 09:04:53,420 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b1302ea870a1dc3343bf26 HTTP/1.1" 200 None 2026-03-13 09:04:53,422 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 09:04:53,436 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ae822fc660ead8a389ab0e HTTP/1.1" 200 None 2026-03-13 09:04:53,437 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 09:04:53,471 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b1302ea870a1dc3343bf26 HTTP/1.1" 200 None 2026-03-13 09:04:53,475 - lava_callback - ERROR - Error processing callback for node 69b1302ea870a1dc3343bf26: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:42240 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33628 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35686 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:35698 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35704 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46642 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52370 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47992 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47006 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35786 - "GET / HTTP/1.0" 200 OK 2026-03-13 09:06:07,444 - lava_callback - INFO - Received callback for node 69b3ccee1727ff69d6f22297 INFO: 172.21.0.1:35788 - "POST /node/69b3ccee1727ff69d6f22297 HTTP/1.0" 202 Accepted 2026-03-13 09:06:07,493 - lava_callback - INFO - Starting async job submit for node 69b3ccee1727ff69d6f22297 2026-03-13 09:06:07,517 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 09:06:07,532 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b3ccee1727ff69d6f22297 HTTP/1.1" 200 None 2026-03-13 09:06:07,533 - lava_callback - DEBUG - Processing node 69b3ccee1727ff69d6f22297: ltp-pty 2026-03-13 09:06:07,640 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-13 09:06:07,816 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-13 09:06:07,817 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/ltp-pty-69b3ccee1727ff69d6f22297/log.txt.gz 2026-03-13 09:06:07,869 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-13 09:06:08,077 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-13 09:06:08,079 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/ltp-pty-69b3ccee1727ff69d6f22297/lava-logs.yaml 2026-03-13 09:06:08,082 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-13 09:06:08,214 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-13 09:06:08,216 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/ltp-pty-69b3ccee1727ff69d6f22297/lava_callback.json.gz 2026-03-13 09:06:08,242 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 09:06:08,257 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b3ccee1727ff69d6f22297 HTTP/1.1" 200 None 2026-03-13 09:06:08,258 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 09:06:08,275 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b3c7f91727ff69d6f21d89 HTTP/1.1" 200 None 2026-03-13 09:06:08,276 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 09:06:08,298 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b3ccee1727ff69d6f22297 HTTP/1.1" 200 None 2026-03-13 09:06:08,353 - lava_callback - INFO - Completed processing callback for node 69b3ccee1727ff69d6f22297 2026-03-13 09:06:13,524 - lava_callback - INFO - Received callback for node 69b1307aa870a1dc3343bf3b INFO: 172.21.0.1:45844 - "POST /node/69b1307aa870a1dc3343bf3b HTTP/1.0" 202 Accepted 2026-03-13 09:06:13,529 - lava_callback - INFO - Starting async job submit for node 69b1307aa870a1dc3343bf3b 2026-03-13 09:06:13,530 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 09:06:13,552 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b1307aa870a1dc3343bf3b HTTP/1.1" 200 None 2026-03-13 09:06:13,554 - lava_callback - DEBUG - Processing node 69b1307aa870a1dc3343bf3b: baseline-arm64-baylibre 2026-03-13 09:06:13,554 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b1307aa870a1dc3343bf3b 2026-03-13 09:06:13,555 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 09:06:13,573 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b1307aa870a1dc3343bf3b HTTP/1.1" 200 None 2026-03-13 09:06:13,575 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 09:06:13,591 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ae822fc660ead8a389ab0e HTTP/1.1" 200 None 2026-03-13 09:06:13,593 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 09:06:13,614 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b1307aa870a1dc3343bf3b HTTP/1.1" 200 None 2026-03-13 09:06:13,637 - lava_callback - ERROR - Error processing callback for node 69b1307aa870a1dc3343bf3b: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:45856 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:45872 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45876 - "GET / HTTP/1.0" 200 OK 2026-03-13 09:06:21,462 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 09:06:21,484 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:45990 - "GET / HTTP/1.0" 200 OK 2026-03-13 09:06:32,427 - lava_callback - INFO - Received callback for node 69b3d3671727ff69d6f227db INFO: 172.21.0.1:35294 - "POST /node/69b3d3671727ff69d6f227db HTTP/1.0" 202 Accepted 2026-03-13 09:06:32,433 - lava_callback - INFO - Starting async job submit for node 69b3d3671727ff69d6f227db 2026-03-13 09:06:32,456 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 09:06:32,488 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b3d3671727ff69d6f227db HTTP/1.1" 200 None 2026-03-13 09:06:32,490 - lava_callback - DEBUG - Processing node 69b3d3671727ff69d6f227db: baseline-arm64-foundriesio 2026-03-13 09:06:32,715 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-13 09:06:32,899 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-13 09:06:32,901 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-foundriesio-69b3d3671727ff69d6f227db/log.txt.gz 2026-03-13 09:06:33,026 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-13 09:06:33,232 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-13 09:06:33,234 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-foundriesio-69b3d3671727ff69d6f227db/lava-logs.yaml 2026-03-13 09:06:33,239 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-13 09:06:33,420 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-13 09:06:33,422 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-foundriesio-69b3d3671727ff69d6f227db/lava_callback.json.gz 2026-03-13 09:06:33,443 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 09:06:33,470 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b3d3671727ff69d6f227db HTTP/1.1" 200 None 2026-03-13 09:06:33,472 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 09:06:33,488 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b3c8061727ff69d6f21d98 HTTP/1.1" 200 None 2026-03-13 09:06:33,490 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 09:06:33,520 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b3d3671727ff69d6f227db HTTP/1.1" 200 None 2026-03-13 09:06:33,522 - lava_callback - INFO - Completed processing callback for node 69b3d3671727ff69d6f227db INFO: 172.21.0.1:35306 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42092 - "GET / HTTP/1.0" 200 OK 2026-03-13 09:06:51,486 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 09:06:51,502 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:45348 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44142 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44244 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:44258 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44262 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55992 - "GET / HTTP/1.0" 200 OK 2026-03-13 09:07:33,592 - lava_callback - INFO - Received callback for node 69b130c4a870a1dc3343bf44 INFO: 172.21.0.1:48044 - "POST /node/69b130c4a870a1dc3343bf44 HTTP/1.0" 202 Accepted 2026-03-13 09:07:33,597 - lava_callback - INFO - Starting async job submit for node 69b130c4a870a1dc3343bf44 2026-03-13 09:07:33,598 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 09:07:33,631 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b130c4a870a1dc3343bf44 HTTP/1.1" 200 None 2026-03-13 09:07:33,632 - lava_callback - DEBUG - Processing node 69b130c4a870a1dc3343bf44: baseline-arm64-baylibre 2026-03-13 09:07:33,633 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b130c4a870a1dc3343bf44 2026-03-13 09:07:33,633 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 09:07:33,646 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b130c4a870a1dc3343bf44 HTTP/1.1" 200 None 2026-03-13 09:07:33,648 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 09:07:33,663 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ae822fc660ead8a389ab0e HTTP/1.1" 200 None 2026-03-13 09:07:33,664 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 09:07:33,687 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b130c4a870a1dc3343bf44 HTTP/1.1" 200 None 2026-03-13 09:07:33,688 - lava_callback - ERROR - Error processing callback for node 69b130c4a870a1dc3343bf44: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:48054 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34424 - "GET /node/69944f555ae459b9df3dceee%5Cn HTTP/1.0" 405 Method Not Allowed INFO: 172.21.0.1:34432 - "GET / HTTP/1.0" 200 OK 2026-03-13 09:07:47,349 - lava_callback - INFO - Received callback for node 69b3d3a11727ff69d6f227ea INFO: 172.21.0.1:34442 - "POST /node/69b3d3a11727ff69d6f227ea HTTP/1.0" 202 Accepted 2026-03-13 09:07:47,355 - lava_callback - INFO - Starting async job submit for node 69b3d3a11727ff69d6f227ea 2026-03-13 09:07:47,376 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 09:07:47,391 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b3d3a11727ff69d6f227ea HTTP/1.1" 200 None 2026-03-13 09:07:47,391 - lava_callback - DEBUG - Processing node 69b3d3a11727ff69d6f227ea: baseline-arm64 2026-03-13 09:07:47,770 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-13 09:07:47,946 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-13 09:07:47,948 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-69b3d3a11727ff69d6f227ea/log.txt.gz 2026-03-13 09:07:48,205 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-13 09:07:48,450 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-13 09:07:48,452 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69b3d3a11727ff69d6f227ea/lava-logs.yaml 2026-03-13 09:07:48,461 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-13 09:07:48,620 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-13 09:07:48,621 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69b3d3a11727ff69d6f227ea/lava_callback.json.gz 2026-03-13 09:07:48,643 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 09:07:48,671 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b3d3a11727ff69d6f227ea HTTP/1.1" 200 None 2026-03-13 09:07:48,672 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 09:07:48,687 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b3c8061727ff69d6f21d98 HTTP/1.1" 200 None 2026-03-13 09:07:48,688 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 09:07:48,714 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b3d3a11727ff69d6f227ea HTTP/1.1" 200 None 2026-03-13 09:07:48,719 - lava_callback - INFO - Completed processing callback for node 69b3d3a11727ff69d6f227ea 2026-03-13 09:07:51,505 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 09:07:51,521 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:37590 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55256 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34592 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:34600 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34614 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50092 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42490 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59844 - "GET / HTTP/1.0" 200 OK 2026-03-13 09:08:53,438 - lava_callback - INFO - Received callback for node 69b13110a870a1dc3343bf56 INFO: 172.21.0.1:57792 - "POST /node/69b13110a870a1dc3343bf56 HTTP/1.0" 202 Accepted 2026-03-13 09:08:53,443 - lava_callback - INFO - Starting async job submit for node 69b13110a870a1dc3343bf56 2026-03-13 09:08:53,444 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 09:08:53,459 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b13110a870a1dc3343bf56 HTTP/1.1" 200 None 2026-03-13 09:08:53,459 - lava_callback - DEBUG - Processing node 69b13110a870a1dc3343bf56: baseline-arm64-baylibre 2026-03-13 09:08:53,460 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b13110a870a1dc3343bf56 2026-03-13 09:08:53,460 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 09:08:53,473 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b13110a870a1dc3343bf56 HTTP/1.1" 200 None 2026-03-13 09:08:53,475 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 09:08:53,488 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ae822fc660ead8a389ab0e HTTP/1.1" 200 None 2026-03-13 09:08:53,490 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 09:08:53,511 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b13110a870a1dc3343bf56 HTTP/1.1" 200 None 2026-03-13 09:08:53,512 - lava_callback - ERROR - Error processing callback for node 69b13110a870a1dc3343bf56: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:57804 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56174 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40012 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:40028 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40034 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51024 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41236 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41214 - "GET / HTTP/1.0" 200 OK 2026-03-13 09:09:53,445 - lava_callback - INFO - Received callback for node 69b1315da870a1dc3343bf5f INFO: 172.21.0.1:35498 - "POST /node/69b1315da870a1dc3343bf5f HTTP/1.0" 202 Accepted 2026-03-13 09:09:53,455 - lava_callback - INFO - Starting async job submit for node 69b1315da870a1dc3343bf5f 2026-03-13 09:09:53,456 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 09:09:53,481 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b1315da870a1dc3343bf5f HTTP/1.1" 200 None 2026-03-13 09:09:53,482 - lava_callback - DEBUG - Processing node 69b1315da870a1dc3343bf5f: baseline-arm64-baylibre 2026-03-13 09:09:53,483 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b1315da870a1dc3343bf5f 2026-03-13 09:09:53,484 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 09:09:53,510 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b1315da870a1dc3343bf5f HTTP/1.1" 200 None 2026-03-13 09:09:53,512 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 09:09:53,536 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ae822fc660ead8a389ab0e HTTP/1.1" 200 None 2026-03-13 09:09:53,538 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 09:09:53,580 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b1315da870a1dc3343bf5f HTTP/1.1" 200 None 2026-03-13 09:09:53,581 - lava_callback - ERROR - Error processing callback for node 69b1315da870a1dc3343bf5f: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:35506 - "GET / HTTP/1.0" 200 OK 2026-03-13 09:10:03,849 - lava_callback - INFO - Received callback for node 69b3d41a1727ff69d6f2280b INFO: 172.21.0.1:40718 - "POST /node/69b3d41a1727ff69d6f2280b HTTP/1.0" 202 Accepted 2026-03-13 09:10:03,859 - lava_callback - INFO - Starting async job submit for node 69b3d41a1727ff69d6f2280b 2026-03-13 09:10:03,900 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 09:10:03,931 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b3d41a1727ff69d6f2280b HTTP/1.1" 200 None 2026-03-13 09:10:03,932 - lava_callback - DEBUG - Processing node 69b3d41a1727ff69d6f2280b: baseline-nfs-arm64 2026-03-13 09:10:04,570 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-13 09:10:04,844 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-13 09:10:04,847 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69b3d41a1727ff69d6f2280b/log.txt.gz 2026-03-13 09:10:05,188 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-13 09:10:05,616 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-13 09:10:05,618 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69b3d41a1727ff69d6f2280b/lava-logs.yaml 2026-03-13 09:10:05,629 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-13 09:10:05,792 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-13 09:10:05,793 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69b3d41a1727ff69d6f2280b/lava_callback.json.gz 2026-03-13 09:10:05,817 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 09:10:05,832 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b3d41a1727ff69d6f2280b HTTP/1.1" 200 None 2026-03-13 09:10:05,834 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 09:10:05,851 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b3c8061727ff69d6f21d98 HTTP/1.1" 200 None 2026-03-13 09:10:05,853 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 09:10:05,904 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b3d41a1727ff69d6f2280b HTTP/1.1" 200 None 2026-03-13 09:10:05,905 - lava_callback - INFO - Completed processing callback for node 69b3d41a1727ff69d6f2280b INFO: 172.21.0.1:40724 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53510 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:53514 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53528 - "GET / HTTP/1.0" 200 OK 2026-03-13 09:10:21,523 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 09:10:21,548 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:57496 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43110 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57694 - "GET / HTTP/1.0" 200 OK 2026-03-13 09:10:54,367 - lava_callback - INFO - Received callback for node 69b3cfdb1727ff69d6f224f0 INFO: 172.21.0.1:36552 - "POST /node/69b3cfdb1727ff69d6f224f0 HTTP/1.0" 202 Accepted 2026-03-13 09:10:54,377 - lava_callback - INFO - Starting async job submit for node 69b3cfdb1727ff69d6f224f0 2026-03-13 09:10:54,436 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 09:10:54,466 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b3cfdb1727ff69d6f224f0 HTTP/1.1" 200 None 2026-03-13 09:10:54,467 - lava_callback - DEBUG - Processing node 69b3cfdb1727ff69d6f224f0: baseline-nfs-arm64 2026-03-13 09:10:56,125 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 INFO: 172.21.0.1:36556 - "GET / HTTP/1.0" 200 OK 2026-03-13 09:10:56,550 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-13 09:10:56,552 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69b3cfdb1727ff69d6f224f0/log.txt.gz 2026-03-13 09:10:57,401 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-13 09:10:57,948 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-13 09:10:57,951 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69b3cfdb1727ff69d6f224f0/lava-logs.yaml 2026-03-13 09:10:57,973 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-13 09:10:58,414 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-13 09:10:58,416 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69b3cfdb1727ff69d6f224f0/lava_callback.json.gz DEBUG: Setup failed for 69b3cfdb1727ff69d6f224f0. Transitting job node result: incomplete -> fail 2026-03-13 09:10:58,587 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 09:10:58,604 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b3cfdb1727ff69d6f224f0 HTTP/1.1" 200 None 2026-03-13 09:10:58,606 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 09:10:58,631 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b3c8061727ff69d6f21d98 HTTP/1.1" 200 None 2026-03-13 09:10:58,632 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 09:10:58,658 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b3cfdb1727ff69d6f224f0 HTTP/1.1" 200 None 2026-03-13 09:10:58,753 - lava_callback - INFO - Completed processing callback for node 69b3cfdb1727ff69d6f224f0 INFO: 172.21.0.1:36144 - "GET / HTTP/1.0" 200 OK 2026-03-13 09:11:13,598 - lava_callback - INFO - Received callback for node 69b131a9a870a1dc3343bf72 INFO: 172.21.0.1:43698 - "POST /node/69b131a9a870a1dc3343bf72 HTTP/1.0" 202 Accepted 2026-03-13 09:11:13,603 - lava_callback - INFO - Starting async job submit for node 69b131a9a870a1dc3343bf72 2026-03-13 09:11:13,604 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 09:11:13,618 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b131a9a870a1dc3343bf72 HTTP/1.1" 200 None 2026-03-13 09:11:13,619 - lava_callback - DEBUG - Processing node 69b131a9a870a1dc3343bf72: baseline-arm64-baylibre 2026-03-13 09:11:13,619 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b131a9a870a1dc3343bf72 2026-03-13 09:11:13,620 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 09:11:13,633 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b131a9a870a1dc3343bf72 HTTP/1.1" 200 None 2026-03-13 09:11:13,634 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 09:11:13,651 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ae822fc660ead8a389ab0e HTTP/1.1" 200 None 2026-03-13 09:11:13,652 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 09:11:13,672 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b131a9a870a1dc3343bf72 HTTP/1.1" 200 None 2026-03-13 09:11:13,678 - lava_callback - ERROR - Error processing callback for node 69b131a9a870a1dc3343bf72: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:43712 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:43714 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43720 - "GET / HTTP/1.0" 200 OK 2026-03-13 09:11:21,551 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 09:11:21,569 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:38548 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59948 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53314 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47318 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36996 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34936 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:34938 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34950 - "GET / HTTP/1.0" 200 OK 2026-03-13 09:12:25,697 - lava_callback - INFO - Received callback for node 69b131eba870a1dc3343bf7c INFO: 172.21.0.1:35002 - "POST /node/69b131eba870a1dc3343bf7c HTTP/1.0" 202 Accepted 2026-03-13 09:12:25,703 - lava_callback - INFO - Starting async job submit for node 69b131eba870a1dc3343bf7c 2026-03-13 09:12:25,704 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 09:12:25,727 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b131eba870a1dc3343bf7c HTTP/1.1" 200 None 2026-03-13 09:12:25,728 - lava_callback - DEBUG - Processing node 69b131eba870a1dc3343bf7c: baseline-arm-clabbe 2026-03-13 09:12:25,729 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b131eba870a1dc3343bf7c 2026-03-13 09:12:25,729 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 09:12:25,743 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b131eba870a1dc3343bf7c HTTP/1.1" 200 None 2026-03-13 09:12:25,745 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 09:12:25,761 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69abdf2740deb775998f3ba4 HTTP/1.1" 200 None 2026-03-13 09:12:25,762 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 09:12:25,783 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b131eba870a1dc3343bf7c HTTP/1.1" 200 None 2026-03-13 09:12:25,792 - lava_callback - ERROR - Error processing callback for node 69b131eba870a1dc3343bf7c: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:35014 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60674 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59510 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57278 - "GET / HTTP/1.0" 200 OK 2026-03-13 09:13:04,558 - lava_callback - INFO - Received callback for node 69b3d0e71727ff69d6f22706 INFO: 172.21.0.1:60172 - "POST /node/69b3d0e71727ff69d6f22706 HTTP/1.0" 202 Accepted 2026-03-13 09:13:04,564 - lava_callback - INFO - Starting async job submit for node 69b3d0e71727ff69d6f22706 2026-03-13 09:13:04,625 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 09:13:04,640 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b3d0e71727ff69d6f22706 HTTP/1.1" 200 None 2026-03-13 09:13:04,640 - lava_callback - DEBUG - Processing node 69b3d0e71727ff69d6f22706: ltp-smoke 2026-03-13 09:13:05,136 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-13 09:13:05,282 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-13 09:13:05,284 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/ltp-smoke-69b3d0e71727ff69d6f22706/log.txt.gz 2026-03-13 09:13:05,557 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-13 09:13:05,688 - lava_callback - INFO - Received callback for node 69b1321fa870a1dc3343bf8e INFO: 172.21.0.1:60184 - "POST /node/69b1321fa870a1dc3343bf8e HTTP/1.0" 202 Accepted 2026-03-13 09:13:05,695 - lava_callback - INFO - Starting async job submit for node 69b1321fa870a1dc3343bf8e 2026-03-13 09:13:05,695 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 09:13:05,713 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b1321fa870a1dc3343bf8e HTTP/1.1" 200 None 2026-03-13 09:13:05,714 - lava_callback - DEBUG - Processing node 69b1321fa870a1dc3343bf8e: baseline-arm64-clabbe 2026-03-13 09:13:05,714 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b1321fa870a1dc3343bf8e 2026-03-13 09:13:05,715 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 09:13:05,729 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b1321fa870a1dc3343bf8e HTTP/1.1" 200 None 2026-03-13 09:13:05,730 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 09:13:05,746 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ae822fc660ead8a389ab0e HTTP/1.1" 200 None 2026-03-13 09:13:05,747 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 09:13:05,769 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b1321fa870a1dc3343bf8e HTTP/1.1" 200 None 2026-03-13 09:13:05,770 - lava_callback - ERROR - Error processing callback for node 69b1321fa870a1dc3343bf8e: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' 2026-03-13 09:13:05,780 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-13 09:13:05,782 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/ltp-smoke-69b3d0e71727ff69d6f22706/lava-logs.yaml 2026-03-13 09:13:05,810 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-13 09:13:06,041 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-13 09:13:06,043 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/ltp-smoke-69b3d0e71727ff69d6f22706/lava_callback.json.gz 2026-03-13 09:13:06,161 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 09:13:06,175 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b3d0e71727ff69d6f22706 HTTP/1.1" 200 None 2026-03-13 09:13:06,176 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 09:13:06,189 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b3c7ff1727ff69d6f21d8f HTTP/1.1" 200 None 2026-03-13 09:13:06,191 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 09:13:06,223 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b3d0e71727ff69d6f22706 HTTP/1.1" 200 None 2026-03-13 09:13:06,345 - lava_callback - INFO - Completed processing callback for node 69b3d0e71727ff69d6f22706 INFO: 172.21.0.1:60200 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36098 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:36100 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36104 - "GET / HTTP/1.0" 200 OK 2026-03-13 09:13:21,571 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 09:13:21,588 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:34008 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54952 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50904 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56684 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47236 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46514 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:46530 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46542 - "GET / HTTP/1.0" 200 OK 2026-03-13 09:14:25,788 - lava_callback - INFO - Received callback for node 69b1326ba870a1dc3343c333 INFO: 172.21.0.1:58750 - "POST /node/69b1326ba870a1dc3343c333 HTTP/1.0" 202 Accepted 2026-03-13 09:14:25,794 - lava_callback - INFO - Starting async job submit for node 69b1326ba870a1dc3343c333 2026-03-13 09:14:25,795 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 09:14:25,818 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b1326ba870a1dc3343c333 HTTP/1.1" 200 None 2026-03-13 09:14:25,819 - lava_callback - DEBUG - Processing node 69b1326ba870a1dc3343c333: baseline-arm64-clabbe 2026-03-13 09:14:25,819 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b1326ba870a1dc3343c333 2026-03-13 09:14:25,820 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 09:14:25,833 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b1326ba870a1dc3343c333 HTTP/1.1" 200 None 2026-03-13 09:14:25,835 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 09:14:25,847 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ae822fc660ead8a389ab0e HTTP/1.1" 200 None 2026-03-13 09:14:25,849 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 09:14:25,869 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b1326ba870a1dc3343c333 HTTP/1.1" 200 None 2026-03-13 09:14:25,878 - lava_callback - ERROR - Error processing callback for node 69b1326ba870a1dc3343c333: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:58754 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56998 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39354 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55266 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60836 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38736 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:38752 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38754 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51846 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43566 - "GET / HTTP/1.0" 200 OK 2026-03-13 09:15:45,841 - lava_callback - INFO - Received callback for node 69b132b6a870a1dc3343c345 INFO: 172.21.0.1:51356 - "POST /node/69b132b6a870a1dc3343c345 HTTP/1.0" 202 Accepted 2026-03-13 09:15:45,847 - lava_callback - INFO - Starting async job submit for node 69b132b6a870a1dc3343c345 2026-03-13 09:15:45,848 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 09:15:45,861 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b132b6a870a1dc3343c345 HTTP/1.1" 200 None 2026-03-13 09:15:45,862 - lava_callback - DEBUG - Processing node 69b132b6a870a1dc3343c345: baseline-arm64-clabbe 2026-03-13 09:15:45,862 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b132b6a870a1dc3343c345 2026-03-13 09:15:45,863 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 09:15:45,876 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b132b6a870a1dc3343c345 HTTP/1.1" 200 None 2026-03-13 09:15:45,877 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 09:15:45,890 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ae822fc660ead8a389ab0e HTTP/1.1" 200 None 2026-03-13 09:15:45,892 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 09:15:45,912 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b132b6a870a1dc3343c345 HTTP/1.1" 200 None 2026-03-13 09:15:45,913 - lava_callback - ERROR - Error processing callback for node 69b132b6a870a1dc3343c345: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:51362 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60464 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57036 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59374 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:59376 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59384 - "GET / HTTP/1.0" 200 OK 2026-03-13 09:16:18,581 - lava_callback - INFO - Received callback for node 69b3d5d51727ff69d6f2289b INFO: 172.21.0.1:59386 - "POST /node/69b3d5d51727ff69d6f2289b HTTP/1.0" 202 Accepted 2026-03-13 09:16:18,586 - lava_callback - INFO - Starting async job submit for node 69b3d5d51727ff69d6f2289b 2026-03-13 09:16:18,588 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 09:16:18,607 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b3d5d51727ff69d6f2289b HTTP/1.1" 200 None 2026-03-13 09:16:18,608 - lava_callback - DEBUG - Processing node 69b3d5d51727ff69d6f2289b: baseline-nfs-arm64 2026-03-13 09:16:18,609 - lava_callback - WARNING - Failed to upload log 2026-03-13 09:16:18,610 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-13 09:16:18,768 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-13 09:16:18,770 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69b3d5d51727ff69d6f2289b/lava-logs.yaml 2026-03-13 09:16:18,771 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-13 09:16:18,914 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-13 09:16:18,916 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69b3d5d51727ff69d6f2289b/lava_callback.json.gz 2026-03-13 09:16:18,918 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 09:16:18,939 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b3d5d51727ff69d6f2289b HTTP/1.1" 200 None 2026-03-13 09:16:18,940 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 09:16:18,957 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b3c8061727ff69d6f21d98 HTTP/1.1" 200 None 2026-03-13 09:16:18,958 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 09:16:18,979 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b3d5d51727ff69d6f2289b HTTP/1.1" 200 None 2026-03-13 09:16:18,987 - lava_callback - INFO - Completed processing callback for node 69b3d5d51727ff69d6f2289b 2026-03-13 09:16:21,590 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 09:16:21,607 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:53074 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41754 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39818 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55850 - "GET / HTTP/1.0" 200 OK 2026-03-13 09:17:05,925 - lava_callback - INFO - Received callback for node 69b13302a870a1dc3343c34e INFO: 172.21.0.1:35426 - "POST /node/69b13302a870a1dc3343c34e HTTP/1.0" 202 Accepted 2026-03-13 09:17:05,933 - lava_callback - INFO - Starting async job submit for node 69b13302a870a1dc3343c34e 2026-03-13 09:17:05,934 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 09:17:05,966 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b13302a870a1dc3343c34e HTTP/1.1" 200 None 2026-03-13 09:17:05,968 - lava_callback - DEBUG - Processing node 69b13302a870a1dc3343c34e: baseline-arm64-clabbe 2026-03-13 09:17:05,968 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b13302a870a1dc3343c34e 2026-03-13 09:17:05,969 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 09:17:06,034 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b13302a870a1dc3343c34e HTTP/1.1" 200 None 2026-03-13 09:17:06,037 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 09:17:06,069 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ae822fc660ead8a389ab0e HTTP/1.1" 200 None 2026-03-13 09:17:06,071 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 09:17:06,106 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b13302a870a1dc3343c34e HTTP/1.1" 200 None 2026-03-13 09:17:06,108 - lava_callback - ERROR - Error processing callback for node 69b13302a870a1dc3343c34e: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:35434 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35438 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:35440 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35446 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53556 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55068 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36986 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55604 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57974 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35570 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:35578 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35594 - "GET / HTTP/1.0" 200 OK 2026-03-13 09:18:25,955 - lava_callback - INFO - Received callback for node 69b1334da870a1dc3343c35e INFO: 172.21.0.1:49588 - "POST /node/69b1334da870a1dc3343c35e HTTP/1.0" 202 Accepted 2026-03-13 09:18:25,964 - lava_callback - INFO - Starting async job submit for node 69b1334da870a1dc3343c35e 2026-03-13 09:18:25,965 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 09:18:25,987 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b1334da870a1dc3343c35e HTTP/1.1" 200 None 2026-03-13 09:18:25,988 - lava_callback - DEBUG - Processing node 69b1334da870a1dc3343c35e: baseline-arm64-clabbe 2026-03-13 09:18:25,988 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b1334da870a1dc3343c35e 2026-03-13 09:18:25,989 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 09:18:26,019 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b1334da870a1dc3343c35e HTTP/1.1" 200 None 2026-03-13 09:18:26,021 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 09:18:26,040 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ae822fc660ead8a389ab0e HTTP/1.1" 200 None 2026-03-13 09:18:26,043 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 09:18:26,073 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b1334da870a1dc3343c35e HTTP/1.1" 200 None 2026-03-13 09:18:26,075 - lava_callback - ERROR - Error processing callback for node 69b1334da870a1dc3343c35e: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:49600 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53430 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51468 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44718 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59226 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57054 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:57066 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57076 - "GET / HTTP/1.0" 200 OK 2026-03-13 09:19:26,005 - lava_callback - INFO - Received callback for node 69b13399a870a1dc3343c384 INFO: 172.21.0.1:47758 - "POST /node/69b13399a870a1dc3343c384 HTTP/1.0" 202 Accepted 2026-03-13 09:19:26,021 - lava_callback - INFO - Starting async job submit for node 69b13399a870a1dc3343c384 2026-03-13 09:19:26,023 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 09:19:26,044 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b13399a870a1dc3343c384 HTTP/1.1" 200 None 2026-03-13 09:19:26,045 - lava_callback - DEBUG - Processing node 69b13399a870a1dc3343c384: baseline-arm64-clabbe 2026-03-13 09:19:26,046 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b13399a870a1dc3343c384 2026-03-13 09:19:26,046 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 09:19:26,063 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b13399a870a1dc3343c384 HTTP/1.1" 200 None 2026-03-13 09:19:26,065 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 09:19:26,079 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ae822fc660ead8a389ab0e HTTP/1.1" 200 None 2026-03-13 09:19:26,081 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 09:19:26,101 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b13399a870a1dc3343c384 HTTP/1.1" 200 None 2026-03-13 09:19:26,102 - lava_callback - ERROR - Error processing callback for node 69b13399a870a1dc3343c384: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:47766 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51882 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35764 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38302 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50634 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56952 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:56954 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56964 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51972 - "GET / HTTP/1.0" 200 OK 2026-03-13 09:20:34,450 - lava_callback - INFO - Received callback for node 69b133d1a870a1dc3343c3ab INFO: 172.21.0.1:55940 - "POST /node/69b133d1a870a1dc3343c3ab HTTP/1.0" 202 Accepted 2026-03-13 09:20:34,456 - lava_callback - INFO - Starting async job submit for node 69b133d1a870a1dc3343c3ab 2026-03-13 09:20:34,456 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 09:20:34,471 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b133d1a870a1dc3343c3ab HTTP/1.1" 200 None 2026-03-13 09:20:34,472 - lava_callback - DEBUG - Processing node 69b133d1a870a1dc3343c3ab: baseline-arm-baylibre 2026-03-13 09:20:34,472 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b133d1a870a1dc3343c3ab 2026-03-13 09:20:34,473 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 09:20:34,485 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b133d1a870a1dc3343c3ab HTTP/1.1" 200 None 2026-03-13 09:20:34,487 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 09:20:34,532 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a93c6a7ee78ae610caa67c HTTP/1.1" 200 None 2026-03-13 09:20:34,533 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 09:20:34,567 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b133d1a870a1dc3343c3ab HTTP/1.1" 200 None 2026-03-13 09:20:34,569 - lava_callback - ERROR - Error processing callback for node 69b133d1a870a1dc3343c3ab: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:55942 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53930 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54354 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39542 - "GET / HTTP/1.0" 200 OK 2026-03-13 09:21:14,068 - lava_callback - INFO - Received callback for node 69b133f7a870a1dc3343c3bf INFO: 172.21.0.1:52524 - "POST /node/69b133f7a870a1dc3343c3bf HTTP/1.0" 202 Accepted 2026-03-13 09:21:14,073 - lava_callback - INFO - Starting async job submit for node 69b133f7a870a1dc3343c3bf 2026-03-13 09:21:14,074 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 09:21:14,096 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b133f7a870a1dc3343c3bf HTTP/1.1" 200 None 2026-03-13 09:21:14,097 - lava_callback - DEBUG - Processing node 69b133f7a870a1dc3343c3bf: baseline-arm-baylibre 2026-03-13 09:21:14,097 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b133f7a870a1dc3343c3bf 2026-03-13 09:21:14,098 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 09:21:14,111 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b133f7a870a1dc3343c3bf HTTP/1.1" 200 None 2026-03-13 09:21:14,112 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 09:21:14,126 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a93c6a7ee78ae610caa67c HTTP/1.1" 200 None 2026-03-13 09:21:14,128 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 09:21:14,165 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b133f7a870a1dc3343c3bf HTTP/1.1" 200 None 2026-03-13 09:21:14,166 - lava_callback - ERROR - Error processing callback for node 69b133f7a870a1dc3343c3bf: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:52530 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:52534 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52544 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37168 - "GET / HTTP/1.0" 200 OK 2026-03-13 09:21:34,096 - lava_callback - INFO - Received callback for node 69b1341ba870a1dc3343c3cc INFO: 172.21.0.1:60014 - "POST /node/69b1341ba870a1dc3343c3cc HTTP/1.0" 202 Accepted 2026-03-13 09:21:34,102 - lava_callback - INFO - Starting async job submit for node 69b1341ba870a1dc3343c3cc 2026-03-13 09:21:34,103 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 09:21:34,120 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b1341ba870a1dc3343c3cc HTTP/1.1" 200 None 2026-03-13 09:21:34,121 - lava_callback - DEBUG - Processing node 69b1341ba870a1dc3343c3cc: baseline-arm-baylibre 2026-03-13 09:21:34,122 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b1341ba870a1dc3343c3cc 2026-03-13 09:21:34,122 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 09:21:34,136 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b1341ba870a1dc3343c3cc HTTP/1.1" 200 None 2026-03-13 09:21:34,137 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 09:21:34,156 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a93c6a7ee78ae610caa67c HTTP/1.1" 200 None 2026-03-13 09:21:34,157 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 09:21:34,177 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b1341ba870a1dc3343c3cc HTTP/1.1" 200 None 2026-03-13 09:21:34,182 - lava_callback - ERROR - Error processing callback for node 69b1341ba870a1dc3343c3cc: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:60028 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56098 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44732 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50686 - "GET / HTTP/1.0" 200 OK 2026-03-13 09:22:14,128 - lava_callback - INFO - Received callback for node 69b13440a870a1dc3343c3d9 INFO: 172.21.0.1:39056 - "POST /node/69b13440a870a1dc3343c3d9 HTTP/1.0" 202 Accepted 2026-03-13 09:22:14,133 - lava_callback - INFO - Starting async job submit for node 69b13440a870a1dc3343c3d9 2026-03-13 09:22:14,134 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 09:22:14,147 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b13440a870a1dc3343c3d9 HTTP/1.1" 200 None 2026-03-13 09:22:14,148 - lava_callback - DEBUG - Processing node 69b13440a870a1dc3343c3d9: baseline-arm-baylibre 2026-03-13 09:22:14,148 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b13440a870a1dc3343c3d9 2026-03-13 09:22:14,149 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 09:22:14,162 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b13440a870a1dc3343c3d9 HTTP/1.1" 200 None 2026-03-13 09:22:14,163 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 09:22:14,176 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a93c6a7ee78ae610caa67c HTTP/1.1" 200 None 2026-03-13 09:22:14,177 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 09:22:14,204 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b13440a870a1dc3343c3d9 HTTP/1.1" 200 None 2026-03-13 09:22:14,205 - lava_callback - ERROR - Error processing callback for node 69b13440a870a1dc3343c3d9: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:39062 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:39076 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39088 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39558 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51148 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42008 - "GET / HTTP/1.0" 200 OK 2026-03-13 09:22:54,162 - lava_callback - INFO - Received callback for node 69b13467a870a1dc3343c3e8 INFO: 172.21.0.1:47880 - "POST /node/69b13467a870a1dc3343c3e8 HTTP/1.0" 202 Accepted 2026-03-13 09:22:54,167 - lava_callback - INFO - Starting async job submit for node 69b13467a870a1dc3343c3e8 2026-03-13 09:22:54,168 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 09:22:54,183 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b13467a870a1dc3343c3e8 HTTP/1.1" 200 None 2026-03-13 09:22:54,184 - lava_callback - DEBUG - Processing node 69b13467a870a1dc3343c3e8: baseline-arm-baylibre 2026-03-13 09:22:54,184 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b13467a870a1dc3343c3e8 2026-03-13 09:22:54,185 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 09:22:54,198 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b13467a870a1dc3343c3e8 HTTP/1.1" 200 None 2026-03-13 09:22:54,200 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 09:22:54,220 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a93c6a7ee78ae610caa67c HTTP/1.1" 200 None 2026-03-13 09:22:54,222 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 09:22:54,243 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b13467a870a1dc3343c3e8 HTTP/1.1" 200 None 2026-03-13 09:22:54,252 - lava_callback - ERROR - Error processing callback for node 69b13467a870a1dc3343c3e8: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:47888 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55792 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42324 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:42334 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42340 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51530 - "GET / HTTP/1.0" 200 OK 2026-03-13 09:23:34,236 - lava_callback - INFO - Received callback for node 69b1348ca870a1dc3343c3f8 INFO: 172.21.0.1:47218 - "POST /node/69b1348ca870a1dc3343c3f8 HTTP/1.0" 202 Accepted 2026-03-13 09:23:34,241 - lava_callback - INFO - Starting async job submit for node 69b1348ca870a1dc3343c3f8 2026-03-13 09:23:34,242 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 09:23:34,258 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b1348ca870a1dc3343c3f8 HTTP/1.1" 200 None 2026-03-13 09:23:34,259 - lava_callback - DEBUG - Processing node 69b1348ca870a1dc3343c3f8: baseline-arm-baylibre 2026-03-13 09:23:34,259 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b1348ca870a1dc3343c3f8 2026-03-13 09:23:34,260 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 09:23:34,273 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b1348ca870a1dc3343c3f8 HTTP/1.1" 200 None 2026-03-13 09:23:34,275 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 09:23:34,288 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a93c6a7ee78ae610caa67c HTTP/1.1" 200 None 2026-03-13 09:23:34,289 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 09:23:34,314 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b1348ca870a1dc3343c3f8 HTTP/1.1" 200 None 2026-03-13 09:23:34,324 - lava_callback - ERROR - Error processing callback for node 69b1348ca870a1dc3343c3f8: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:47226 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54430 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48682 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41420 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51522 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:51536 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51542 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57388 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33342 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58406 - "GET / HTTP/1.0" 200 OK 2026-03-13 09:24:49,465 - lava_callback - INFO - Received callback for node 69b3d6251727ff69d6f228a7 INFO: 172.21.0.1:58414 - "POST /node/69b3d6251727ff69d6f228a7 HTTP/1.0" 202 Accepted 2026-03-13 09:24:49,472 - lava_callback - INFO - Starting async job submit for node 69b3d6251727ff69d6f228a7 2026-03-13 09:24:49,507 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 09:24:49,545 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b3d6251727ff69d6f228a7 HTTP/1.1" 200 None 2026-03-13 09:24:49,546 - lava_callback - DEBUG - Processing node 69b3d6251727ff69d6f228a7: baseline-arm64 2026-03-13 09:24:49,922 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-13 09:24:50,084 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-13 09:24:50,086 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-69b3d6251727ff69d6f228a7/log.txt.gz 2026-03-13 09:24:50,296 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-13 09:24:50,536 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-13 09:24:50,538 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69b3d6251727ff69d6f228a7/lava-logs.yaml 2026-03-13 09:24:50,547 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-13 09:24:50,722 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-13 09:24:50,724 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69b3d6251727ff69d6f228a7/lava_callback.json.gz DEBUG: Setup failed for 69b3d6251727ff69d6f228a7. Transitting job node result: incomplete -> fail 2026-03-13 09:24:50,798 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 09:24:50,812 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b3d6251727ff69d6f228a7 HTTP/1.1" 200 None 2026-03-13 09:24:50,814 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 09:24:50,827 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b3c8061727ff69d6f21d98 HTTP/1.1" 200 None 2026-03-13 09:24:50,828 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 09:24:50,856 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b3d6251727ff69d6f228a7 HTTP/1.1" 200 None 2026-03-13 09:24:50,951 - lava_callback - INFO - Completed processing callback for node 69b3d6251727ff69d6f228a7 2026-03-13 09:24:51,610 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 09:24:51,632 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:47858 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50368 - "GET / HTTP/1.0" 200 OK 2026-03-13 09:25:10,887 - lava_callback - INFO - Received callback for node 69b3d7c51727ff69d6f22913 INFO: 172.21.0.1:47356 - "POST /node/69b3d7c51727ff69d6f22913 HTTP/1.0" 202 Accepted 2026-03-13 09:25:10,894 - lava_callback - INFO - Starting async job submit for node 69b3d7c51727ff69d6f22913 2026-03-13 09:25:10,923 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 09:25:10,938 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b3d7c51727ff69d6f22913 HTTP/1.1" 200 None 2026-03-13 09:25:10,938 - lava_callback - DEBUG - Processing node 69b3d7c51727ff69d6f22913: baseline-arm64 2026-03-13 09:25:11,071 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-13 09:25:11,217 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-13 09:25:11,219 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-69b3d7c51727ff69d6f22913/log.txt.gz 2026-03-13 09:25:11,288 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-13 09:25:11,460 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-13 09:25:11,462 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69b3d7c51727ff69d6f22913/lava-logs.yaml 2026-03-13 09:25:11,465 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-13 09:25:11,599 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-13 09:25:11,601 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69b3d7c51727ff69d6f22913/lava_callback.json.gz 2026-03-13 09:25:11,631 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 09:25:11,645 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b3d7c51727ff69d6f22913 HTTP/1.1" 200 None 2026-03-13 09:25:11,646 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 09:25:11,667 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b3c8061727ff69d6f21d98 HTTP/1.1" 200 None 2026-03-13 09:25:11,668 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 09:25:11,690 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b3d7c51727ff69d6f22913 HTTP/1.1" 200 None 2026-03-13 09:25:11,814 - lava_callback - INFO - Completed processing callback for node 69b3d7c51727ff69d6f22913 INFO: 172.21.0.1:47366 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:47372 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47378 - "GET / HTTP/1.0" 200 OK 2026-03-13 09:25:21,635 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 09:25:21,650 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:35150 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40888 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49106 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51960 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33824 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58204 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:58216 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58232 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52890 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37050 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36634 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53028 - "GET / HTTP/1.0" 200 OK 2026-03-13 09:27:06,381 - lava_callback - INFO - Received callback for node 69b1355ca870a1dc3343c431 INFO: 172.21.0.1:39060 - "POST /node/69b1355ca870a1dc3343c431 HTTP/1.0" 202 Accepted 2026-03-13 09:27:06,387 - lava_callback - INFO - Starting async job submit for node 69b1355ca870a1dc3343c431 2026-03-13 09:27:06,388 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 09:27:06,402 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b1355ca870a1dc3343c431 HTTP/1.1" 200 None 2026-03-13 09:27:06,403 - lava_callback - DEBUG - Processing node 69b1355ca870a1dc3343c431: baseline-arm-clabbe 2026-03-13 09:27:06,403 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b1355ca870a1dc3343c431 2026-03-13 09:27:06,403 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 09:27:06,423 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b1355ca870a1dc3343c431 HTTP/1.1" 200 None 2026-03-13 09:27:06,424 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 09:27:06,437 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a93c6a7ee78ae610caa67c HTTP/1.1" 200 None 2026-03-13 09:27:06,439 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 09:27:06,480 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b1355ca870a1dc3343c431 HTTP/1.1" 200 None 2026-03-13 09:27:06,481 - lava_callback - ERROR - Error processing callback for node 69b1355ca870a1dc3343c431: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:39068 - "GET / HTTP/1.0" 200 OK 2026-03-13 09:27:10,927 - lava_callback - INFO - Received callback for node 69b3d8391727ff69d6f2292d INFO: 172.21.0.1:43788 - "POST /node/69b3d8391727ff69d6f2292d HTTP/1.0" 202 Accepted 2026-03-13 09:27:10,933 - lava_callback - INFO - Starting async job submit for node 69b3d8391727ff69d6f2292d 2026-03-13 09:27:10,961 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 09:27:10,976 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b3d8391727ff69d6f2292d HTTP/1.1" 200 None 2026-03-13 09:27:10,977 - lava_callback - DEBUG - Processing node 69b3d8391727ff69d6f2292d: baseline-arm64 2026-03-13 09:27:11,109 - lava_callback - WARNING - Failed to upload log 2026-03-13 09:27:11,177 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-13 09:27:11,393 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-13 09:27:11,394 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69b3d8391727ff69d6f2292d/lava-logs.yaml 2026-03-13 09:27:11,398 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-13 09:27:11,532 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-13 09:27:11,534 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69b3d8391727ff69d6f2292d/lava_callback.json.gz 2026-03-13 09:27:11,564 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 09:27:11,583 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b3d8391727ff69d6f2292d HTTP/1.1" 200 None 2026-03-13 09:27:11,585 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 09:27:11,599 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b3c8061727ff69d6f21d98 HTTP/1.1" 200 None 2026-03-13 09:27:11,601 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 09:27:11,643 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b3d8391727ff69d6f2292d HTTP/1.1" 200 None 2026-03-13 09:27:11,695 - lava_callback - INFO - Completed processing callback for node 69b3d8391727ff69d6f2292d INFO: 172.21.0.1:43800 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:43816 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43832 - "GET / HTTP/1.0" 200 OK 2026-03-13 09:27:21,653 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 09:27:21,672 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:54984 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41140 - "GET / HTTP/1.0" 200 OK 2026-03-13 09:27:46,400 - lava_callback - INFO - Received callback for node 69b13581a870a1dc3343c455 INFO: 172.21.0.1:54262 - "POST /node/69b13581a870a1dc3343c455 HTTP/1.0" 202 Accepted 2026-03-13 09:27:46,405 - lava_callback - INFO - Starting async job submit for node 69b13581a870a1dc3343c455 2026-03-13 09:27:46,406 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 09:27:46,421 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b13581a870a1dc3343c455 HTTP/1.1" 200 None 2026-03-13 09:27:46,422 - lava_callback - DEBUG - Processing node 69b13581a870a1dc3343c455: baseline-arm-clabbe 2026-03-13 09:27:46,422 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b13581a870a1dc3343c455 2026-03-13 09:27:46,423 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 09:27:46,436 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b13581a870a1dc3343c455 HTTP/1.1" 200 None 2026-03-13 09:27:46,437 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 09:27:46,459 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a93c6a7ee78ae610caa67c HTTP/1.1" 200 None 2026-03-13 09:27:46,461 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 09:27:46,481 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b13581a870a1dc3343c455 HTTP/1.1" 200 None 2026-03-13 09:27:46,482 - lava_callback - ERROR - Error processing callback for node 69b13581a870a1dc3343c455: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:54266 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37948 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49410 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54402 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:54406 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54416 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54992 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59892 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38098 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34430 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43708 - "GET / HTTP/1.0" 200 OK 2026-03-13 09:29:14,176 - lava_callback - INFO - Received callback for node 69b3d4ac1727ff69d6f22835 INFO: 172.21.0.1:59234 - "POST /node/69b3d4ac1727ff69d6f22835 HTTP/1.0" 202 Accepted 2026-03-13 09:29:14,183 - lava_callback - INFO - Starting async job submit for node 69b3d4ac1727ff69d6f22835 2026-03-13 09:29:14,236 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 09:29:14,250 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b3d4ac1727ff69d6f22835 HTTP/1.1" 200 None 2026-03-13 09:29:14,251 - lava_callback - DEBUG - Processing node 69b3d4ac1727ff69d6f22835: baseline-arm 2026-03-13 09:29:14,852 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-13 09:29:15,016 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-13 09:29:15,018 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-69b3d4ac1727ff69d6f22835/log.txt.gz INFO: 172.21.0.1:59244 - "GET /api/metrics HTTP/1.0" 200 OK 2026-03-13 09:29:15,361 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-13 09:29:15,617 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-13 09:29:15,619 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm-69b3d4ac1727ff69d6f22835/lava-logs.yaml 2026-03-13 09:29:15,633 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-13 09:29:15,788 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-13 09:29:15,790 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-69b3d4ac1727ff69d6f22835/lava_callback.json.gz DEBUG: Setup failed for 69b3d4ac1727ff69d6f22835. Transitting job node result: incomplete -> fail 2026-03-13 09:29:15,897 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 09:29:15,928 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b3d4ac1727ff69d6f22835 HTTP/1.1" 200 None 2026-03-13 09:29:15,930 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 09:29:15,944 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b3c7f91727ff69d6f21d89 HTTP/1.1" 200 None 2026-03-13 09:29:15,945 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 INFO: 172.21.0.1:59258 - "GET / HTTP/1.0" 200 OK 2026-03-13 09:29:15,970 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b3d4ac1727ff69d6f22835 HTTP/1.1" 200 None 2026-03-13 09:29:16,093 - lava_callback - INFO - Completed processing callback for node 69b3d4ac1727ff69d6f22835 INFO: 172.21.0.1:59262 - "GET / HTTP/1.0" 200 OK 2026-03-13 09:29:21,674 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 09:29:21,689 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:60782 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39212 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39914 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45464 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37000 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40554 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:40568 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40570 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33160 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34622 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35936 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55458 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39314 - "GET / HTTP/1.0" 200 OK 2026-03-13 09:31:14,746 - lava_callback - INFO - Received callback for node 69b1364fa870a1dc3343c499 INFO: 172.21.0.1:38086 - "POST /node/69b1364fa870a1dc3343c499 HTTP/1.0" 202 Accepted 2026-03-13 09:31:14,752 - lava_callback - INFO - Starting async job submit for node 69b1364fa870a1dc3343c499 2026-03-13 09:31:14,753 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 09:31:14,766 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b1364fa870a1dc3343c499 HTTP/1.1" 200 None 2026-03-13 09:31:14,767 - lava_callback - DEBUG - Processing node 69b1364fa870a1dc3343c499: baseline-arm64-baylibre 2026-03-13 09:31:14,767 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b1364fa870a1dc3343c499 2026-03-13 09:31:14,768 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 09:31:14,781 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b1364fa870a1dc3343c499 HTTP/1.1" 200 None 2026-03-13 09:31:14,782 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 09:31:14,801 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69abdf3340deb775998f3bb5 HTTP/1.1" 200 None 2026-03-13 09:31:14,802 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 09:31:14,822 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b1364fa870a1dc3343c499 HTTP/1.1" 200 None 2026-03-13 09:31:14,827 - lava_callback - ERROR - Error processing callback for node 69b1364fa870a1dc3343c499: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:38102 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:38114 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38124 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47040 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59840 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57996 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57256 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43628 - "GET / HTTP/1.0" 200 OK 2026-03-13 09:32:14,633 - lava_callback - INFO - Received callback for node 69b13699a870a1dc3343c4ab INFO: 172.21.0.1:57576 - "POST /node/69b13699a870a1dc3343c4ab HTTP/1.0" 202 Accepted 2026-03-13 09:32:14,638 - lava_callback - INFO - Starting async job submit for node 69b13699a870a1dc3343c4ab 2026-03-13 09:32:14,639 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 09:32:14,653 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b13699a870a1dc3343c4ab HTTP/1.1" 200 None 2026-03-13 09:32:14,654 - lava_callback - DEBUG - Processing node 69b13699a870a1dc3343c4ab: baseline-arm64-baylibre 2026-03-13 09:32:14,654 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b13699a870a1dc3343c4ab 2026-03-13 09:32:14,655 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 09:32:14,669 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b13699a870a1dc3343c4ab HTTP/1.1" 200 None 2026-03-13 09:32:14,670 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 09:32:14,688 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69abdf3340deb775998f3bb5 HTTP/1.1" 200 None 2026-03-13 09:32:14,690 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 09:32:14,711 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b13699a870a1dc3343c4ab HTTP/1.1" 200 None 2026-03-13 09:32:14,717 - lava_callback - ERROR - Error processing callback for node 69b13699a870a1dc3343c4ab: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:57584 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:57596 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57598 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47582 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37852 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35820 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56376 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49148 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44678 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:44694 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44702 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48570 - "GET / HTTP/1.0" 200 OK 2026-03-13 09:33:34,745 - lava_callback - INFO - Received callback for node 69b136e7a870a1dc3343c4ba INFO: 172.21.0.1:40066 - "POST /node/69b136e7a870a1dc3343c4ba HTTP/1.0" 202 Accepted 2026-03-13 09:33:34,750 - lava_callback - INFO - Starting async job submit for node 69b136e7a870a1dc3343c4ba 2026-03-13 09:33:34,751 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 09:33:34,765 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b136e7a870a1dc3343c4ba HTTP/1.1" 200 None 2026-03-13 09:33:34,766 - lava_callback - DEBUG - Processing node 69b136e7a870a1dc3343c4ba: baseline-arm64-baylibre 2026-03-13 09:33:34,766 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b136e7a870a1dc3343c4ba 2026-03-13 09:33:34,767 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 09:33:34,779 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b136e7a870a1dc3343c4ba HTTP/1.1" 200 None 2026-03-13 09:33:34,781 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 09:33:34,793 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69abdf3340deb775998f3bb5 HTTP/1.1" 200 None 2026-03-13 09:33:34,795 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 09:33:34,819 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b136e7a870a1dc3343c4ba HTTP/1.1" 200 None 2026-03-13 09:33:34,820 - lava_callback - ERROR - Error processing callback for node 69b136e7a870a1dc3343c4ba: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:40074 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36152 - "GET / HTTP/1.0" 200 OK 2026-03-13 09:33:48,049 - lava_callback - INFO - Received callback for node 69b3d56b1727ff69d6f22879 INFO: 172.21.0.1:36160 - "POST /node/69b3d56b1727ff69d6f22879 HTTP/1.0" 202 Accepted 2026-03-13 09:33:48,101 - lava_callback - INFO - Starting async job submit for node 69b3d56b1727ff69d6f22879 2026-03-13 09:33:48,125 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 09:33:48,140 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b3d56b1727ff69d6f22879 HTTP/1.1" 200 None 2026-03-13 09:33:48,141 - lava_callback - DEBUG - Processing node 69b3d56b1727ff69d6f22879: baseline-arm-pengutronix 2026-03-13 09:33:48,252 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-13 09:33:48,412 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-13 09:33:48,414 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-pengutronix-69b3d56b1727ff69d6f22879/log.txt.gz 2026-03-13 09:33:48,472 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-13 09:33:48,655 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-13 09:33:48,657 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm-pengutronix-69b3d56b1727ff69d6f22879/lava-logs.yaml 2026-03-13 09:33:48,660 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-13 09:33:48,796 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-13 09:33:48,798 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-pengutronix-69b3d56b1727ff69d6f22879/lava_callback.json.gz DEBUG: Setup failed for 69b3d56b1727ff69d6f22879. Transitting job node result: incomplete -> fail 2026-03-13 09:33:48,848 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 09:33:48,861 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b3d56b1727ff69d6f22879 HTTP/1.1" 200 None 2026-03-13 09:33:48,863 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 09:33:48,883 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b3c7f91727ff69d6f21d89 HTTP/1.1" 200 None 2026-03-13 09:33:48,885 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 09:33:48,911 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b3d56b1727ff69d6f22879 HTTP/1.1" 200 None 2026-03-13 09:33:48,978 - lava_callback - INFO - Completed processing callback for node 69b3d56b1727ff69d6f22879 2026-03-13 09:33:49,131 - lava_callback - INFO - Received callback for node 69b3d8f91727ff69d6f22951 INFO: 172.21.0.1:36174 - "POST /node/69b3d8f91727ff69d6f22951 HTTP/1.0" 202 Accepted 2026-03-13 09:33:49,138 - lava_callback - INFO - Starting async job submit for node 69b3d8f91727ff69d6f22951 2026-03-13 09:33:49,164 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 09:33:49,180 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b3d8f91727ff69d6f22951 HTTP/1.1" 200 None 2026-03-13 09:33:49,180 - lava_callback - DEBUG - Processing node 69b3d8f91727ff69d6f22951: ltp-pty 2026-03-13 09:33:49,547 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-13 09:33:49,706 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-13 09:33:49,708 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/ltp-pty-69b3d8f91727ff69d6f22951/log.txt.gz 2026-03-13 09:33:49,917 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-13 09:33:50,156 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-13 09:33:50,158 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/ltp-pty-69b3d8f91727ff69d6f22951/lava-logs.yaml 2026-03-13 09:33:50,167 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-13 09:33:50,321 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-13 09:33:50,323 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/ltp-pty-69b3d8f91727ff69d6f22951/lava_callback.json.gz 2026-03-13 09:33:50,348 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 09:33:50,363 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b3d8f91727ff69d6f22951 HTTP/1.1" 200 None 2026-03-13 09:33:50,364 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 09:33:50,378 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b3c7f91727ff69d6f21d89 HTTP/1.1" 200 None 2026-03-13 09:33:50,379 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 09:33:50,405 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b3d8f91727ff69d6f22951 HTTP/1.1" 200 None 2026-03-13 09:33:50,406 - lava_callback - INFO - Completed processing callback for node 69b3d8f91727ff69d6f22951 2026-03-13 09:33:51,692 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 09:33:51,709 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:56982 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47276 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57304 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:57312 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57328 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40396 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43786 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53528 - "GET / HTTP/1.0" 200 OK 2026-03-13 09:34:54,774 - lava_callback - INFO - Received callback for node 69b13733a870a1dc3343c4d0 INFO: 172.21.0.1:40620 - "POST /node/69b13733a870a1dc3343c4d0 HTTP/1.0" 202 Accepted 2026-03-13 09:34:54,779 - lava_callback - INFO - Starting async job submit for node 69b13733a870a1dc3343c4d0 2026-03-13 09:34:54,780 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 09:34:54,795 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b13733a870a1dc3343c4d0 HTTP/1.1" 200 None 2026-03-13 09:34:54,796 - lava_callback - DEBUG - Processing node 69b13733a870a1dc3343c4d0: baseline-arm64-baylibre 2026-03-13 09:34:54,796 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b13733a870a1dc3343c4d0 2026-03-13 09:34:54,796 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 09:34:54,811 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b13733a870a1dc3343c4d0 HTTP/1.1" 200 None 2026-03-13 09:34:54,813 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 09:34:54,826 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69abdf3340deb775998f3bb5 HTTP/1.1" 200 None 2026-03-13 09:34:54,827 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 09:34:54,848 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b13733a870a1dc3343c4d0 HTTP/1.1" 200 None 2026-03-13 09:34:54,860 - lava_callback - ERROR - Error processing callback for node 69b13733a870a1dc3343c4d0: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:40628 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53126 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40804 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:40814 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40818 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40464 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41252 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54252 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46100 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53478 - "GET / HTTP/1.0" 200 OK 2026-03-13 09:36:14,945 - lava_callback - INFO - Received callback for node 69b1377da870a1dc3343c4e6 INFO: 172.21.0.1:48316 - "POST /node/69b1377da870a1dc3343c4e6 HTTP/1.0" 202 Accepted 2026-03-13 09:36:14,951 - lava_callback - INFO - Starting async job submit for node 69b1377da870a1dc3343c4e6 2026-03-13 09:36:14,952 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 09:36:14,965 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b1377da870a1dc3343c4e6 HTTP/1.1" 200 None 2026-03-13 09:36:14,965 - lava_callback - DEBUG - Processing node 69b1377da870a1dc3343c4e6: baseline-arm64-baylibre 2026-03-13 09:36:14,966 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b1377da870a1dc3343c4e6 2026-03-13 09:36:14,966 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 09:36:14,979 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b1377da870a1dc3343c4e6 HTTP/1.1" 200 None 2026-03-13 09:36:14,980 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 09:36:14,993 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69abdf3340deb775998f3bb5 HTTP/1.1" 200 None 2026-03-13 09:36:14,994 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 09:36:15,016 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b1377da870a1dc3343c4e6 HTTP/1.1" 200 None 2026-03-13 09:36:15,025 - lava_callback - ERROR - Error processing callback for node 69b1377da870a1dc3343c4e6: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:48324 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:48330 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48334 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43022 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34952 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38312 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49670 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48928 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36516 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:36530 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36540 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42024 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51866 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53890 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50968 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37024 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39758 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:39762 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39778 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60268 - "GET / HTTP/1.0" 200 OK 2026-03-13 09:38:34,951 - lava_callback - INFO - Received callback for node 69b13808a870a1dc3343c500 INFO: 172.21.0.1:43606 - "POST /node/69b13808a870a1dc3343c500 HTTP/1.0" 202 Accepted 2026-03-13 09:38:34,957 - lava_callback - INFO - Starting async job submit for node 69b13808a870a1dc3343c500 2026-03-13 09:38:34,958 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 09:38:34,979 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b13808a870a1dc3343c500 HTTP/1.1" 200 None 2026-03-13 09:38:34,980 - lava_callback - DEBUG - Processing node 69b13808a870a1dc3343c500: baseline-arm64-baylibre 2026-03-13 09:38:34,980 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b13808a870a1dc3343c500 2026-03-13 09:38:34,980 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 09:38:34,994 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b13808a870a1dc3343c500 HTTP/1.1" 200 None 2026-03-13 09:38:34,995 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 09:38:35,009 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69abdf3340deb775998f3bb5 HTTP/1.1" 200 None 2026-03-13 09:38:35,010 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 09:38:35,030 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b13808a870a1dc3343c500 HTTP/1.1" 200 None 2026-03-13 09:38:35,032 - lava_callback - ERROR - Error processing callback for node 69b13808a870a1dc3343c500: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:43610 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37596 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43016 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51110 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37380 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:37396 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37406 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49070 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53142 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34266 - "GET / HTTP/1.0" 200 OK 2026-03-13 09:39:47,005 - lava_callback - INFO - Received callback for node 69b13859a870a1dc3343c514 INFO: 172.21.0.1:34276 - "POST /node/69b13859a870a1dc3343c514 HTTP/1.0" 202 Accepted 2026-03-13 09:39:47,010 - lava_callback - INFO - Starting async job submit for node 69b13859a870a1dc3343c514 2026-03-13 09:39:47,011 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 09:39:47,040 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b13859a870a1dc3343c514 HTTP/1.1" 200 None 2026-03-13 09:39:47,041 - lava_callback - DEBUG - Processing node 69b13859a870a1dc3343c514: baseline-arm64-clabbe 2026-03-13 09:39:47,041 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b13859a870a1dc3343c514 2026-03-13 09:39:47,042 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 09:39:47,058 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b13859a870a1dc3343c514 HTTP/1.1" 200 None 2026-03-13 09:39:47,060 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 09:39:47,074 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69abdf3340deb775998f3bb5 HTTP/1.1" 200 None 2026-03-13 09:39:47,075 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 09:39:47,097 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b13859a870a1dc3343c514 HTTP/1.1" 200 None 2026-03-13 09:39:47,098 - lava_callback - ERROR - Error processing callback for node 69b13859a870a1dc3343c514: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:51268 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33626 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38128 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:38132 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38146 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54748 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58708 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59582 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43430 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41152 - "GET / HTTP/1.0" 200 OK 2026-03-13 09:41:06,989 - lava_callback - INFO - Received callback for node 69b138a4a870a1dc3343c526 INFO: 172.21.0.1:41166 - "POST /node/69b138a4a870a1dc3343c526 HTTP/1.0" 202 Accepted 2026-03-13 09:41:06,998 - lava_callback - INFO - Starting async job submit for node 69b138a4a870a1dc3343c526 2026-03-13 09:41:06,999 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 09:41:07,016 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b138a4a870a1dc3343c526 HTTP/1.1" 200 None 2026-03-13 09:41:07,017 - lava_callback - DEBUG - Processing node 69b138a4a870a1dc3343c526: baseline-arm64-clabbe 2026-03-13 09:41:07,017 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b138a4a870a1dc3343c526 2026-03-13 09:41:07,018 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 09:41:07,032 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b138a4a870a1dc3343c526 HTTP/1.1" 200 None 2026-03-13 09:41:07,034 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 09:41:07,051 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69abdf3340deb775998f3bb5 HTTP/1.1" 200 None 2026-03-13 09:41:07,052 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 09:41:07,088 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b138a4a870a1dc3343c526 HTTP/1.1" 200 None 2026-03-13 09:41:07,090 - lava_callback - ERROR - Error processing callback for node 69b138a4a870a1dc3343c526: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:56554 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:56568 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56582 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50252 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51562 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53752 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49562 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36182 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36830 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:36832 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36834 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47950 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59400 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60724 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45034 - "GET / HTTP/1.0" 200 OK 2026-03-13 09:43:02,884 - lava_callback - INFO - Received callback for node 69b3dc131727ff69d6f229d2 INFO: 172.21.0.1:60372 - "POST /node/69b3dc131727ff69d6f229d2 HTTP/1.0" 202 Accepted 2026-03-13 09:43:02,889 - lava_callback - INFO - Starting async job submit for node 69b3dc131727ff69d6f229d2 2026-03-13 09:43:02,891 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 09:43:02,912 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b3dc131727ff69d6f229d2 HTTP/1.1" 200 None 2026-03-13 09:43:02,913 - lava_callback - DEBUG - Processing node 69b3dc131727ff69d6f229d2: baseline-nfs-arm64 2026-03-13 09:43:02,914 - lava_callback - WARNING - Failed to upload log 2026-03-13 09:43:02,916 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-13 09:43:03,113 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-13 09:43:03,115 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69b3dc131727ff69d6f229d2/lava-logs.yaml 2026-03-13 09:43:03,117 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-13 09:43:03,241 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-13 09:43:03,243 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69b3dc131727ff69d6f229d2/lava_callback.json.gz 2026-03-13 09:43:03,245 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 09:43:03,270 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b3dc131727ff69d6f229d2 HTTP/1.1" 200 None 2026-03-13 09:43:03,272 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 09:43:03,285 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b3c8061727ff69d6f21d98 HTTP/1.1" 200 None 2026-03-13 09:43:03,286 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 09:43:03,307 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b3dc131727ff69d6f229d2 HTTP/1.1" 200 None 2026-03-13 09:43:03,314 - lava_callback - INFO - Completed processing callback for node 69b3dc131727ff69d6f229d2 INFO: 172.21.0.1:60374 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49686 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:49692 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49704 - "GET / HTTP/1.0" 200 OK 2026-03-13 09:43:21,713 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 09:43:21,729 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:50362 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40420 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40998 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49100 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34992 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52248 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:52252 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52260 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48738 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39206 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51188 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45516 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54488 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42182 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:42198 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42204 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41106 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47122 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43288 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58648 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37236 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46148 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:46154 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46170 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48234 - "GET / HTTP/1.0" 200 OK 2026-03-13 09:46:35,516 - lava_callback - INFO - Received callback for node 69b139f9a870a1dc3343c55d INFO: 172.21.0.1:54874 - "POST /node/69b139f9a870a1dc3343c55d HTTP/1.0" 202 Accepted 2026-03-13 09:46:35,522 - lava_callback - INFO - Starting async job submit for node 69b139f9a870a1dc3343c55d 2026-03-13 09:46:35,522 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 09:46:35,536 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b139f9a870a1dc3343c55d HTTP/1.1" 200 None 2026-03-13 09:46:35,537 - lava_callback - DEBUG - Processing node 69b139f9a870a1dc3343c55d: baseline-arm64-baylibre 2026-03-13 09:46:35,537 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b139f9a870a1dc3343c55d 2026-03-13 09:46:35,538 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 09:46:35,553 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b139f9a870a1dc3343c55d HTTP/1.1" 200 None 2026-03-13 09:46:35,554 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 09:46:35,572 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a93c777ee78ae610caa696 HTTP/1.1" 200 None 2026-03-13 09:46:35,574 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 09:46:35,599 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b139f9a870a1dc3343c55d HTTP/1.1" 200 None 2026-03-13 09:46:35,601 - lava_callback - ERROR - Error processing callback for node 69b139f9a870a1dc3343c55d: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:54876 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:32844 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40554 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36344 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49572 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:49578 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49580 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38412 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41576 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52484 - "GET / HTTP/1.0" 200 OK 2026-03-13 09:47:55,518 - lava_callback - INFO - Received callback for node 69b13a43a870a1dc3343c56a INFO: 172.21.0.1:50890 - "POST /node/69b13a43a870a1dc3343c56a HTTP/1.0" 202 Accepted 2026-03-13 09:47:55,524 - lava_callback - INFO - Starting async job submit for node 69b13a43a870a1dc3343c56a 2026-03-13 09:47:55,525 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 09:47:55,539 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b13a43a870a1dc3343c56a HTTP/1.1" 200 None 2026-03-13 09:47:55,540 - lava_callback - DEBUG - Processing node 69b13a43a870a1dc3343c56a: baseline-arm64-baylibre 2026-03-13 09:47:55,541 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b13a43a870a1dc3343c56a 2026-03-13 09:47:55,541 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 09:47:55,572 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b13a43a870a1dc3343c56a HTTP/1.1" 200 None 2026-03-13 09:47:55,574 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 09:47:55,587 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a93c777ee78ae610caa696 HTTP/1.1" 200 None 2026-03-13 09:47:55,588 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 09:47:55,615 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b13a43a870a1dc3343c56a HTTP/1.1" 200 None 2026-03-13 09:47:55,621 - lava_callback - ERROR - Error processing callback for node 69b13a43a870a1dc3343c56a: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:50898 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58250 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48616 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:48626 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48636 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57266 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49352 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60992 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45050 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47736 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51246 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:51248 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51254 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49234 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41976 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55474 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49692 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36904 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34888 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:34904 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34912 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37698 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36630 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:32964 - "GET / HTTP/1.0" 200 OK 2026-03-13 09:50:55,725 - lava_callback - INFO - Received callback for node 69b13aeea870a1dc3343c591 INFO: 172.21.0.1:32928 - "POST /node/69b13aeea870a1dc3343c591 HTTP/1.0" 202 Accepted 2026-03-13 09:50:55,731 - lava_callback - INFO - Starting async job submit for node 69b13aeea870a1dc3343c591 2026-03-13 09:50:55,732 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 09:50:55,746 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b13aeea870a1dc3343c591 HTTP/1.1" 200 None 2026-03-13 09:50:55,747 - lava_callback - DEBUG - Processing node 69b13aeea870a1dc3343c591: baseline-arm64-baylibre 2026-03-13 09:50:55,748 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b13aeea870a1dc3343c591 2026-03-13 09:50:55,748 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 09:50:55,761 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b13aeea870a1dc3343c591 HTTP/1.1" 200 None 2026-03-13 09:50:55,763 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 09:50:55,776 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a93c777ee78ae610caa696 HTTP/1.1" 200 None 2026-03-13 09:50:55,777 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 09:50:55,798 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b13aeea870a1dc3343c591 HTTP/1.1" 200 None 2026-03-13 09:50:55,804 - lava_callback - ERROR - Error processing callback for node 69b13aeea870a1dc3343c591: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:32938 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38192 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44346 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:44354 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44358 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60660 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47808 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46970 - "GET / HTTP/1.0" 200 OK 2026-03-13 09:51:48,442 - lava_callback - INFO - Received callback for node 69b3ddf81727ff69d6f22a05 INFO: 172.21.0.1:46980 - "POST /node/69b3ddf81727ff69d6f22a05 HTTP/1.0" 202 Accepted 2026-03-13 09:51:48,449 - lava_callback - INFO - Starting async job submit for node 69b3ddf81727ff69d6f22a05 2026-03-13 09:51:48,478 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 09:51:48,493 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b3ddf81727ff69d6f22a05 HTTP/1.1" 200 None 2026-03-13 09:51:48,494 - lava_callback - DEBUG - Processing node 69b3ddf81727ff69d6f22a05: baseline-arm64 2026-03-13 09:51:48,630 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-13 09:51:48,806 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-13 09:51:48,808 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-69b3ddf81727ff69d6f22a05/log.txt.gz 2026-03-13 09:51:48,880 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-13 09:51:49,099 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-13 09:51:49,101 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69b3ddf81727ff69d6f22a05/lava-logs.yaml 2026-03-13 09:51:49,105 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-13 09:51:49,250 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-13 09:51:49,252 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69b3ddf81727ff69d6f22a05/lava_callback.json.gz 2026-03-13 09:51:49,281 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 09:51:49,296 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b3ddf81727ff69d6f22a05 HTTP/1.1" 200 None 2026-03-13 09:51:49,298 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 09:51:49,312 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b3c8061727ff69d6f21d98 HTTP/1.1" 200 None 2026-03-13 09:51:49,314 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 09:51:49,334 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b3ddf81727ff69d6f22a05 HTTP/1.1" 200 None 2026-03-13 09:51:49,400 - lava_callback - INFO - Completed processing callback for node 69b3ddf81727ff69d6f22a05 2026-03-13 09:51:51,732 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 09:51:51,749 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:47056 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42022 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53440 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:53448 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53454 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60780 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51262 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48334 - "GET / HTTP/1.0" 200 OK 2026-03-13 09:52:55,868 - lava_callback - INFO - Received callback for node 69b13b66a870a1dc3343c59e INFO: 172.21.0.1:57140 - "POST /node/69b13b66a870a1dc3343c59e HTTP/1.0" 202 Accepted 2026-03-13 09:52:55,874 - lava_callback - INFO - Starting async job submit for node 69b13b66a870a1dc3343c59e 2026-03-13 09:52:55,875 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 09:52:55,901 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b13b66a870a1dc3343c59e HTTP/1.1" 200 None 2026-03-13 09:52:55,902 - lava_callback - DEBUG - Processing node 69b13b66a870a1dc3343c59e: baseline-arm64-baylibre 2026-03-13 09:52:55,902 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b13b66a870a1dc3343c59e 2026-03-13 09:52:55,903 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 09:52:55,918 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b13b66a870a1dc3343c59e HTTP/1.1" 200 None 2026-03-13 09:52:55,920 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 09:52:55,935 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a93c777ee78ae610caa696 HTTP/1.1" 200 None 2026-03-13 09:52:55,936 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 09:52:55,958 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b13b66a870a1dc3343c59e HTTP/1.1" 200 None 2026-03-13 09:52:55,962 - lava_callback - ERROR - Error processing callback for node 69b13b66a870a1dc3343c59e: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:57154 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40038 - "GET / HTTP/1.0" 200 OK 2026-03-13 09:53:11,881 - lava_callback - INFO - Received callback for node 69b3de4a1727ff69d6f22a12 INFO: 172.21.0.1:55340 - "POST /node/69b3de4a1727ff69d6f22a12 HTTP/1.0" 202 Accepted 2026-03-13 09:53:11,892 - lava_callback - INFO - Starting async job submit for node 69b3de4a1727ff69d6f22a12 2026-03-13 09:53:11,923 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 09:53:11,938 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b3de4a1727ff69d6f22a12 HTTP/1.1" 200 None 2026-03-13 09:53:11,939 - lava_callback - DEBUG - Processing node 69b3de4a1727ff69d6f22a12: baseline-arm64 2026-03-13 09:53:12,080 - lava_callback - WARNING - Failed to upload log 2026-03-13 09:53:12,149 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-13 09:53:12,359 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-13 09:53:12,361 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69b3de4a1727ff69d6f22a12/lava-logs.yaml 2026-03-13 09:53:12,364 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-13 09:53:12,511 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-13 09:53:12,512 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69b3de4a1727ff69d6f22a12/lava_callback.json.gz 2026-03-13 09:53:12,542 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 09:53:12,556 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b3de4a1727ff69d6f22a12 HTTP/1.1" 200 None 2026-03-13 09:53:12,557 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 09:53:12,570 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b3c8061727ff69d6f21d98 HTTP/1.1" 200 None 2026-03-13 09:53:12,572 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 09:53:12,598 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b3de4a1727ff69d6f22a12 HTTP/1.1" 200 None 2026-03-13 09:53:12,671 - lava_callback - INFO - Completed processing callback for node 69b3de4a1727ff69d6f22a12 INFO: 172.21.0.1:55354 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:55362 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55370 - "GET / HTTP/1.0" 200 OK 2026-03-13 09:53:21,751 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 09:53:21,767 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:35794 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58812 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34582 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49568 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54274 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41590 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:41596 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41610 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58494 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49598 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33008 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49826 - "GET / HTTP/1.0" 200 OK 2026-03-13 09:55:02,510 - lava_callback - INFO - Received callback for node 69b3da4c1727ff69d6f2298f INFO: 172.21.0.1:48478 - "POST /node/69b3da4c1727ff69d6f2298f HTTP/1.0" 202 Accepted 2026-03-13 09:55:02,522 - lava_callback - INFO - Starting async job submit for node 69b3da4c1727ff69d6f2298f 2026-03-13 09:55:02,589 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 09:55:02,627 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b3da4c1727ff69d6f2298f HTTP/1.1" 200 None 2026-03-13 09:55:02,628 - lava_callback - DEBUG - Processing node 69b3da4c1727ff69d6f2298f: baseline-nfs-arm64 2026-03-13 09:55:03,966 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-13 09:55:04,177 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-13 09:55:04,178 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69b3da4c1727ff69d6f2298f/log.txt.gz 2026-03-13 09:55:04,934 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-13 09:55:05,287 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-13 09:55:05,290 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69b3da4c1727ff69d6f2298f/lava-logs.yaml 2026-03-13 09:55:05,312 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-13 09:55:05,511 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-13 09:55:05,513 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69b3da4c1727ff69d6f2298f/lava_callback.json.gz DEBUG: Setup failed for 69b3da4c1727ff69d6f2298f. Transitting job node result: incomplete -> fail 2026-03-13 09:55:05,632 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 09:55:05,653 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b3da4c1727ff69d6f2298f HTTP/1.1" 200 None 2026-03-13 09:55:05,654 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 09:55:05,670 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b3c8061727ff69d6f21d98 HTTP/1.1" 200 None 2026-03-13 09:55:05,673 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 09:55:05,700 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b3da4c1727ff69d6f2298f HTTP/1.1" 200 None 2026-03-13 09:55:05,823 - lava_callback - INFO - Completed processing callback for node 69b3da4c1727ff69d6f2298f INFO: 172.21.0.1:48492 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50906 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:50912 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50926 - "GET / HTTP/1.0" 200 OK 2026-03-13 09:55:21,770 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 09:55:21,787 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:38374 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56984 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56196 - "GET / HTTP/1.0" 200 OK 2026-03-13 09:55:47,636 - lava_callback - INFO - Received callback for node 69b13c0fa870a1dc3343c5a8 INFO: 172.21.0.1:56202 - "POST /node/69b13c0fa870a1dc3343c5a8 HTTP/1.0" 202 Accepted 2026-03-13 09:55:47,641 - lava_callback - INFO - Starting async job submit for node 69b13c0fa870a1dc3343c5a8 2026-03-13 09:55:47,642 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 09:55:47,657 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b13c0fa870a1dc3343c5a8 HTTP/1.1" 200 None 2026-03-13 09:55:47,658 - lava_callback - DEBUG - Processing node 69b13c0fa870a1dc3343c5a8: baseline-arm64-clabbe 2026-03-13 09:55:47,658 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b13c0fa870a1dc3343c5a8 2026-03-13 09:55:47,659 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 09:55:47,673 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b13c0fa870a1dc3343c5a8 HTTP/1.1" 200 None 2026-03-13 09:55:47,674 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 09:55:47,687 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a93c777ee78ae610caa696 HTTP/1.1" 200 None 2026-03-13 09:55:47,689 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 09:55:47,709 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b13c0fa870a1dc3343c5a8 HTTP/1.1" 200 None 2026-03-13 09:55:47,711 - lava_callback - ERROR - Error processing callback for node 69b13c0fa870a1dc3343c5a8: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:35098 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38870 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33490 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:33504 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33512 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56136 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43520 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59718 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58722 - "GET / HTTP/1.0" 200 OK 2026-03-13 09:57:05,024 - lava_callback - INFO - Received callback for node 69b3db601727ff69d6f229b5 INFO: 172.21.0.1:35746 - "POST /node/69b3db601727ff69d6f229b5 HTTP/1.0" 202 Accepted 2026-03-13 09:57:05,031 - lava_callback - INFO - Starting async job submit for node 69b3db601727ff69d6f229b5 2026-03-13 09:57:05,092 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 09:57:05,113 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b3db601727ff69d6f229b5 HTTP/1.1" 200 None 2026-03-13 09:57:05,114 - lava_callback - DEBUG - Processing node 69b3db601727ff69d6f229b5: ltp-smoke 2026-03-13 09:57:05,597 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-13 09:57:05,749 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-13 09:57:05,751 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/ltp-smoke-69b3db601727ff69d6f229b5/log.txt.gz 2026-03-13 09:57:06,037 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-13 09:57:06,271 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-13 09:57:06,273 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/ltp-smoke-69b3db601727ff69d6f229b5/lava-logs.yaml 2026-03-13 09:57:06,285 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-13 09:57:06,465 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-13 09:57:06,467 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/ltp-smoke-69b3db601727ff69d6f229b5/lava_callback.json.gz INFO: 172.21.0.1:35756 - "GET / HTTP/1.0" 200 OK 2026-03-13 09:57:06,605 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 09:57:06,633 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b3db601727ff69d6f229b5 HTTP/1.1" 200 None 2026-03-13 09:57:06,634 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 09:57:06,649 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b3c7ff1727ff69d6f21d8f HTTP/1.1" 200 None 2026-03-13 09:57:06,651 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 09:57:06,688 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b3db601727ff69d6f229b5 HTTP/1.1" 200 None 2026-03-13 09:57:06,816 - lava_callback - INFO - Completed processing callback for node 69b3db601727ff69d6f229b5 INFO: 172.21.0.1:42696 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:42700 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42704 - "GET / HTTP/1.0" 200 OK 2026-03-13 09:57:21,790 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 09:57:21,806 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:39758 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46834 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46060 - "GET / HTTP/1.0" 200 OK 2026-03-13 09:57:56,221 - lava_callback - INFO - Received callback for node 69b13c92a870a1dc3343c647 INFO: 172.21.0.1:46222 - "POST /node/69b13c92a870a1dc3343c647 HTTP/1.0" 202 Accepted 2026-03-13 09:57:56,227 - lava_callback - INFO - Starting async job submit for node 69b13c92a870a1dc3343c647 2026-03-13 09:57:56,228 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 09:57:56,241 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b13c92a870a1dc3343c647 HTTP/1.1" 200 None 2026-03-13 09:57:56,242 - lava_callback - DEBUG - Processing node 69b13c92a870a1dc3343c647: baseline-arm64-baylibre 2026-03-13 09:57:56,242 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b13c92a870a1dc3343c647 2026-03-13 09:57:56,243 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 09:57:56,267 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b13c92a870a1dc3343c647 HTTP/1.1" 200 None 2026-03-13 09:57:56,268 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 09:57:56,282 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b125a3a870a1dc3343ba94 HTTP/1.1" 200 None 2026-03-13 09:57:56,283 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 09:57:56,313 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b13c92a870a1dc3343c647 HTTP/1.1" 200 None 2026-03-13 09:57:56,315 - lava_callback - ERROR - Error processing callback for node 69b13c92a870a1dc3343c647: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:46226 - "GET / HTTP/1.0" 200 OK 2026-03-13 09:57:56,893 - lava_callback - INFO - Received callback for node 69b13c96a870a1dc3343c64e INFO: 172.21.0.1:46228 - "POST /node/69b13c96a870a1dc3343c64e HTTP/1.0" 202 Accepted 2026-03-13 09:57:56,899 - lava_callback - INFO - Starting async job submit for node 69b13c96a870a1dc3343c64e 2026-03-13 09:57:56,900 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 09:57:56,914 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b13c96a870a1dc3343c64e HTTP/1.1" 200 None 2026-03-13 09:57:56,915 - lava_callback - DEBUG - Processing node 69b13c96a870a1dc3343c64e: baseline-arm64-baylibre 2026-03-13 09:57:56,916 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b13c96a870a1dc3343c64e 2026-03-13 09:57:56,916 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 09:57:56,931 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b13c96a870a1dc3343c64e HTTP/1.1" 200 None 2026-03-13 09:57:56,933 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 09:57:56,950 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b125a3a870a1dc3343ba94 HTTP/1.1" 200 None 2026-03-13 09:57:56,952 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 09:57:56,974 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b13c96a870a1dc3343c64e HTTP/1.1" 200 None 2026-03-13 09:57:56,976 - lava_callback - ERROR - Error processing callback for node 69b13c96a870a1dc3343c64e: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' 2026-03-13 09:57:57,538 - lava_callback - INFO - Received callback for node 69b13c97a870a1dc3343c651 INFO: 172.21.0.1:46244 - "POST /node/69b13c97a870a1dc3343c651 HTTP/1.0" 202 Accepted 2026-03-13 09:57:57,543 - lava_callback - INFO - Starting async job submit for node 69b13c97a870a1dc3343c651 2026-03-13 09:57:57,544 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 09:57:57,559 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b13c97a870a1dc3343c651 HTTP/1.1" 200 None 2026-03-13 09:57:57,560 - lava_callback - DEBUG - Processing node 69b13c97a870a1dc3343c651: baseline-arm64-baylibre 2026-03-13 09:57:57,561 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b13c97a870a1dc3343c651 2026-03-13 09:57:57,561 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 09:57:57,574 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b13c97a870a1dc3343c651 HTTP/1.1" 200 None 2026-03-13 09:57:57,576 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 09:57:57,590 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b125a3a870a1dc3343ba94 HTTP/1.1" 200 None 2026-03-13 09:57:57,591 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 09:57:57,612 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b13c97a870a1dc3343c651 HTTP/1.1" 200 None 2026-03-13 09:57:57,617 - lava_callback - ERROR - Error processing callback for node 69b13c97a870a1dc3343c651: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:37696 - "GET / HTTP/1.0" 200 OK 2026-03-13 09:58:07,885 - lava_callback - INFO - Received callback for node 69b13ca8a870a1dc3343c680 INFO: 172.21.0.1:37704 - "POST /node/69b13ca8a870a1dc3343c680 HTTP/1.0" 202 Accepted 2026-03-13 09:58:07,890 - lava_callback - INFO - Starting async job submit for node 69b13ca8a870a1dc3343c680 2026-03-13 09:58:07,891 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 09:58:07,907 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b13ca8a870a1dc3343c680 HTTP/1.1" 200 None 2026-03-13 09:58:07,908 - lava_callback - DEBUG - Processing node 69b13ca8a870a1dc3343c680: baseline-arm64-clabbe 2026-03-13 09:58:07,908 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b13ca8a870a1dc3343c680 2026-03-13 09:58:07,908 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 09:58:07,944 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b13ca8a870a1dc3343c680 HTTP/1.1" 200 None 2026-03-13 09:58:07,945 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 09:58:07,958 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b125a3a870a1dc3343ba94 HTTP/1.1" 200 None 2026-03-13 09:58:07,959 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 09:58:07,980 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b13ca8a870a1dc3343c680 HTTP/1.1" 200 None 2026-03-13 09:58:07,985 - lava_callback - ERROR - Error processing callback for node 69b13ca8a870a1dc3343c680: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' 2026-03-13 09:58:08,567 - lava_callback - INFO - Received callback for node 69b13ca9a870a1dc3343c683 INFO: 172.21.0.1:37718 - "POST /node/69b13ca9a870a1dc3343c683 HTTP/1.0" 202 Accepted 2026-03-13 09:58:08,573 - lava_callback - INFO - Starting async job submit for node 69b13ca9a870a1dc3343c683 2026-03-13 09:58:08,574 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 09:58:08,588 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b13ca9a870a1dc3343c683 HTTP/1.1" 200 None 2026-03-13 09:58:08,589 - lava_callback - DEBUG - Processing node 69b13ca9a870a1dc3343c683: baseline-arm64-clabbe 2026-03-13 09:58:08,589 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b13ca9a870a1dc3343c683 2026-03-13 09:58:08,590 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 09:58:08,605 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b13ca9a870a1dc3343c683 HTTP/1.1" 200 None 2026-03-13 09:58:08,607 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 09:58:08,620 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b125a3a870a1dc3343ba94 HTTP/1.1" 200 None 2026-03-13 09:58:08,622 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 09:58:08,642 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b13ca9a870a1dc3343c683 HTTP/1.1" 200 None 2026-03-13 09:58:08,644 - lava_callback - ERROR - Error processing callback for node 69b13ca9a870a1dc3343c683: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' 2026-03-13 09:58:09,224 - lava_callback - INFO - Received callback for node 69b13caaa870a1dc3343c686 INFO: 172.21.0.1:37728 - "POST /node/69b13caaa870a1dc3343c686 HTTP/1.0" 202 Accepted 2026-03-13 09:58:09,230 - lava_callback - INFO - Starting async job submit for node 69b13caaa870a1dc3343c686 2026-03-13 09:58:09,230 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 09:58:09,244 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b13caaa870a1dc3343c686 HTTP/1.1" 200 None 2026-03-13 09:58:09,245 - lava_callback - DEBUG - Processing node 69b13caaa870a1dc3343c686: baseline-arm64-clabbe 2026-03-13 09:58:09,245 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b13caaa870a1dc3343c686 2026-03-13 09:58:09,246 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 09:58:09,259 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b13caaa870a1dc3343c686 HTTP/1.1" 200 None 2026-03-13 09:58:09,261 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 09:58:09,274 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b125a3a870a1dc3343ba94 HTTP/1.1" 200 None 2026-03-13 09:58:09,276 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 09:58:09,296 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b13caaa870a1dc3343c686 HTTP/1.1" 200 None 2026-03-13 09:58:09,298 - lava_callback - ERROR - Error processing callback for node 69b13caaa870a1dc3343c686: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' 2026-03-13 09:58:09,908 - lava_callback - INFO - Received callback for node 69b13caca870a1dc3343c6a6 INFO: 172.21.0.1:35530 - "POST /node/69b13caca870a1dc3343c6a6 HTTP/1.0" 202 Accepted 2026-03-13 09:58:09,914 - lava_callback - INFO - Starting async job submit for node 69b13caca870a1dc3343c6a6 2026-03-13 09:58:09,915 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 09:58:09,936 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b13caca870a1dc3343c6a6 HTTP/1.1" 200 None 2026-03-13 09:58:09,937 - lava_callback - DEBUG - Processing node 69b13caca870a1dc3343c6a6: baseline-arm64-clabbe 2026-03-13 09:58:09,937 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b13caca870a1dc3343c6a6 2026-03-13 09:58:09,938 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 09:58:09,957 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b13caca870a1dc3343c6a6 HTTP/1.1" 200 None 2026-03-13 09:58:09,958 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 09:58:09,972 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b125a3a870a1dc3343ba94 HTTP/1.1" 200 None 2026-03-13 09:58:09,974 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 09:58:09,994 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b13caca870a1dc3343c6a6 HTTP/1.1" 200 None 2026-03-13 09:58:09,996 - lava_callback - ERROR - Error processing callback for node 69b13caca870a1dc3343c6a6: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:35534 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:35546 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35548 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36470 - "GET / HTTP/1.0" 200 OK 2026-03-13 09:58:27,685 - lava_callback - INFO - Received callback for node 69b13cafa870a1dc3343c6af INFO: 172.21.0.1:36480 - "POST /node/69b13cafa870a1dc3343c6af HTTP/1.0" 202 Accepted 2026-03-13 09:58:27,691 - lava_callback - INFO - Starting async job submit for node 69b13cafa870a1dc3343c6af 2026-03-13 09:58:27,692 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 09:58:27,712 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b13cafa870a1dc3343c6af HTTP/1.1" 200 None 2026-03-13 09:58:27,713 - lava_callback - DEBUG - Processing node 69b13cafa870a1dc3343c6af: baseline-arm64-clabbe 2026-03-13 09:58:27,714 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b13cafa870a1dc3343c6af 2026-03-13 09:58:27,714 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 09:58:27,734 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b13cafa870a1dc3343c6af HTTP/1.1" 200 None 2026-03-13 09:58:27,736 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 09:58:27,750 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b125a3a870a1dc3343ba94 HTTP/1.1" 200 None 2026-03-13 09:58:27,751 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 09:58:27,778 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b13cafa870a1dc3343c6af HTTP/1.1" 200 None 2026-03-13 09:58:27,793 - lava_callback - ERROR - Error processing callback for node 69b13cafa870a1dc3343c6af: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' 2026-03-13 09:58:28,374 - lava_callback - INFO - Received callback for node 69b13caea870a1dc3343c6ac INFO: 172.21.0.1:36482 - "POST /node/69b13caea870a1dc3343c6ac HTTP/1.0" 202 Accepted 2026-03-13 09:58:28,380 - lava_callback - INFO - Starting async job submit for node 69b13caea870a1dc3343c6ac 2026-03-13 09:58:28,381 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 09:58:28,396 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b13caea870a1dc3343c6ac HTTP/1.1" 200 None 2026-03-13 09:58:28,397 - lava_callback - DEBUG - Processing node 69b13caea870a1dc3343c6ac: baseline-arm64-clabbe 2026-03-13 09:58:28,397 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b13caea870a1dc3343c6ac 2026-03-13 09:58:28,398 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 09:58:28,417 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b13caea870a1dc3343c6ac HTTP/1.1" 200 None 2026-03-13 09:58:28,420 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 09:58:28,436 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b125a3a870a1dc3343ba94 HTTP/1.1" 200 None 2026-03-13 09:58:28,438 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 09:58:28,473 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b13caea870a1dc3343c6ac HTTP/1.1" 200 None 2026-03-13 09:58:28,475 - lava_callback - ERROR - Error processing callback for node 69b13caea870a1dc3343c6ac: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:57992 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53902 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52624 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59004 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43726 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:43740 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43750 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43452 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50082 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34498 - "GET / HTTP/1.0" 200 OK 2026-03-13 09:59:49,673 - lava_callback - INFO - Received callback for node 69b3ddaa1727ff69d6f229ff INFO: 172.21.0.1:34514 - "POST /node/69b3ddaa1727ff69d6f229ff HTTP/1.0" 202 Accepted 2026-03-13 09:59:49,680 - lava_callback - INFO - Starting async job submit for node 69b3ddaa1727ff69d6f229ff 2026-03-13 09:59:49,715 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 09:59:49,730 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b3ddaa1727ff69d6f229ff HTTP/1.1" 200 None 2026-03-13 09:59:49,730 - lava_callback - DEBUG - Processing node 69b3ddaa1727ff69d6f229ff: baseline-arm64 2026-03-13 09:59:50,098 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-13 09:59:50,256 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-13 09:59:50,258 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-69b3ddaa1727ff69d6f229ff/log.txt.gz 2026-03-13 09:59:50,472 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-13 09:59:50,710 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-13 09:59:50,712 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69b3ddaa1727ff69d6f229ff/lava-logs.yaml 2026-03-13 09:59:50,721 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-13 09:59:50,903 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-13 09:59:50,904 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69b3ddaa1727ff69d6f229ff/lava_callback.json.gz DEBUG: Setup failed for 69b3ddaa1727ff69d6f229ff. Transitting job node result: incomplete -> fail 2026-03-13 09:59:50,976 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 09:59:50,990 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b3ddaa1727ff69d6f229ff HTTP/1.1" 200 None 2026-03-13 09:59:50,991 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 09:59:51,005 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b3c8061727ff69d6f21d98 HTTP/1.1" 200 None 2026-03-13 09:59:51,007 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 09:59:51,035 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b3ddaa1727ff69d6f229ff HTTP/1.1" 200 None 2026-03-13 09:59:51,121 - lava_callback - INFO - Completed processing callback for node 69b3ddaa1727ff69d6f229ff 2026-03-13 09:59:51,809 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 09:59:51,833 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:35064 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59546 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44286 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:44290 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44296 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43556 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37678 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51322 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45172 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36954 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59102 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:59116 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59126 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52032 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56874 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36602 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34332 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48066 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48980 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:48986 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48994 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53962 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58608 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58302 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35946 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59630 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34316 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:34326 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34328 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50514 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49924 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40076 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52942 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46594 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40948 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:40962 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40970 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53534 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53460 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45442 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42072 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46602 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48718 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:48720 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48736 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51088 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52326 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60870 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42914 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37714 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56546 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:56558 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56574 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45978 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50834 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49458 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60012 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48606 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52570 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:52576 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52592 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59752 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45882 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34794 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49898 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48418 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34928 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:34934 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34942 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49052 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57874 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33734 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43812 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46554 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59186 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:59194 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59198 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45072 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52932 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33266 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48318 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57234 - "GET / HTTP/1.0" 200 OK 2026-03-13 10:10:06,791 - lava_callback - INFO - Received callback for node 69b3de9b1727ff69d6f22a20 INFO: 172.21.0.1:57242 - "POST /node/69b3de9b1727ff69d6f22a20 HTTP/1.0" 202 Accepted 2026-03-13 10:10:06,798 - lava_callback - INFO - Starting async job submit for node 69b3de9b1727ff69d6f22a20 2026-03-13 10:10:06,861 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 10:10:06,875 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b3de9b1727ff69d6f22a20 HTTP/1.1" 200 None 2026-03-13 10:10:06,876 - lava_callback - DEBUG - Processing node 69b3de9b1727ff69d6f22a20: baseline-arm 2026-03-13 10:10:07,474 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-13 10:10:07,648 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-13 10:10:07,650 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-69b3de9b1727ff69d6f22a20/log.txt.gz 2026-03-13 10:10:08,072 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-13 10:10:08,335 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-13 10:10:08,337 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm-69b3de9b1727ff69d6f22a20/lava-logs.yaml 2026-03-13 10:10:08,352 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-13 10:10:08,515 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-13 10:10:08,517 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-69b3de9b1727ff69d6f22a20/lava_callback.json.gz DEBUG: Setup failed for 69b3de9b1727ff69d6f22a20. Transitting job node result: incomplete -> fail 2026-03-13 10:10:08,643 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 10:10:08,661 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b3de9b1727ff69d6f22a20 HTTP/1.1" 200 None 2026-03-13 10:10:08,662 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 10:10:08,677 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b3c7f91727ff69d6f21d89 HTTP/1.1" 200 None 2026-03-13 10:10:08,679 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 10:10:08,816 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b3de9b1727ff69d6f22a20 HTTP/1.1" 200 None 2026-03-13 10:10:08,939 - lava_callback - INFO - Completed processing callback for node 69b3de9b1727ff69d6f22a20 INFO: 172.21.0.1:48230 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:48246 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48248 - "GET / HTTP/1.0" 200 OK 2026-03-13 10:10:21,837 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 10:10:21,853 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:52882 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40576 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49436 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47602 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60670 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53534 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:53540 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53542 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60918 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55350 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44644 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33764 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39518 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60486 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:60502 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60504 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58476 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44280 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39208 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39716 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34774 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48932 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:48948 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48950 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54124 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44634 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42006 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49054 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49518 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52904 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:52916 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52920 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43566 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41722 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33540 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51840 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43926 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57418 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:57422 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57428 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47670 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39696 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48744 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52338 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34750 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56008 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:56014 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56030 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41158 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38976 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50160 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44126 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34704 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57836 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:57846 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57854 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39548 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45042 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50806 - "GET / HTTP/1.0" 200 OK 2026-03-13 10:17:50,227 - lava_callback - INFO - Received callback for node 69b3dfbd1727ff69d6f22a63 INFO: 172.21.0.1:58442 - "POST /node/69b3dfbd1727ff69d6f22a63 HTTP/1.0" 202 Accepted 2026-03-13 10:17:50,274 - lava_callback - INFO - Starting async job submit for node 69b3dfbd1727ff69d6f22a63 2026-03-13 10:17:50,302 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 10:17:50,316 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b3dfbd1727ff69d6f22a63 HTTP/1.1" 200 None 2026-03-13 10:17:50,317 - lava_callback - DEBUG - Processing node 69b3dfbd1727ff69d6f22a63: baseline-arm-pengutronix 2026-03-13 10:17:50,420 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-13 10:17:50,578 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-13 10:17:50,580 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-pengutronix-69b3dfbd1727ff69d6f22a63/log.txt.gz 2026-03-13 10:17:50,647 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-13 10:17:50,851 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-13 10:17:50,853 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm-pengutronix-69b3dfbd1727ff69d6f22a63/lava-logs.yaml 2026-03-13 10:17:50,856 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-13 10:17:50,989 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-13 10:17:50,991 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-pengutronix-69b3dfbd1727ff69d6f22a63/lava_callback.json.gz DEBUG: Setup failed for 69b3dfbd1727ff69d6f22a63. Transitting job node result: incomplete -> fail 2026-03-13 10:17:51,038 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 10:17:51,053 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b3dfbd1727ff69d6f22a63 HTTP/1.1" 200 None 2026-03-13 10:17:51,054 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 10:17:51,068 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b3c7f91727ff69d6f21d89 HTTP/1.1" 200 None 2026-03-13 10:17:51,069 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 10:17:51,094 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b3dfbd1727ff69d6f22a63 HTTP/1.1" 200 None 2026-03-13 10:17:51,150 - lava_callback - INFO - Completed processing callback for node 69b3dfbd1727ff69d6f22a63 2026-03-13 10:17:51,857 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 10:17:51,873 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:58454 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:32896 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33624 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:33636 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33638 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58254 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43596 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43216 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45164 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33854 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60692 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:60708 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60718 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39350 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49896 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42090 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60402 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40218 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54038 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:54042 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54058 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54132 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58292 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58954 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34884 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34688 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42330 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:42338 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42346 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53788 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36724 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34156 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54126 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50576 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42570 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:42576 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42590 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52148 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52550 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54960 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39514 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56308 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60194 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:60202 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60214 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40862 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57214 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49064 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38742 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41054 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60462 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:60476 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60478 - "GET / HTTP/1.0" 200 OK 2026-03-13 10:24:25,884 - lava_callback - INFO - Received callback for node 69b3e1c81727ff69d6f22aaf INFO: 172.21.0.1:52124 - "POST /node/69b3e1c81727ff69d6f22aaf HTTP/1.0" 202 Accepted 2026-03-13 10:24:25,890 - lava_callback - INFO - Starting async job submit for node 69b3e1c81727ff69d6f22aaf 2026-03-13 10:24:25,946 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 10:24:25,985 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b3e1c81727ff69d6f22aaf HTTP/1.1" 200 None 2026-03-13 10:24:25,986 - lava_callback - DEBUG - Processing node 69b3e1c81727ff69d6f22aaf: ltp-smoke 2026-03-13 10:24:26,448 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 INFO: 172.21.0.1:52128 - "GET / HTTP/1.0" 200 OK 2026-03-13 10:24:26,619 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-13 10:24:26,621 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/ltp-smoke-69b3e1c81727ff69d6f22aaf/log.txt.gz 2026-03-13 10:24:26,904 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-13 10:24:27,159 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-13 10:24:27,161 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/ltp-smoke-69b3e1c81727ff69d6f22aaf/lava-logs.yaml 2026-03-13 10:24:27,173 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-13 10:24:27,357 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-13 10:24:27,359 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/ltp-smoke-69b3e1c81727ff69d6f22aaf/lava_callback.json.gz 2026-03-13 10:24:27,473 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 10:24:27,488 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b3e1c81727ff69d6f22aaf HTTP/1.1" 200 None 2026-03-13 10:24:27,489 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 10:24:27,502 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b3c7ff1727ff69d6f21d8f HTTP/1.1" 200 None 2026-03-13 10:24:27,504 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 10:24:27,528 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b3e1c81727ff69d6f22aaf HTTP/1.1" 200 None 2026-03-13 10:24:27,642 - lava_callback - INFO - Completed processing callback for node 69b3e1c81727ff69d6f22aaf INFO: 172.21.0.1:54200 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47952 - "GET / HTTP/1.0" 200 OK 2026-03-13 10:24:51,876 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 10:24:51,915 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:46126 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50178 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34896 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:34900 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34916 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59748 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41308 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58046 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38116 - "GET / HTTP/1.0" 200 OK 2026-03-13 10:26:02,722 - lava_callback - INFO - Received callback for node 69b3e17e1727ff69d6f22aa3 INFO: 172.21.0.1:53132 - "POST /node/69b3e17e1727ff69d6f22aa3 HTTP/1.0" 202 Accepted 2026-03-13 10:26:02,730 - lava_callback - INFO - Starting async job submit for node 69b3e17e1727ff69d6f22aa3 2026-03-13 10:26:02,772 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 10:26:02,790 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b3e17e1727ff69d6f22aa3 HTTP/1.1" 200 None 2026-03-13 10:26:02,790 - lava_callback - DEBUG - Processing node 69b3e17e1727ff69d6f22aa3: baseline-nfs-arm64 2026-03-13 10:26:03,860 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-13 10:26:04,064 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-13 10:26:04,066 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69b3e17e1727ff69d6f22aa3/log.txt.gz 2026-03-13 10:26:04,707 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-13 10:26:04,972 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-13 10:26:04,975 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69b3e17e1727ff69d6f22aa3/lava-logs.yaml 2026-03-13 10:26:04,996 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-13 10:26:05,193 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-13 10:26:05,195 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69b3e17e1727ff69d6f22aa3/lava_callback.json.gz DEBUG: Setup failed for 69b3e17e1727ff69d6f22aa3. Transitting job node result: incomplete -> fail 2026-03-13 10:26:05,281 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 10:26:05,296 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b3e17e1727ff69d6f22aa3 HTTP/1.1" 200 None 2026-03-13 10:26:05,298 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 10:26:05,311 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b3c8061727ff69d6f21d98 HTTP/1.1" 200 None 2026-03-13 10:26:05,313 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 10:26:05,341 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b3e17e1727ff69d6f22aa3 HTTP/1.1" 200 None 2026-03-13 10:26:05,446 - lava_callback - INFO - Completed processing callback for node 69b3e17e1727ff69d6f22aa3 INFO: 172.21.0.1:53144 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53054 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:53066 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53068 - "GET / HTTP/1.0" 200 OK 2026-03-13 10:26:21,917 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 10:26:21,934 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:43548 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48800 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41850 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50940 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56222 - "GET / HTTP/1.0" 200 OK 2026-03-13 10:27:11,497 - lava_callback - INFO - Received callback for node 69b3e4b71727ff69d6f22b10 INFO: 172.21.0.1:56598 - "POST /node/69b3e4b71727ff69d6f22b10 HTTP/1.0" 202 Accepted 2026-03-13 10:27:11,504 - lava_callback - INFO - Starting async job submit for node 69b3e4b71727ff69d6f22b10 2026-03-13 10:27:11,541 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 10:27:11,555 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b3e4b71727ff69d6f22b10 HTTP/1.1" 200 None 2026-03-13 10:27:11,556 - lava_callback - DEBUG - Processing node 69b3e4b71727ff69d6f22b10: baseline-arm64 2026-03-13 10:27:11,921 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-13 10:27:12,074 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-13 10:27:12,076 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-69b3e4b71727ff69d6f22b10/log.txt.gz 2026-03-13 10:27:12,302 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-13 10:27:12,549 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-13 10:27:12,551 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69b3e4b71727ff69d6f22b10/lava-logs.yaml 2026-03-13 10:27:12,560 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-13 10:27:12,757 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-13 10:27:12,758 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69b3e4b71727ff69d6f22b10/lava_callback.json.gz DEBUG: Setup failed for 69b3e4b71727ff69d6f22b10. Transitting job node result: incomplete -> fail 2026-03-13 10:27:12,829 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 10:27:12,844 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b3e4b71727ff69d6f22b10 HTTP/1.1" 200 None 2026-03-13 10:27:12,845 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 10:27:12,858 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b3c8061727ff69d6f21d98 HTTP/1.1" 200 None 2026-03-13 10:27:12,860 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 10:27:12,883 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b3e4b71727ff69d6f22b10 HTTP/1.1" 200 None 2026-03-13 10:27:12,964 - lava_callback - INFO - Completed processing callback for node 69b3e4b71727ff69d6f22b10 INFO: 172.21.0.1:56612 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:56626 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56642 - "GET / HTTP/1.0" 200 OK 2026-03-13 10:27:21,936 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 10:27:21,963 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:45958 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49912 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44536 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42246 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37692 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37210 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:37226 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37232 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49578 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56308 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51806 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52440 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39944 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55814 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:55818 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55822 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49214 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39160 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60982 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44920 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44956 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47750 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:47754 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47764 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38026 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43120 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47638 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51000 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37922 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44390 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:44398 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44408 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60862 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33584 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35884 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44760 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33604 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48954 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:48964 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48972 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45204 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51440 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48920 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37780 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40936 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34990 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:35006 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35020 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54320 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36314 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46492 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41932 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55486 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50034 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:50050 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50056 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52164 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45204 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59768 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52070 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54256 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53764 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:53774 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53786 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55066 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55498 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60020 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59648 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46436 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44718 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:44732 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44742 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45754 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59686 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55088 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50516 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54344 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47712 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:47716 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47726 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56194 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40324 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54554 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44458 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60270 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51696 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:51710 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51712 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44420 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39498 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59442 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49348 - "GET / HTTP/1.0" 200 OK 2026-03-13 10:39:01,201 - lava_callback - INFO - Received callback for node 69b3e5031727ff69d6f22b16 INFO: 172.21.0.1:50790 - "POST /node/69b3e5031727ff69d6f22b16 HTTP/1.0" 202 Accepted 2026-03-13 10:39:01,208 - lava_callback - INFO - Starting async job submit for node 69b3e5031727ff69d6f22b16 2026-03-13 10:39:01,260 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 10:39:01,276 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b3e5031727ff69d6f22b16 HTTP/1.1" 200 None 2026-03-13 10:39:01,277 - lava_callback - DEBUG - Processing node 69b3e5031727ff69d6f22b16: baseline-arm 2026-03-13 10:39:01,833 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-13 10:39:02,000 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-13 10:39:02,001 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-69b3e5031727ff69d6f22b16/log.txt.gz 2026-03-13 10:39:02,359 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-13 10:39:02,620 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-13 10:39:02,622 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm-69b3e5031727ff69d6f22b16/lava-logs.yaml 2026-03-13 10:39:02,637 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-13 10:39:02,830 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-13 10:39:02,832 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-69b3e5031727ff69d6f22b16/lava_callback.json.gz DEBUG: Setup failed for 69b3e5031727ff69d6f22b16. Transitting job node result: incomplete -> fail 2026-03-13 10:39:02,938 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 10:39:02,952 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b3e5031727ff69d6f22b16 HTTP/1.1" 200 None 2026-03-13 10:39:02,954 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 10:39:02,968 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b3c7f91727ff69d6f21d89 HTTP/1.1" 200 None 2026-03-13 10:39:02,970 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 10:39:02,994 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b3e5031727ff69d6f22b16 HTTP/1.1" 200 None 2026-03-13 10:39:03,101 - lava_callback - INFO - Completed processing callback for node 69b3e5031727ff69d6f22b16 INFO: 172.21.0.1:50796 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49224 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:49232 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49238 - "GET / HTTP/1.0" 200 OK 2026-03-13 10:39:21,968 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 10:39:21,995 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:55406 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37730 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47404 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50816 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57028 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54310 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:54316 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54320 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35972 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48338 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45028 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50530 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43584 - "GET / HTTP/1.0" 200 OK 2026-03-13 10:41:12,400 - lava_callback - INFO - Received callback for node 69b3e5321727ff69d6f22b21 INFO: 172.21.0.1:35172 - "POST /node/69b3e5321727ff69d6f22b21 HTTP/1.0" 202 Accepted 2026-03-13 10:41:12,449 - lava_callback - INFO - Starting async job submit for node 69b3e5321727ff69d6f22b21 2026-03-13 10:41:12,472 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 10:41:12,487 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b3e5321727ff69d6f22b21 HTTP/1.1" 200 None 2026-03-13 10:41:12,488 - lava_callback - DEBUG - Processing node 69b3e5321727ff69d6f22b21: baseline-arm-pengutronix 2026-03-13 10:41:12,591 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-13 10:41:12,754 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-13 10:41:12,756 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-pengutronix-69b3e5321727ff69d6f22b21/log.txt.gz 2026-03-13 10:41:12,814 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-13 10:41:13,002 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-13 10:41:13,004 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm-pengutronix-69b3e5321727ff69d6f22b21/lava-logs.yaml 2026-03-13 10:41:13,007 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-13 10:41:13,137 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-13 10:41:13,138 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-pengutronix-69b3e5321727ff69d6f22b21/lava_callback.json.gz DEBUG: Setup failed for 69b3e5321727ff69d6f22b21. Transitting job node result: incomplete -> fail 2026-03-13 10:41:13,193 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 10:41:13,207 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b3e5321727ff69d6f22b21 HTTP/1.1" 200 None 2026-03-13 10:41:13,209 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 10:41:13,246 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b3c7f91727ff69d6f21d89 HTTP/1.1" 200 None 2026-03-13 10:41:13,247 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 10:41:13,271 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b3e5321727ff69d6f22b21 HTTP/1.1" 200 None 2026-03-13 10:41:13,314 - lava_callback - INFO - Completed processing callback for node 69b3e5321727ff69d6f22b21 INFO: 172.21.0.1:35180 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:35184 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35192 - "GET / HTTP/1.0" 200 OK 2026-03-13 10:41:21,997 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 10:41:22,017 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:35686 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48430 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38622 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48820 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56996 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54726 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:54728 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54732 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46584 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49780 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43010 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40242 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45122 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39702 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:39718 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39720 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53796 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42370 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60138 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34834 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35192 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60694 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:60698 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60702 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50438 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60234 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60268 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34930 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60368 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36922 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:36930 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36940 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40588 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39870 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33022 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47316 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55584 - "GET / HTTP/1.0" 200 OK 2026-03-13 10:46:07,842 - lava_callback - INFO - Received callback for node 69b3e6461727ff69d6f22b34 INFO: 172.21.0.1:55594 - "POST /node/69b3e6461727ff69d6f22b34 HTTP/1.0" 202 Accepted 2026-03-13 10:46:07,850 - lava_callback - INFO - Starting async job submit for node 69b3e6461727ff69d6f22b34 2026-03-13 10:46:07,892 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 10:46:07,920 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b3e6461727ff69d6f22b34 HTTP/1.1" 200 None 2026-03-13 10:46:07,921 - lava_callback - DEBUG - Processing node 69b3e6461727ff69d6f22b34: baseline-nfs-arm64 2026-03-13 10:46:08,995 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-13 10:46:09,202 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-13 10:46:09,203 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69b3e6461727ff69d6f22b34/log.txt.gz 2026-03-13 10:46:09,851 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-13 10:46:10,080 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-13 10:46:10,083 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69b3e6461727ff69d6f22b34/lava-logs.yaml 2026-03-13 10:46:10,104 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-13 10:46:10,295 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-13 10:46:10,297 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69b3e6461727ff69d6f22b34/lava_callback.json.gz DEBUG: Setup failed for 69b3e6461727ff69d6f22b34. Transitting job node result: incomplete -> fail 2026-03-13 10:46:10,384 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 10:46:10,415 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b3e6461727ff69d6f22b34 HTTP/1.1" 200 None 2026-03-13 10:46:10,417 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 10:46:10,430 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b3c8061727ff69d6f21d98 HTTP/1.1" 200 None 2026-03-13 10:46:10,431 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 10:46:10,459 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b3e6461727ff69d6f22b34 HTTP/1.1" 200 None 2026-03-13 10:46:10,565 - lava_callback - INFO - Completed processing callback for node 69b3e6461727ff69d6f22b34 INFO: 172.21.0.1:50486 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:50492 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50508 - "GET / HTTP/1.0" 200 OK 2026-03-13 10:46:22,020 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 10:46:22,059 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:39898 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38406 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42268 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39928 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49364 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48270 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:48284 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48286 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43748 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48092 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52214 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47050 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56244 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45346 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:45362 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45370 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47912 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59292 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47140 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57620 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34646 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56338 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:56350 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56366 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45788 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42060 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56702 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59914 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53536 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47218 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:47230 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47232 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35826 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45428 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42542 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50816 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38344 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49010 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:49014 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49030 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57716 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43772 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47474 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39154 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56318 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51284 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:51294 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51304 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33094 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45402 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42738 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40814 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39224 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39266 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:39270 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39284 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37098 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60236 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47626 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59694 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60434 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54938 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:54946 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54950 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48572 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55808 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34774 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53954 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49828 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33910 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:33922 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33932 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35870 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36012 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34126 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44362 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41794 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39474 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:39484 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39486 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59352 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35348 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47624 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35110 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59958 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34730 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:34734 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34746 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59984 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51912 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45190 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52566 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42688 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33102 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:33106 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33108 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50590 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58726 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45076 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57010 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46554 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60020 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:60028 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60044 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50530 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47528 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58722 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38656 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49696 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41992 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:41994 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42006 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51902 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47442 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52380 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44992 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47198 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45550 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:45554 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45566 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34288 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55380 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46942 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49222 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53640 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48786 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:48802 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48806 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48704 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56842 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43126 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58044 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38846 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55704 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:55710 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55718 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50430 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40586 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46704 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48832 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37268 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42590 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:42604 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42608 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36846 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44834 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53350 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46342 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57268 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36714 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:36720 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36728 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46760 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60278 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51002 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54964 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55564 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59328 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:59342 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59346 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38520 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57848 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37362 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34812 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45720 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38518 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:38526 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38534 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47882 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33010 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43450 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34496 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60268 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51626 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:51632 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51644 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60196 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57396 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57676 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53824 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48470 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44794 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:44804 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44806 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41532 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36030 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35574 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50012 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56880 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37892 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:37896 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37902 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40112 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50492 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48372 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48070 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41974 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33900 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:33912 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33918 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47124 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41730 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46662 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53876 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42958 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40900 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:40908 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40918 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39728 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39870 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39246 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36032 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55904 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41070 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:41076 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41090 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38264 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59668 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41484 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59692 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48142 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42550 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:42566 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42574 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45186 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48144 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38536 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45742 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42596 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59332 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:59348 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59354 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37580 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49614 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37264 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39274 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56310 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35568 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:35578 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35586 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40942 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41986 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40542 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33146 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57514 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52184 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:52192 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52206 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38012 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55256 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42478 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45196 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56536 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50946 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:50954 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50966 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55604 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45728 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35822 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37002 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49730 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53246 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:53250 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53254 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54040 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48878 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39996 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43864 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47156 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52968 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:52980 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52996 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35072 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41396 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58168 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40976 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54814 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58914 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:58916 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58926 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54762 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49336 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44170 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57952 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52410 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47078 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:47090 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47104 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50776 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34122 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53624 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39696 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51410 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41022 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:41026 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41034 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33764 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56294 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54932 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50372 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48070 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51052 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:51064 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51080 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46800 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49692 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59242 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45528 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54466 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38868 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:38882 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38888 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42814 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41068 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39500 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59634 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47892 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37640 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:37652 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37658 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46728 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40978 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35672 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40580 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45664 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40878 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:40894 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40906 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33938 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38220 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58340 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60752 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33704 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54092 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:54106 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54114 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50628 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53246 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50824 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55554 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40246 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39472 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:39474 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39490 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33066 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46162 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46226 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39300 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40606 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35860 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:35866 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35878 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52986 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45058 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34150 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55624 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36178 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56132 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:56148 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56164 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53994 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51264 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58964 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42132 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56848 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40400 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:40416 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40418 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54368 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36346 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36680 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38130 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60010 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56984 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:56998 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57014 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53986 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57968 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50442 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51628 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:32962 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44938 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:44944 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44954 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50452 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50678 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43188 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48390 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51530 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39226 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:39236 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39252 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57704 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42708 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35284 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48694 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50446 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50170 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:50172 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50178 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53380 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48414 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34360 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42766 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54740 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44782 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:44796 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44806 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52110 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60956 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33772 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36988 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51792 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33948 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:33952 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33958 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39942 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48242 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37156 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47044 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38418 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41110 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:41122 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41132 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47088 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43246 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60278 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43174 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36884 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34752 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:34764 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34778 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36958 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39252 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40478 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46956 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54718 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54440 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:54450 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54456 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50510 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42790 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52084 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54316 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36710 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49068 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:49084 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49094 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33714 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34168 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33598 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44006 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34052 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38788 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:38790 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38798 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38996 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57092 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48910 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55038 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36158 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40854 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:40860 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40876 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43596 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58842 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52444 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55278 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41924 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45080 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:45084 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45094 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55470 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43166 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47498 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39912 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42298 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48284 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:48290 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48304 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55606 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46764 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49700 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56652 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58790 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45574 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:45580 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45588 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39434 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57226 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45396 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33184 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59896 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48390 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:48396 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48412 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43820 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57312 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40672 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48280 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46918 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35958 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:35960 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35964 - "GET / HTTP/1.0" 200 OK 2026-03-13 11:49:24,468 - lava_callback - INFO - Received callback for node 69b3cca31727ff69d6f2219d INFO: 172.21.0.1:57034 - "POST /node/69b3cca31727ff69d6f2219d HTTP/1.0" 202 Accepted 2026-03-13 11:49:24,474 - lava_callback - INFO - Starting async job submit for node 69b3cca31727ff69d6f2219d 2026-03-13 11:49:24,493 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 11:49:24,510 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b3cca31727ff69d6f2219d HTTP/1.1" 200 None 2026-03-13 11:49:24,511 - lava_callback - DEBUG - Processing node 69b3cca31727ff69d6f2219d: baseline-x86 2026-03-13 11:49:24,806 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-13 11:49:24,973 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-13 11:49:24,976 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-x86-69b3cca31727ff69d6f2219d/log.txt.gz 2026-03-13 11:49:25,171 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-13 11:49:25,416 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-13 11:49:25,418 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-x86-69b3cca31727ff69d6f2219d/lava-logs.yaml 2026-03-13 11:49:25,426 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-13 11:49:25,641 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-13 11:49:25,643 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-x86-69b3cca31727ff69d6f2219d/lava_callback.json.gz 2026-03-13 11:49:25,663 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 11:49:25,686 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b3cca31727ff69d6f2219d HTTP/1.1" 200 None 2026-03-13 11:49:25,688 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 11:49:25,701 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b3c81d1727ff69d6f21db3 HTTP/1.1" 200 None 2026-03-13 11:49:25,703 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 11:49:25,741 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b3cca31727ff69d6f2219d HTTP/1.1" 200 None 2026-03-13 11:49:25,742 - lava_callback - INFO - Completed processing callback for node 69b3cca31727ff69d6f2219d INFO: 172.21.0.1:57040 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50930 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48912 - "GET / HTTP/1.0" 200 OK 2026-03-13 11:49:52,074 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 11:49:52,100 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:36404 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49132 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45788 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:45802 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45808 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36932 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50464 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56900 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43692 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52702 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34574 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:34576 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34588 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37216 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48738 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55928 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57728 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57228 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52662 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:52664 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52670 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38654 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55274 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35408 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36966 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39240 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55074 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:55078 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55094 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47484 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55526 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42004 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39632 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33860 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40298 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:40312 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40324 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57666 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58908 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42800 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38994 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:32992 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35744 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:35758 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35768 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37460 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58188 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33524 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53116 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36248 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49566 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:49578 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49580 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48820 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57224 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36708 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44418 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42784 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34178 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:34182 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34198 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38528 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56000 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42586 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42802 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36058 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44014 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:44022 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44036 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44376 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52710 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43916 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41382 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38392 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42664 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:42670 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42676 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47414 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53846 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40996 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43780 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56922 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56086 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:56098 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56106 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42158 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40320 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53700 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48820 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37134 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60974 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:60976 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60980 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57708 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38132 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48200 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36356 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33964 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51568 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:51578 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51590 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48086 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55656 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55980 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60714 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42094 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44020 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:44022 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44036 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41040 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44672 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39328 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38488 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50244 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56980 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:56994 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57002 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51370 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45770 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34060 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38978 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41270 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41330 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:41342 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41344 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36636 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60720 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45470 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51506 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46926 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41760 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:41774 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41786 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37386 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43862 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54838 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53208 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48780 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58142 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:58150 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58160 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46722 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34448 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41684 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49538 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52440 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37742 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:37758 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37766 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35436 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39174 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38062 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44900 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33580 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50530 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:50546 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50550 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53822 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51342 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40922 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46244 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58844 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38026 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:38028 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38030 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41558 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38938 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56436 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43976 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46652 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50116 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:50128 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50144 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37202 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54298 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44556 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54790 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35852 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37334 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:37346 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37350 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39722 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45634 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47812 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36792 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45354 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58158 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:58174 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58190 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44014 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44828 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44782 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36400 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36592 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38740 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:38744 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38760 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36012 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60176 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47996 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50902 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52596 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51516 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:51532 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51548 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33126 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55486 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58994 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58096 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59440 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37476 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:37478 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37488 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35894 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46064 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59800 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34400 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40418 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52780 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:52782 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52786 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45854 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50070 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33608 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37832 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41632 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40962 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:40964 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40974 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38808 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59468 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45586 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36180 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48122 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53602 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:53616 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53626 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49614 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44506 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47900 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35444 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51344 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42220 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:42228 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42234 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59462 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40174 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43044 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35150 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58776 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48022 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:48024 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48040 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57332 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44362 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43956 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55730 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48616 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59886 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:59898 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59912 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49972 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59436 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42786 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35412 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33228 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54604 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:54606 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54620 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37018 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50596 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51968 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44052 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43652 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33026 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:33028 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33032 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55786 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50438 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60298 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43234 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37184 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39786 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:39796 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39798 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33126 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50782 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45274 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52156 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45364 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33970 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:33972 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33978 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54056 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53600 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47852 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36970 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56232 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52728 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:52736 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52738 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45564 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49542 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34988 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44370 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33034 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60028 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:60030 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60036 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46742 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54368 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37736 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47612 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38908 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47420 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:47424 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47440 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42886 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38020 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34742 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39994 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56344 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46260 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:46276 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46288 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55754 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51008 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34644 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54018 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39084 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44784 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:44796 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44808 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49818 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46898 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42966 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47232 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35042 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41288 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:41304 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41314 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34714 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37950 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53062 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49140 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50864 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40288 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:40298 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40310 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47192 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59294 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42918 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38664 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38386 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53346 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:53350 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53362 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39766 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45056 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48698 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45502 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59092 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38646 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:38662 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38664 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38704 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55610 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33408 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43940 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48408 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44278 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:44280 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44294 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35326 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41420 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39430 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42388 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57494 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43036 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:43050 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43052 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48682 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49526 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47246 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53682 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37042 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56712 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:56728 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56730 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53320 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35764 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33848 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56436 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41050 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60094 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:60110 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60116 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35510 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44076 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38618 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60338 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56422 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50702 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:50714 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50722 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40164 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57728 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57094 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43984 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48112 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38344 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:38356 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38372 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35324 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43252 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57298 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35862 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42570 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34884 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:34890 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34906 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37230 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59628 - "GET / HTTP/1.0" 200 OK 2026-03-13 12:42:45,401 - lava_callback - INFO - Received callback for node 69b1633da870a1dc3343c9ff INFO: 172.21.0.1:48198 - "POST /node/69b1633da870a1dc3343c9ff HTTP/1.0" 202 Accepted 2026-03-13 12:42:45,407 - lava_callback - INFO - Starting async job submit for node 69b1633da870a1dc3343c9ff 2026-03-13 12:42:45,408 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 12:42:45,423 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b1633da870a1dc3343c9ff HTTP/1.1" 200 None 2026-03-13 12:42:45,424 - lava_callback - DEBUG - Processing node 69b1633da870a1dc3343c9ff: baseline-arm-baylibre 2026-03-13 12:42:45,425 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b1633da870a1dc3343c9ff 2026-03-13 12:42:45,425 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 12:42:45,440 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b1633da870a1dc3343c9ff HTTP/1.1" 200 None 2026-03-13 12:42:45,442 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 12:42:45,464 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b0b4fc9d19175818251fd6 HTTP/1.1" 200 None 2026-03-13 12:42:45,465 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 12:42:45,486 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b1633da870a1dc3343c9ff HTTP/1.1" 200 None 2026-03-13 12:42:45,492 - lava_callback - ERROR - Error processing callback for node 69b1633da870a1dc3343c9ff: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:48204 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49226 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43880 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35486 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:35490 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35500 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41460 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33094 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58818 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59164 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56454 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53986 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:53994 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54000 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49006 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54972 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43398 - "GET / HTTP/1.0" 200 OK 2026-03-13 12:44:54,787 - lava_callback - INFO - Received callback for node 69b163b6a870a1dc3343ca24 INFO: 172.21.0.1:51018 - "POST /node/69b163b6a870a1dc3343ca24 HTTP/1.0" 202 Accepted 2026-03-13 12:44:54,792 - lava_callback - INFO - Starting async job submit for node 69b163b6a870a1dc3343ca24 2026-03-13 12:44:54,793 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 12:44:54,810 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b163b6a870a1dc3343ca24 HTTP/1.1" 200 None 2026-03-13 12:44:54,811 - lava_callback - DEBUG - Processing node 69b163b6a870a1dc3343ca24: baseline-arm-clabbe 2026-03-13 12:44:54,811 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b163b6a870a1dc3343ca24 2026-03-13 12:44:54,811 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 12:44:54,824 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b163b6a870a1dc3343ca24 HTTP/1.1" 200 None 2026-03-13 12:44:54,826 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 12:44:54,841 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b0b4fc9d19175818251fd6 HTTP/1.1" 200 None 2026-03-13 12:44:54,843 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 12:44:54,879 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b163b6a870a1dc3343ca24 HTTP/1.1" 200 None 2026-03-13 12:44:54,881 - lava_callback - ERROR - Error processing callback for node 69b163b6a870a1dc3343ca24: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:51032 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50500 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34732 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:34740 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34754 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54634 - "GET / HTTP/1.0" 200 OK 2026-03-13 12:45:34,769 - lava_callback - INFO - Received callback for node 69b163e8a870a1dc3343ca2f INFO: 172.21.0.1:40814 - "POST /node/69b163e8a870a1dc3343ca2f HTTP/1.0" 202 Accepted 2026-03-13 12:45:34,775 - lava_callback - INFO - Starting async job submit for node 69b163e8a870a1dc3343ca2f 2026-03-13 12:45:34,776 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 12:45:34,794 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b163e8a870a1dc3343ca2f HTTP/1.1" 200 None 2026-03-13 12:45:34,795 - lava_callback - DEBUG - Processing node 69b163e8a870a1dc3343ca2f: baseline-arm-clabbe 2026-03-13 12:45:34,796 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b163e8a870a1dc3343ca2f 2026-03-13 12:45:34,796 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 12:45:34,811 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b163e8a870a1dc3343ca2f HTTP/1.1" 200 None 2026-03-13 12:45:34,812 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 12:45:34,825 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b0b4fc9d19175818251fd6 HTTP/1.1" 200 None 2026-03-13 12:45:34,827 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 12:45:34,846 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b163e8a870a1dc3343ca2f HTTP/1.1" 200 None 2026-03-13 12:45:34,848 - lava_callback - ERROR - Error processing callback for node 69b163e8a870a1dc3343ca2f: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:40820 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45496 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35222 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50576 - "GET / HTTP/1.0" 200 OK 2026-03-13 12:46:14,832 - lava_callback - INFO - Received callback for node 69b1640ca870a1dc3343ca3a INFO: 172.21.0.1:50578 - "POST /node/69b1640ca870a1dc3343ca3a HTTP/1.0" 202 Accepted 2026-03-13 12:46:14,838 - lava_callback - INFO - Starting async job submit for node 69b1640ca870a1dc3343ca3a 2026-03-13 12:46:14,839 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 12:46:14,852 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b1640ca870a1dc3343ca3a HTTP/1.1" 200 None 2026-03-13 12:46:14,853 - lava_callback - DEBUG - Processing node 69b1640ca870a1dc3343ca3a: baseline-arm-clabbe 2026-03-13 12:46:14,853 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b1640ca870a1dc3343ca3a 2026-03-13 12:46:14,854 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 12:46:14,873 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b1640ca870a1dc3343ca3a HTTP/1.1" 200 None 2026-03-13 12:46:14,875 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 12:46:14,888 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b0b4fc9d19175818251fd6 HTTP/1.1" 200 None 2026-03-13 12:46:14,890 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 12:46:14,911 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b1640ca870a1dc3343ca3a HTTP/1.1" 200 None 2026-03-13 12:46:14,913 - lava_callback - ERROR - Error processing callback for node 69b1640ca870a1dc3343ca3a: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:50582 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:50584 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50586 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53726 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38852 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50558 - "GET / HTTP/1.0" 200 OK 2026-03-13 12:46:54,844 - lava_callback - INFO - Received callback for node 69b16430a870a1dc3343ca4b INFO: 172.21.0.1:47206 - "POST /node/69b16430a870a1dc3343ca4b HTTP/1.0" 202 Accepted 2026-03-13 12:46:54,849 - lava_callback - INFO - Starting async job submit for node 69b16430a870a1dc3343ca4b 2026-03-13 12:46:54,850 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 12:46:54,873 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b16430a870a1dc3343ca4b HTTP/1.1" 200 None 2026-03-13 12:46:54,874 - lava_callback - DEBUG - Processing node 69b16430a870a1dc3343ca4b: baseline-arm-clabbe 2026-03-13 12:46:54,875 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b16430a870a1dc3343ca4b 2026-03-13 12:46:54,875 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 12:46:54,926 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b16430a870a1dc3343ca4b HTTP/1.1" 200 None 2026-03-13 12:46:54,928 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 12:46:54,942 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b0b4fc9d19175818251fd6 HTTP/1.1" 200 None 2026-03-13 12:46:54,943 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 12:46:54,964 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b16430a870a1dc3343ca4b HTTP/1.1" 200 None 2026-03-13 12:46:54,966 - lava_callback - ERROR - Error processing callback for node 69b16430a870a1dc3343ca4b: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:47220 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52826 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37692 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:37696 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37712 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47620 - "GET / HTTP/1.0" 200 OK 2026-03-13 12:47:34,919 - lava_callback - INFO - Received callback for node 69b16455a870a1dc3343ca54 INFO: 172.21.0.1:49992 - "POST /node/69b16455a870a1dc3343ca54 HTTP/1.0" 202 Accepted 2026-03-13 12:47:34,925 - lava_callback - INFO - Starting async job submit for node 69b16455a870a1dc3343ca54 2026-03-13 12:47:34,926 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 12:47:34,941 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b16455a870a1dc3343ca54 HTTP/1.1" 200 None 2026-03-13 12:47:34,942 - lava_callback - DEBUG - Processing node 69b16455a870a1dc3343ca54: baseline-arm-clabbe 2026-03-13 12:47:34,943 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b16455a870a1dc3343ca54 2026-03-13 12:47:34,943 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 12:47:34,957 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b16455a870a1dc3343ca54 HTTP/1.1" 200 None 2026-03-13 12:47:34,959 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 12:47:34,973 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b0b4fc9d19175818251fd6 HTTP/1.1" 200 None 2026-03-13 12:47:34,975 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 12:47:35,006 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b16455a870a1dc3343ca54 HTTP/1.1" 200 None 2026-03-13 12:47:35,022 - lava_callback - ERROR - Error processing callback for node 69b16455a870a1dc3343ca54: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:50000 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56946 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57330 - "GET / HTTP/1.0" 200 OK 2026-03-13 12:48:05,663 - lava_callback - INFO - Received callback for node 69b16474a870a1dc3343ca62 INFO: 172.21.0.1:37840 - "POST /node/69b16474a870a1dc3343ca62 HTTP/1.0" 202 Accepted 2026-03-13 12:48:05,668 - lava_callback - INFO - Starting async job submit for node 69b16474a870a1dc3343ca62 2026-03-13 12:48:05,669 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 12:48:05,684 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b16474a870a1dc3343ca62 HTTP/1.1" 200 None 2026-03-13 12:48:05,685 - lava_callback - DEBUG - Processing node 69b16474a870a1dc3343ca62: baseline-arm-baylibre 2026-03-13 12:48:05,685 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b16474a870a1dc3343ca62 2026-03-13 12:48:05,686 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 12:48:05,720 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b16474a870a1dc3343ca62 HTTP/1.1" 200 None 2026-03-13 12:48:05,722 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 12:48:05,736 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ae11668ef4424e487b2ea2 HTTP/1.1" 200 None 2026-03-13 12:48:05,737 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 12:48:05,757 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b16474a870a1dc3343ca62 HTTP/1.1" 200 None 2026-03-13 12:48:05,763 - lava_callback - ERROR - Error processing callback for node 69b16474a870a1dc3343ca62: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:37854 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54356 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:54368 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54380 - "GET / HTTP/1.0" 200 OK 2026-03-13 12:48:25,611 - lava_callback - INFO - Received callback for node 69b16497a870a1dc3343ca85 INFO: 172.21.0.1:34276 - "POST /node/69b16497a870a1dc3343ca85 HTTP/1.0" 202 Accepted 2026-03-13 12:48:25,616 - lava_callback - INFO - Starting async job submit for node 69b16497a870a1dc3343ca85 2026-03-13 12:48:25,617 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 12:48:25,632 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b16497a870a1dc3343ca85 HTTP/1.1" 200 None 2026-03-13 12:48:25,634 - lava_callback - DEBUG - Processing node 69b16497a870a1dc3343ca85: baseline-arm-baylibre 2026-03-13 12:48:25,634 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b16497a870a1dc3343ca85 2026-03-13 12:48:25,635 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 12:48:25,652 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b16497a870a1dc3343ca85 HTTP/1.1" 200 None 2026-03-13 12:48:25,654 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 12:48:25,674 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ae11668ef4424e487b2ea2 HTTP/1.1" 200 None 2026-03-13 12:48:25,676 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 12:48:25,701 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b16497a870a1dc3343ca85 HTTP/1.1" 200 None 2026-03-13 12:48:25,710 - lava_callback - ERROR - Error processing callback for node 69b16497a870a1dc3343ca85: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:34282 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48334 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53326 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38384 - "GET / HTTP/1.0" 200 OK 2026-03-13 12:49:05,667 - lava_callback - INFO - Received callback for node 69b164bba870a1dc3343ca90 INFO: 172.21.0.1:45638 - "POST /node/69b164bba870a1dc3343ca90 HTTP/1.0" 202 Accepted 2026-03-13 12:49:05,672 - lava_callback - INFO - Starting async job submit for node 69b164bba870a1dc3343ca90 2026-03-13 12:49:05,673 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 12:49:05,687 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b164bba870a1dc3343ca90 HTTP/1.1" 200 None 2026-03-13 12:49:05,688 - lava_callback - DEBUG - Processing node 69b164bba870a1dc3343ca90: baseline-arm-baylibre 2026-03-13 12:49:05,688 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b164bba870a1dc3343ca90 2026-03-13 12:49:05,689 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 12:49:05,706 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b164bba870a1dc3343ca90 HTTP/1.1" 200 None 2026-03-13 12:49:05,707 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 12:49:05,720 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ae11668ef4424e487b2ea2 HTTP/1.1" 200 None 2026-03-13 12:49:05,722 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 12:49:05,745 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b164bba870a1dc3343ca90 HTTP/1.1" 200 None 2026-03-13 12:49:05,758 - lava_callback - ERROR - Error processing callback for node 69b164bba870a1dc3343ca90: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:45644 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34676 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:34692 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34708 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34506 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59566 - "GET / HTTP/1.0" 200 OK 2026-03-13 12:49:45,731 - lava_callback - INFO - Received callback for node 69b164dea870a1dc3343ca9f INFO: 172.21.0.1:41096 - "POST /node/69b164dea870a1dc3343ca9f HTTP/1.0" 202 Accepted 2026-03-13 12:49:45,737 - lava_callback - INFO - Starting async job submit for node 69b164dea870a1dc3343ca9f 2026-03-13 12:49:45,737 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 12:49:45,751 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b164dea870a1dc3343ca9f HTTP/1.1" 200 None 2026-03-13 12:49:45,752 - lava_callback - DEBUG - Processing node 69b164dea870a1dc3343ca9f: baseline-arm-baylibre 2026-03-13 12:49:45,753 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b164dea870a1dc3343ca9f 2026-03-13 12:49:45,753 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 12:49:45,766 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b164dea870a1dc3343ca9f HTTP/1.1" 200 None 2026-03-13 12:49:45,768 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 12:49:45,781 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aeba33feb96b28aa34a775 HTTP/1.1" 200 None 2026-03-13 12:49:45,782 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 12:49:45,809 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b164dea870a1dc3343ca9f HTTP/1.1" 200 None 2026-03-13 12:49:45,811 - lava_callback - ERROR - Error processing callback for node 69b164dea870a1dc3343ca9f: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:41108 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55624 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57750 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56386 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:56400 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56404 - "GET / HTTP/1.0" 200 OK 2026-03-13 12:50:25,751 - lava_callback - INFO - Received callback for node 69b16501a870a1dc3343caac INFO: 172.21.0.1:46400 - "POST /node/69b16501a870a1dc3343caac HTTP/1.0" 202 Accepted 2026-03-13 12:50:25,756 - lava_callback - INFO - Starting async job submit for node 69b16501a870a1dc3343caac 2026-03-13 12:50:25,757 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 12:50:25,772 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b16501a870a1dc3343caac HTTP/1.1" 200 None 2026-03-13 12:50:25,773 - lava_callback - DEBUG - Processing node 69b16501a870a1dc3343caac: baseline-arm-baylibre 2026-03-13 12:50:25,774 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b16501a870a1dc3343caac 2026-03-13 12:50:25,774 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 12:50:25,791 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b16501a870a1dc3343caac HTTP/1.1" 200 None 2026-03-13 12:50:25,793 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 12:50:25,811 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aeba33feb96b28aa34a775 HTTP/1.1" 200 None 2026-03-13 12:50:25,812 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 12:50:25,842 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b16501a870a1dc3343caac HTTP/1.1" 200 None 2026-03-13 12:50:25,844 - lava_callback - ERROR - Error processing callback for node 69b16501a870a1dc3343caac: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:46406 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50294 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37756 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59716 - "GET / HTTP/1.0" 200 OK 2026-03-13 12:51:05,782 - lava_callback - INFO - Received callback for node 69b16524a870a1dc3343cab9 INFO: 172.21.0.1:35046 - "POST /node/69b16524a870a1dc3343cab9 HTTP/1.0" 202 Accepted 2026-03-13 12:51:05,788 - lava_callback - INFO - Starting async job submit for node 69b16524a870a1dc3343cab9 2026-03-13 12:51:05,789 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 12:51:05,806 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b16524a870a1dc3343cab9 HTTP/1.1" 200 None 2026-03-13 12:51:05,807 - lava_callback - DEBUG - Processing node 69b16524a870a1dc3343cab9: baseline-arm-baylibre 2026-03-13 12:51:05,807 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b16524a870a1dc3343cab9 2026-03-13 12:51:05,808 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 12:51:05,823 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b16524a870a1dc3343cab9 HTTP/1.1" 200 None 2026-03-13 12:51:05,825 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 12:51:05,839 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aeba33feb96b28aa34a775 HTTP/1.1" 200 None 2026-03-13 12:51:05,841 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 12:51:05,873 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b16524a870a1dc3343cab9 HTTP/1.1" 200 None 2026-03-13 12:51:05,875 - lava_callback - ERROR - Error processing callback for node 69b16524a870a1dc3343cab9: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:35052 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36136 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:36148 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36158 - "GET / HTTP/1.0" 200 OK 2026-03-13 12:51:25,769 - lava_callback - INFO - Received callback for node 69b16548a870a1dc3343cac3 INFO: 172.21.0.1:38250 - "POST /node/69b16548a870a1dc3343cac3 HTTP/1.0" 202 Accepted 2026-03-13 12:51:25,775 - lava_callback - INFO - Starting async job submit for node 69b16548a870a1dc3343cac3 2026-03-13 12:51:25,776 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 12:51:25,797 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b16548a870a1dc3343cac3 HTTP/1.1" 200 None 2026-03-13 12:51:25,797 - lava_callback - DEBUG - Processing node 69b16548a870a1dc3343cac3: baseline-arm-baylibre 2026-03-13 12:51:25,798 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b16548a870a1dc3343cac3 2026-03-13 12:51:25,798 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 12:51:25,811 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b16548a870a1dc3343cac3 HTTP/1.1" 200 None 2026-03-13 12:51:25,813 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 12:51:25,826 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aeba33feb96b28aa34a775 HTTP/1.1" 200 None 2026-03-13 12:51:25,828 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 12:51:25,848 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b16548a870a1dc3343cac3 HTTP/1.1" 200 None 2026-03-13 12:51:25,872 - lava_callback - ERROR - Error processing callback for node 69b16548a870a1dc3343cac3: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:38260 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50464 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45422 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38456 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45176 - "GET / HTTP/1.0" 200 OK 2026-03-13 12:52:15,102 - lava_callback - INFO - Received callback for node 69b1656da870a1dc3343cad0 INFO: 172.21.0.1:36562 - "POST /node/69b1656da870a1dc3343cad0 HTTP/1.0" 202 Accepted 2026-03-13 12:52:15,107 - lava_callback - INFO - Starting async job submit for node 69b1656da870a1dc3343cad0 2026-03-13 12:52:15,108 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 12:52:15,123 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b1656da870a1dc3343cad0 HTTP/1.1" 200 None 2026-03-13 12:52:15,124 - lava_callback - DEBUG - Processing node 69b1656da870a1dc3343cad0: baseline-arm-clabbe 2026-03-13 12:52:15,124 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b1656da870a1dc3343cad0 2026-03-13 12:52:15,125 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 12:52:15,139 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b1656da870a1dc3343cad0 HTTP/1.1" 200 None 2026-03-13 12:52:15,141 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 INFO: 172.21.0.1:36578 - "GET /api/metrics HTTP/1.0" 200 OK 2026-03-13 12:52:15,176 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aeba33feb96b28aa34a775 HTTP/1.1" 200 None 2026-03-13 12:52:15,177 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 12:52:15,209 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b1656da870a1dc3343cad0 HTTP/1.1" 200 None 2026-03-13 12:52:15,216 - lava_callback - ERROR - Error processing callback for node 69b1656da870a1dc3343cad0: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:36582 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36584 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46308 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60140 - "GET / HTTP/1.0" 200 OK 2026-03-13 12:52:45,902 - lava_callback - INFO - Received callback for node 69b1658fa870a1dc3343cada INFO: 172.21.0.1:43530 - "POST /node/69b1658fa870a1dc3343cada HTTP/1.0" 202 Accepted 2026-03-13 12:52:45,908 - lava_callback - INFO - Starting async job submit for node 69b1658fa870a1dc3343cada 2026-03-13 12:52:45,908 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 12:52:45,923 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b1658fa870a1dc3343cada HTTP/1.1" 200 None 2026-03-13 12:52:45,924 - lava_callback - DEBUG - Processing node 69b1658fa870a1dc3343cada: baseline-arm-baylibre 2026-03-13 12:52:45,924 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b1658fa870a1dc3343cada 2026-03-13 12:52:45,925 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 12:52:45,937 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b1658fa870a1dc3343cada HTTP/1.1" 200 None 2026-03-13 12:52:45,939 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 12:52:45,957 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aeba33feb96b28aa34a775 HTTP/1.1" 200 None 2026-03-13 12:52:45,958 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 12:52:45,980 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b1658fa870a1dc3343cada HTTP/1.1" 200 None 2026-03-13 12:52:45,981 - lava_callback - ERROR - Error processing callback for node 69b1658fa870a1dc3343cada: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:43546 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47924 - "GET / HTTP/1.0" 200 OK 2026-03-13 12:53:05,878 - lava_callback - INFO - Received callback for node 69b165afa870a1dc3343cae3 INFO: 172.21.0.1:58452 - "POST /node/69b165afa870a1dc3343cae3 HTTP/1.0" 202 Accepted 2026-03-13 12:53:05,885 - lava_callback - INFO - Starting async job submit for node 69b165afa870a1dc3343cae3 2026-03-13 12:53:05,885 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 12:53:05,899 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b165afa870a1dc3343cae3 HTTP/1.1" 200 None 2026-03-13 12:53:05,900 - lava_callback - DEBUG - Processing node 69b165afa870a1dc3343cae3: baseline-arm-baylibre 2026-03-13 12:53:05,900 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b165afa870a1dc3343cae3 2026-03-13 12:53:05,901 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 12:53:05,914 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b165afa870a1dc3343cae3 HTTP/1.1" 200 None 2026-03-13 12:53:05,915 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 12:53:05,933 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ae11668ef4424e487b2ea2 HTTP/1.1" 200 None 2026-03-13 12:53:05,935 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 12:53:05,955 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b165afa870a1dc3343cae3 HTTP/1.1" 200 None 2026-03-13 12:53:05,956 - lava_callback - ERROR - Error processing callback for node 69b165afa870a1dc3343cae3: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:58464 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54138 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:54154 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54158 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45488 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53836 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40124 - "GET / HTTP/1.0" 200 OK 2026-03-13 12:53:55,220 - lava_callback - INFO - Received callback for node 69b165d6a870a1dc3343caf1 INFO: 172.21.0.1:40322 - "POST /node/69b165d6a870a1dc3343caf1 HTTP/1.0" 202 Accepted 2026-03-13 12:53:55,229 - lava_callback - INFO - Starting async job submit for node 69b165d6a870a1dc3343caf1 2026-03-13 12:53:55,230 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 12:53:55,243 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b165d6a870a1dc3343caf1 HTTP/1.1" 200 None 2026-03-13 12:53:55,244 - lava_callback - DEBUG - Processing node 69b165d6a870a1dc3343caf1: baseline-arm-clabbe 2026-03-13 12:53:55,244 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b165d6a870a1dc3343caf1 2026-03-13 12:53:55,245 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 12:53:55,262 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b165d6a870a1dc3343caf1 HTTP/1.1" 200 None 2026-03-13 12:53:55,264 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 12:53:55,277 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aeba33feb96b28aa34a775 HTTP/1.1" 200 None 2026-03-13 12:53:55,279 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 12:53:55,299 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b165d6a870a1dc3343caf1 HTTP/1.1" 200 None 2026-03-13 12:53:55,300 - lava_callback - ERROR - Error processing callback for node 69b165d6a870a1dc3343caf1: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:40326 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41742 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42112 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:42120 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42132 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38450 - "GET / HTTP/1.0" 200 OK 2026-03-13 12:54:35,215 - lava_callback - INFO - Received callback for node 69b165faa870a1dc3343cafb INFO: 172.21.0.1:47528 - "POST /node/69b165faa870a1dc3343cafb HTTP/1.0" 202 Accepted 2026-03-13 12:54:35,220 - lava_callback - INFO - Starting async job submit for node 69b165faa870a1dc3343cafb 2026-03-13 12:54:35,221 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 12:54:35,236 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b165faa870a1dc3343cafb HTTP/1.1" 200 None 2026-03-13 12:54:35,236 - lava_callback - DEBUG - Processing node 69b165faa870a1dc3343cafb: baseline-arm-clabbe 2026-03-13 12:54:35,237 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b165faa870a1dc3343cafb 2026-03-13 12:54:35,237 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 12:54:35,252 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b165faa870a1dc3343cafb HTTP/1.1" 200 None 2026-03-13 12:54:35,253 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 12:54:35,281 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aeba33feb96b28aa34a775 HTTP/1.1" 200 None 2026-03-13 12:54:35,283 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 12:54:35,311 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b165faa870a1dc3343cafb HTTP/1.1" 200 None 2026-03-13 12:54:35,312 - lava_callback - ERROR - Error processing callback for node 69b165faa870a1dc3343cafb: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:47538 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37102 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33970 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54400 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56042 - "GET /api/metrics HTTP/1.0" 200 OK 2026-03-13 12:55:15,203 - lava_callback - INFO - Received callback for node 69b1661ea870a1dc3343cb08 INFO: 172.21.0.1:56052 - "POST /node/69b1661ea870a1dc3343cb08 HTTP/1.0" 202 Accepted 2026-03-13 12:55:15,209 - lava_callback - INFO - Starting async job submit for node 69b1661ea870a1dc3343cb08 2026-03-13 12:55:15,210 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 12:55:15,226 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b1661ea870a1dc3343cb08 HTTP/1.1" 200 None 2026-03-13 12:55:15,227 - lava_callback - DEBUG - Processing node 69b1661ea870a1dc3343cb08: baseline-arm-clabbe 2026-03-13 12:55:15,227 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b1661ea870a1dc3343cb08 2026-03-13 12:55:15,228 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 12:55:15,241 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b1661ea870a1dc3343cb08 HTTP/1.1" 200 None 2026-03-13 12:55:15,242 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 12:55:15,259 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aeba33feb96b28aa34a775 HTTP/1.1" 200 None 2026-03-13 12:55:15,260 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 12:55:15,286 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b1661ea870a1dc3343cb08 HTTP/1.1" 200 None 2026-03-13 12:55:15,287 - lava_callback - ERROR - Error processing callback for node 69b1661ea870a1dc3343cb08: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:56054 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56064 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56300 - "GET / HTTP/1.0" 200 OK 2026-03-13 12:55:35,260 - lava_callback - INFO - Received callback for node 69b16642a870a1dc3343cb16 INFO: 172.21.0.1:52404 - "POST /node/69b16642a870a1dc3343cb16 HTTP/1.0" 202 Accepted 2026-03-13 12:55:35,265 - lava_callback - INFO - Starting async job submit for node 69b16642a870a1dc3343cb16 2026-03-13 12:55:35,266 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 12:55:35,282 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b16642a870a1dc3343cb16 HTTP/1.1" 200 None 2026-03-13 12:55:35,283 - lava_callback - DEBUG - Processing node 69b16642a870a1dc3343cb16: baseline-arm-clabbe 2026-03-13 12:55:35,283 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b16642a870a1dc3343cb16 2026-03-13 12:55:35,284 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 12:55:35,301 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b16642a870a1dc3343cb16 HTTP/1.1" 200 None 2026-03-13 12:55:35,303 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 12:55:35,316 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aeba33feb96b28aa34a775 HTTP/1.1" 200 None 2026-03-13 12:55:35,317 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 12:55:35,342 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b16642a870a1dc3343cb16 HTTP/1.1" 200 None 2026-03-13 12:55:35,349 - lava_callback - ERROR - Error processing callback for node 69b16642a870a1dc3343cb16: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:52416 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59046 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59614 - "GET / HTTP/1.0" 200 OK 2026-03-13 12:56:06,087 - lava_callback - INFO - Received callback for node 69b16661a870a1dc3343cb20 INFO: 172.21.0.1:50868 - "POST /node/69b16661a870a1dc3343cb20 HTTP/1.0" 202 Accepted 2026-03-13 12:56:06,093 - lava_callback - INFO - Starting async job submit for node 69b16661a870a1dc3343cb20 2026-03-13 12:56:06,094 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 12:56:06,107 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b16661a870a1dc3343cb20 HTTP/1.1" 200 None 2026-03-13 12:56:06,108 - lava_callback - DEBUG - Processing node 69b16661a870a1dc3343cb20: baseline-arm-baylibre 2026-03-13 12:56:06,108 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b16661a870a1dc3343cb20 2026-03-13 12:56:06,109 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 12:56:06,122 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b16661a870a1dc3343cb20 HTTP/1.1" 200 None 2026-03-13 12:56:06,123 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 12:56:06,139 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ae11668ef4424e487b2ea2 HTTP/1.1" 200 None 2026-03-13 12:56:06,141 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 12:56:06,161 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b16661a870a1dc3343cb20 HTTP/1.1" 200 None 2026-03-13 12:56:06,162 - lava_callback - ERROR - Error processing callback for node 69b16661a870a1dc3343cb20: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:50870 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38768 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:38770 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38786 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:32986 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46404 - "GET / HTTP/1.0" 200 OK 2026-03-13 12:56:46,085 - lava_callback - INFO - Received callback for node 69b16684a870a1dc3343cb33 INFO: 172.21.0.1:47080 - "POST /node/69b16684a870a1dc3343cb33 HTTP/1.0" 202 Accepted 2026-03-13 12:56:46,092 - lava_callback - INFO - Starting async job submit for node 69b16684a870a1dc3343cb33 2026-03-13 12:56:46,092 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 12:56:46,107 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b16684a870a1dc3343cb33 HTTP/1.1" 200 None 2026-03-13 12:56:46,108 - lava_callback - DEBUG - Processing node 69b16684a870a1dc3343cb33: baseline-arm-baylibre 2026-03-13 12:56:46,108 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b16684a870a1dc3343cb33 2026-03-13 12:56:46,109 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 12:56:46,133 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b16684a870a1dc3343cb33 HTTP/1.1" 200 None 2026-03-13 12:56:46,134 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 12:56:46,148 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ae11668ef4424e487b2ea2 HTTP/1.1" 200 None 2026-03-13 12:56:46,149 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 12:56:46,170 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b16684a870a1dc3343cb33 HTTP/1.1" 200 None 2026-03-13 12:56:46,171 - lava_callback - ERROR - Error processing callback for node 69b16684a870a1dc3343cb33: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:47094 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55178 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60904 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42626 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:42630 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42636 - "GET / HTTP/1.0" 200 OK 2026-03-13 12:57:26,146 - lava_callback - INFO - Received callback for node 69b166a8a870a1dc3343cb3b INFO: 172.21.0.1:44210 - "POST /node/69b166a8a870a1dc3343cb3b HTTP/1.0" 202 Accepted 2026-03-13 12:57:26,152 - lava_callback - INFO - Starting async job submit for node 69b166a8a870a1dc3343cb3b 2026-03-13 12:57:26,153 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 12:57:26,167 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b166a8a870a1dc3343cb3b HTTP/1.1" 200 None 2026-03-13 12:57:26,168 - lava_callback - DEBUG - Processing node 69b166a8a870a1dc3343cb3b: baseline-arm-baylibre 2026-03-13 12:57:26,168 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b166a8a870a1dc3343cb3b 2026-03-13 12:57:26,169 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 12:57:26,182 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b166a8a870a1dc3343cb3b HTTP/1.1" 200 None 2026-03-13 12:57:26,183 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 12:57:26,196 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ae11668ef4424e487b2ea2 HTTP/1.1" 200 None 2026-03-13 12:57:26,198 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 12:57:26,222 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b166a8a870a1dc3343cb3b HTTP/1.1" 200 None 2026-03-13 12:57:26,224 - lava_callback - ERROR - Error processing callback for node 69b166a8a870a1dc3343cb3b: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:44226 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34810 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45248 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50352 - "GET / HTTP/1.0" 200 OK 2026-03-13 12:58:06,132 - lava_callback - INFO - Received callback for node 69b166cca870a1dc3343cb48 INFO: 172.21.0.1:58620 - "POST /node/69b166cca870a1dc3343cb48 HTTP/1.0" 202 Accepted 2026-03-13 12:58:06,138 - lava_callback - INFO - Starting async job submit for node 69b166cca870a1dc3343cb48 2026-03-13 12:58:06,139 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 12:58:06,162 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b166cca870a1dc3343cb48 HTTP/1.1" 200 None 2026-03-13 12:58:06,163 - lava_callback - DEBUG - Processing node 69b166cca870a1dc3343cb48: baseline-arm-baylibre 2026-03-13 12:58:06,163 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b166cca870a1dc3343cb48 2026-03-13 12:58:06,164 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 12:58:06,177 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b166cca870a1dc3343cb48 HTTP/1.1" 200 None 2026-03-13 12:58:06,178 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 12:58:06,192 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ae11668ef4424e487b2ea2 HTTP/1.1" 200 None 2026-03-13 12:58:06,193 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 12:58:06,213 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b166cca870a1dc3343cb48 HTTP/1.1" 200 None 2026-03-13 12:58:06,217 - lava_callback - ERROR - Error processing callback for node 69b166cca870a1dc3343cb48: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:58622 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47748 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:47754 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47766 - "GET / HTTP/1.0" 200 OK 2026-03-13 12:58:26,166 - lava_callback - INFO - Received callback for node 69b166eea870a1dc3343cb56 INFO: 172.21.0.1:45684 - "POST /node/69b166eea870a1dc3343cb56 HTTP/1.0" 202 Accepted 2026-03-13 12:58:26,172 - lava_callback - INFO - Starting async job submit for node 69b166eea870a1dc3343cb56 2026-03-13 12:58:26,172 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 12:58:26,187 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b166eea870a1dc3343cb56 HTTP/1.1" 200 None 2026-03-13 12:58:26,188 - lava_callback - DEBUG - Processing node 69b166eea870a1dc3343cb56: baseline-arm-baylibre 2026-03-13 12:58:26,188 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b166eea870a1dc3343cb56 2026-03-13 12:58:26,189 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 12:58:26,228 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b166eea870a1dc3343cb56 HTTP/1.1" 200 None 2026-03-13 12:58:26,230 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 12:58:26,243 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ae11668ef4424e487b2ea2 HTTP/1.1" 200 None 2026-03-13 12:58:26,244 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 12:58:26,265 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b166eea870a1dc3343cb56 HTTP/1.1" 200 None 2026-03-13 12:58:26,270 - lava_callback - ERROR - Error processing callback for node 69b166eea870a1dc3343cb56: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:45686 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34506 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50408 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55312 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53028 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51120 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:51122 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51130 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44218 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40368 - "GET / HTTP/1.0" 200 OK 2026-03-13 12:59:46,257 - lava_callback - INFO - Received callback for node 69b16734a870a1dc3343cb71 INFO: 172.21.0.1:38890 - "POST /node/69b16734a870a1dc3343cb71 HTTP/1.0" 202 Accepted 2026-03-13 12:59:46,263 - lava_callback - INFO - Starting async job submit for node 69b16734a870a1dc3343cb71 2026-03-13 12:59:46,263 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 12:59:46,278 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b16734a870a1dc3343cb71 HTTP/1.1" 200 None 2026-03-13 12:59:46,279 - lava_callback - DEBUG - Processing node 69b16734a870a1dc3343cb71: baseline-arm-baylibre 2026-03-13 12:59:46,279 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b16734a870a1dc3343cb71 2026-03-13 12:59:46,280 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 12:59:46,294 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b16734a870a1dc3343cb71 HTTP/1.1" 200 None 2026-03-13 12:59:46,295 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 12:59:46,320 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ae11668ef4424e487b2ea2 HTTP/1.1" 200 None 2026-03-13 12:59:46,322 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 12:59:46,351 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b16734a870a1dc3343cb71 HTTP/1.1" 200 None 2026-03-13 12:59:46,353 - lava_callback - ERROR - Error processing callback for node 69b16734a870a1dc3343cb71: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:38904 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41268 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42288 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48706 - "GET /api/metrics HTTP/1.0" 200 OK 2026-03-13 13:00:15,540 - lava_callback - INFO - Received callback for node 69b16759a870a1dc3343cb7e INFO: 172.21.0.1:48710 - "POST /node/69b16759a870a1dc3343cb7e HTTP/1.0" 202 Accepted 2026-03-13 13:00:15,545 - lava_callback - INFO - Starting async job submit for node 69b16759a870a1dc3343cb7e 2026-03-13 13:00:15,546 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 13:00:15,579 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b16759a870a1dc3343cb7e HTTP/1.1" 200 None 2026-03-13 13:00:15,580 - lava_callback - DEBUG - Processing node 69b16759a870a1dc3343cb7e: baseline-arm-clabbe 2026-03-13 13:00:15,580 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b16759a870a1dc3343cb7e 2026-03-13 13:00:15,581 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 13:00:15,596 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b16759a870a1dc3343cb7e HTTP/1.1" 200 None 2026-03-13 13:00:15,597 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 13:00:15,612 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ae11668ef4424e487b2ea2 HTTP/1.1" 200 None 2026-03-13 13:00:15,614 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 13:00:15,635 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b16759a870a1dc3343cb7e HTTP/1.1" 200 None 2026-03-13 13:00:15,636 - lava_callback - ERROR - Error processing callback for node 69b16759a870a1dc3343cb7e: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:48714 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48722 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46478 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42714 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43714 - "GET / HTTP/1.0" 200 OK 2026-03-13 13:00:55,494 - lava_callback - INFO - Received callback for node 69b1677ea870a1dc3343cb89 INFO: 172.21.0.1:52826 - "POST /node/69b1677ea870a1dc3343cb89 HTTP/1.0" 202 Accepted 2026-03-13 13:00:55,500 - lava_callback - INFO - Starting async job submit for node 69b1677ea870a1dc3343cb89 2026-03-13 13:00:55,500 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 13:00:55,537 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b1677ea870a1dc3343cb89 HTTP/1.1" 200 None 2026-03-13 13:00:55,538 - lava_callback - DEBUG - Processing node 69b1677ea870a1dc3343cb89: baseline-arm-clabbe 2026-03-13 13:00:55,538 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b1677ea870a1dc3343cb89 2026-03-13 13:00:55,539 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 13:00:55,571 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b1677ea870a1dc3343cb89 HTTP/1.1" 200 None 2026-03-13 13:00:55,573 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 13:00:55,586 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ae11668ef4424e487b2ea2 HTTP/1.1" 200 None 2026-03-13 13:00:55,587 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 13:00:55,610 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b1677ea870a1dc3343cb89 HTTP/1.1" 200 None 2026-03-13 13:00:55,615 - lava_callback - ERROR - Error processing callback for node 69b1677ea870a1dc3343cb89: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:52840 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43124 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48450 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:48452 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48462 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39920 - "GET / HTTP/1.0" 200 OK 2026-03-13 13:01:31,690 - lava_callback - INFO - Received callback for node 69b3cffe1727ff69d6f22551 INFO: 172.21.0.1:55398 - "POST /node/69b3cffe1727ff69d6f22551 HTTP/1.0" 202 Accepted 2026-03-13 13:01:31,696 - lava_callback - INFO - Starting async job submit for node 69b3cffe1727ff69d6f22551 2026-03-13 13:01:31,718 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 13:01:31,749 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b3cffe1727ff69d6f22551 HTTP/1.1" 200 None 2026-03-13 13:01:31,750 - lava_callback - DEBUG - Processing node 69b3cffe1727ff69d6f22551: baseline-arm64-broonie 2026-03-13 13:01:31,976 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-13 13:01:32,177 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-13 13:01:32,179 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69b3cffe1727ff69d6f22551/log.txt.gz 2026-03-13 13:01:32,316 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-13 13:01:32,536 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-13 13:01:32,538 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69b3cffe1727ff69d6f22551/lava-logs.yaml 2026-03-13 13:01:32,544 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-13 13:01:32,708 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-13 13:01:32,710 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69b3cffe1727ff69d6f22551/lava_callback.json.gz 2026-03-13 13:01:32,733 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 13:01:32,749 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b3cffe1727ff69d6f22551 HTTP/1.1" 200 None 2026-03-13 13:01:32,751 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 13:01:32,767 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b3c8061727ff69d6f21d98 HTTP/1.1" 200 None 2026-03-13 13:01:32,769 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 13:01:32,803 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b3cffe1727ff69d6f22551 HTTP/1.1" 200 None 2026-03-13 13:01:32,806 - lava_callback - INFO - Completed processing callback for node 69b3cffe1727ff69d6f22551 2026-03-13 13:01:35,525 - lava_callback - INFO - Received callback for node 69b167a3a870a1dc3343cb99 INFO: 172.21.0.1:55402 - "POST /node/69b167a3a870a1dc3343cb99 HTTP/1.0" 202 Accepted 2026-03-13 13:01:35,531 - lava_callback - INFO - Starting async job submit for node 69b167a3a870a1dc3343cb99 2026-03-13 13:01:35,532 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 13:01:35,546 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b167a3a870a1dc3343cb99 HTTP/1.1" 200 None 2026-03-13 13:01:35,547 - lava_callback - DEBUG - Processing node 69b167a3a870a1dc3343cb99: baseline-arm-clabbe 2026-03-13 13:01:35,548 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b167a3a870a1dc3343cb99 2026-03-13 13:01:35,548 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 13:01:35,562 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b167a3a870a1dc3343cb99 HTTP/1.1" 200 None 2026-03-13 13:01:35,563 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 13:01:35,576 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ae11668ef4424e487b2ea2 HTTP/1.1" 200 None 2026-03-13 13:01:35,578 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 13:01:35,599 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b167a3a870a1dc3343cb99 HTTP/1.1" 200 None 2026-03-13 13:01:35,601 - lava_callback - ERROR - Error processing callback for node 69b167a3a870a1dc3343cb99: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:55406 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58500 - "GET / HTTP/1.0" 200 OK 2026-03-13 13:01:52,116 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 13:01:52,132 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:49350 - "GET / HTTP/1.0" 200 OK 2026-03-13 13:02:06,448 - lava_callback - INFO - Received callback for node 69b167c5a870a1dc3343cba9 INFO: 172.21.0.1:47282 - "POST /node/69b167c5a870a1dc3343cba9 HTTP/1.0" 202 Accepted 2026-03-13 13:02:06,454 - lava_callback - INFO - Starting async job submit for node 69b167c5a870a1dc3343cba9 2026-03-13 13:02:06,455 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 13:02:06,470 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b167c5a870a1dc3343cba9 HTTP/1.1" 200 None 2026-03-13 13:02:06,471 - lava_callback - DEBUG - Processing node 69b167c5a870a1dc3343cba9: baseline-arm-baylibre 2026-03-13 13:02:06,471 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b167c5a870a1dc3343cba9 2026-03-13 13:02:06,472 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 13:02:06,509 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b167c5a870a1dc3343cba9 HTTP/1.1" 200 None INFO: 172.21.0.1:47290 - "GET / HTTP/1.0" 200 OK 2026-03-13 13:02:06,512 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 13:02:06,540 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ae11668ef4424e487b2ea2 HTTP/1.1" 200 None 2026-03-13 13:02:06,541 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 13:02:06,563 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b167c5a870a1dc3343cba9 HTTP/1.1" 200 None 2026-03-13 13:02:06,565 - lava_callback - ERROR - Error processing callback for node 69b167c5a870a1dc3343cba9: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:34476 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:34486 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34500 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42392 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36198 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47882 - "GET / HTTP/1.0" 200 OK 2026-03-13 13:02:55,572 - lava_callback - INFO - Received callback for node 69b167eaa870a1dc3343cbb9 INFO: 172.21.0.1:56426 - "POST /node/69b167eaa870a1dc3343cbb9 HTTP/1.0" 202 Accepted 2026-03-13 13:02:55,577 - lava_callback - INFO - Starting async job submit for node 69b167eaa870a1dc3343cbb9 2026-03-13 13:02:55,578 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 13:02:55,605 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b167eaa870a1dc3343cbb9 HTTP/1.1" 200 None 2026-03-13 13:02:55,606 - lava_callback - DEBUG - Processing node 69b167eaa870a1dc3343cbb9: baseline-arm-clabbe 2026-03-13 13:02:55,606 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b167eaa870a1dc3343cbb9 2026-03-13 13:02:55,606 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 13:02:55,619 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b167eaa870a1dc3343cbb9 HTTP/1.1" 200 None 2026-03-13 13:02:55,621 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 13:02:55,634 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ae11668ef4424e487b2ea2 HTTP/1.1" 200 None 2026-03-13 13:02:55,635 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 13:02:55,660 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b167eaa870a1dc3343cbb9 HTTP/1.1" 200 None 2026-03-13 13:02:55,669 - lava_callback - ERROR - Error processing callback for node 69b167eaa870a1dc3343cbb9: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:56440 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39742 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54408 - "GET /api/metrics HTTP/1.0" 200 OK 2026-03-13 13:03:15,596 - lava_callback - INFO - Received callback for node 69b1680ea870a1dc3343cbc7 INFO: 172.21.0.1:54410 - "POST /node/69b1680ea870a1dc3343cbc7 HTTP/1.0" 202 Accepted 2026-03-13 13:03:15,602 - lava_callback - INFO - Starting async job submit for node 69b1680ea870a1dc3343cbc7 2026-03-13 13:03:15,602 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 13:03:15,617 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b1680ea870a1dc3343cbc7 HTTP/1.1" 200 None 2026-03-13 13:03:15,618 - lava_callback - DEBUG - Processing node 69b1680ea870a1dc3343cbc7: baseline-arm-clabbe 2026-03-13 13:03:15,618 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b1680ea870a1dc3343cbc7 2026-03-13 13:03:15,619 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 13:03:15,639 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b1680ea870a1dc3343cbc7 HTTP/1.1" 200 None 2026-03-13 13:03:15,640 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 13:03:15,654 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ae11668ef4424e487b2ea2 HTTP/1.1" 200 None 2026-03-13 13:03:15,656 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 13:03:15,676 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b1680ea870a1dc3343cbc7 HTTP/1.1" 200 None 2026-03-13 13:03:15,677 - lava_callback - ERROR - Error processing callback for node 69b1680ea870a1dc3343cbc7: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:54416 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54432 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48930 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54436 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34612 - "GET / HTTP/1.0" 200 OK 2026-03-13 13:03:55,613 - lava_callback - INFO - Received callback for node 69b16832a870a1dc3343cbd3 INFO: 172.21.0.1:53940 - "POST /node/69b16832a870a1dc3343cbd3 HTTP/1.0" 202 Accepted 2026-03-13 13:03:55,618 - lava_callback - INFO - Starting async job submit for node 69b16832a870a1dc3343cbd3 2026-03-13 13:03:55,619 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 13:03:55,633 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b16832a870a1dc3343cbd3 HTTP/1.1" 200 None 2026-03-13 13:03:55,634 - lava_callback - DEBUG - Processing node 69b16832a870a1dc3343cbd3: baseline-arm-clabbe 2026-03-13 13:03:55,634 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b16832a870a1dc3343cbd3 2026-03-13 13:03:55,635 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 13:03:55,670 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b16832a870a1dc3343cbd3 HTTP/1.1" 200 None 2026-03-13 13:03:55,671 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 13:03:55,684 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ae11668ef4424e487b2ea2 HTTP/1.1" 200 None 2026-03-13 13:03:55,685 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 13:03:55,706 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b16832a870a1dc3343cbd3 HTTP/1.1" 200 None 2026-03-13 13:03:55,710 - lava_callback - ERROR - Error processing callback for node 69b16832a870a1dc3343cbd3: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:53946 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59190 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52644 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:52646 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52656 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54212 - "GET / HTTP/1.0" 200 OK 2026-03-13 13:04:35,624 - lava_callback - INFO - Received callback for node 69b16855a870a1dc3343cbdd INFO: 172.21.0.1:58446 - "POST /node/69b16855a870a1dc3343cbdd HTTP/1.0" 202 Accepted 2026-03-13 13:04:35,629 - lava_callback - INFO - Starting async job submit for node 69b16855a870a1dc3343cbdd 2026-03-13 13:04:35,630 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 13:04:35,644 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b16855a870a1dc3343cbdd HTTP/1.1" 200 None 2026-03-13 13:04:35,645 - lava_callback - DEBUG - Processing node 69b16855a870a1dc3343cbdd: baseline-arm-clabbe 2026-03-13 13:04:35,645 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b16855a870a1dc3343cbdd 2026-03-13 13:04:35,646 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 13:04:35,660 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b16855a870a1dc3343cbdd HTTP/1.1" 200 None 2026-03-13 13:04:35,661 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 13:04:35,674 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ae11668ef4424e487b2ea2 HTTP/1.1" 200 None 2026-03-13 13:04:35,675 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 13:04:35,696 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b16855a870a1dc3343cbdd HTTP/1.1" 200 None 2026-03-13 13:04:35,697 - lava_callback - ERROR - Error processing callback for node 69b16855a870a1dc3343cbdd: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:58460 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57448 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54450 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50202 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41154 - "GET /api/metrics HTTP/1.0" 200 OK 2026-03-13 13:05:15,629 - lava_callback - INFO - Received callback for node 69b16879a870a1dc3343cbe9 INFO: 172.21.0.1:41166 - "POST /node/69b16879a870a1dc3343cbe9 HTTP/1.0" 202 Accepted 2026-03-13 13:05:15,634 - lava_callback - INFO - Starting async job submit for node 69b16879a870a1dc3343cbe9 2026-03-13 13:05:15,635 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 13:05:15,649 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b16879a870a1dc3343cbe9 HTTP/1.1" 200 None 2026-03-13 13:05:15,650 - lava_callback - DEBUG - Processing node 69b16879a870a1dc3343cbe9: baseline-arm-clabbe 2026-03-13 13:05:15,651 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b16879a870a1dc3343cbe9 2026-03-13 13:05:15,651 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 13:05:15,665 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b16879a870a1dc3343cbe9 HTTP/1.1" 200 None 2026-03-13 13:05:15,667 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 13:05:15,681 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ae11668ef4424e487b2ea2 HTTP/1.1" 200 None 2026-03-13 13:05:15,683 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 13:05:15,705 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b16879a870a1dc3343cbe9 HTTP/1.1" 200 None 2026-03-13 13:05:15,716 - lava_callback - ERROR - Error processing callback for node 69b16879a870a1dc3343cbe9: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:41172 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41174 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33864 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52198 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34494 - "GET / HTTP/1.0" 200 OK 2026-03-13 13:05:55,667 - lava_callback - INFO - Received callback for node 69b1689da870a1dc3343cbf6 INFO: 172.21.0.1:35310 - "POST /node/69b1689da870a1dc3343cbf6 HTTP/1.0" 202 Accepted 2026-03-13 13:05:55,672 - lava_callback - INFO - Starting async job submit for node 69b1689da870a1dc3343cbf6 2026-03-13 13:05:55,673 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 13:05:55,691 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b1689da870a1dc3343cbf6 HTTP/1.1" 200 None 2026-03-13 13:05:55,691 - lava_callback - DEBUG - Processing node 69b1689da870a1dc3343cbf6: baseline-arm-clabbe 2026-03-13 13:05:55,692 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b1689da870a1dc3343cbf6 2026-03-13 13:05:55,692 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 13:05:55,706 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b1689da870a1dc3343cbf6 HTTP/1.1" 200 None 2026-03-13 13:05:55,707 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 13:05:55,720 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ae11668ef4424e487b2ea2 HTTP/1.1" 200 None 2026-03-13 13:05:55,722 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 13:05:55,741 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b1689da870a1dc3343cbf6 HTTP/1.1" 200 None 2026-03-13 13:05:55,749 - lava_callback - ERROR - Error processing callback for node 69b1689da870a1dc3343cbf6: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:35320 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34892 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52618 - "GET /api/metrics HTTP/1.0" 200 OK 2026-03-13 13:06:15,710 - lava_callback - INFO - Received callback for node 69b168c2a870a1dc3343cc04 INFO: 172.21.0.1:52628 - "POST /node/69b168c2a870a1dc3343cc04 HTTP/1.0" 202 Accepted 2026-03-13 13:06:15,715 - lava_callback - INFO - Starting async job submit for node 69b168c2a870a1dc3343cc04 2026-03-13 13:06:15,716 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 13:06:15,757 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b168c2a870a1dc3343cc04 HTTP/1.1" 200 None 2026-03-13 13:06:15,758 - lava_callback - DEBUG - Processing node 69b168c2a870a1dc3343cc04: baseline-arm-clabbe 2026-03-13 13:06:15,759 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b168c2a870a1dc3343cc04 2026-03-13 13:06:15,759 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 13:06:15,775 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b168c2a870a1dc3343cc04 HTTP/1.1" 200 None 2026-03-13 13:06:15,777 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 13:06:15,792 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ae11668ef4424e487b2ea2 HTTP/1.1" 200 None 2026-03-13 13:06:15,794 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 13:06:15,841 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b168c2a870a1dc3343cc04 HTTP/1.1" 200 None 2026-03-13 13:06:15,844 - lava_callback - ERROR - Error processing callback for node 69b168c2a870a1dc3343cc04: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:52630 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52642 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53606 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52972 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44978 - "GET / HTTP/1.0" 200 OK 2026-03-13 13:06:55,731 - lava_callback - INFO - Received callback for node 69b168e6a870a1dc3343cc0e INFO: 172.21.0.1:56986 - "POST /node/69b168e6a870a1dc3343cc0e HTTP/1.0" 202 Accepted 2026-03-13 13:06:55,736 - lava_callback - INFO - Starting async job submit for node 69b168e6a870a1dc3343cc0e 2026-03-13 13:06:55,737 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 13:06:55,753 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b168e6a870a1dc3343cc0e HTTP/1.1" 200 None 2026-03-13 13:06:55,754 - lava_callback - DEBUG - Processing node 69b168e6a870a1dc3343cc0e: baseline-arm-clabbe 2026-03-13 13:06:55,754 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b168e6a870a1dc3343cc0e 2026-03-13 13:06:55,755 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 13:06:55,773 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b168e6a870a1dc3343cc0e HTTP/1.1" 200 None 2026-03-13 13:06:55,775 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 13:06:55,789 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ae11668ef4424e487b2ea2 HTTP/1.1" 200 None 2026-03-13 13:06:55,791 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 13:06:55,817 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b168e6a870a1dc3343cc0e HTTP/1.1" 200 None 2026-03-13 13:06:55,818 - lava_callback - ERROR - Error processing callback for node 69b168e6a870a1dc3343cc0e: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:56994 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43148 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37582 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:37588 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37594 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43232 - "GET / HTTP/1.0" 200 OK 2026-03-13 13:07:35,775 - lava_callback - INFO - Received callback for node 69b1690aa870a1dc3343cc19 INFO: 172.21.0.1:59008 - "POST /node/69b1690aa870a1dc3343cc19 HTTP/1.0" 202 Accepted 2026-03-13 13:07:35,780 - lava_callback - INFO - Starting async job submit for node 69b1690aa870a1dc3343cc19 2026-03-13 13:07:35,781 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 13:07:35,818 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b1690aa870a1dc3343cc19 HTTP/1.1" 200 None 2026-03-13 13:07:35,819 - lava_callback - DEBUG - Processing node 69b1690aa870a1dc3343cc19: baseline-arm-clabbe 2026-03-13 13:07:35,819 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b1690aa870a1dc3343cc19 2026-03-13 13:07:35,820 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 13:07:35,840 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b1690aa870a1dc3343cc19 HTTP/1.1" 200 None 2026-03-13 13:07:35,842 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 13:07:35,855 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ae11668ef4424e487b2ea2 HTTP/1.1" 200 None 2026-03-13 13:07:35,857 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 13:07:35,878 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b1690aa870a1dc3343cc19 HTTP/1.1" 200 None 2026-03-13 13:07:35,880 - lava_callback - ERROR - Error processing callback for node 69b1690aa870a1dc3343cc19: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:59010 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33732 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44732 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34408 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41522 - "GET /api/metrics HTTP/1.0" 200 OK 2026-03-13 13:08:15,792 - lava_callback - INFO - Received callback for node 69b1692fa870a1dc3343cc2c INFO: 172.21.0.1:41534 - "POST /node/69b1692fa870a1dc3343cc2c HTTP/1.0" 202 Accepted 2026-03-13 13:08:15,797 - lava_callback - INFO - Starting async job submit for node 69b1692fa870a1dc3343cc2c 2026-03-13 13:08:15,798 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 13:08:15,820 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b1692fa870a1dc3343cc2c HTTP/1.1" 200 None 2026-03-13 13:08:15,821 - lava_callback - DEBUG - Processing node 69b1692fa870a1dc3343cc2c: baseline-arm-clabbe 2026-03-13 13:08:15,821 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b1692fa870a1dc3343cc2c 2026-03-13 13:08:15,822 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 13:08:15,846 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b1692fa870a1dc3343cc2c HTTP/1.1" 200 None 2026-03-13 13:08:15,847 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 13:08:15,860 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ae11668ef4424e487b2ea2 HTTP/1.1" 200 None 2026-03-13 13:08:15,862 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 13:08:15,882 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b1692fa870a1dc3343cc2c HTTP/1.1" 200 None 2026-03-13 13:08:15,884 - lava_callback - ERROR - Error processing callback for node 69b1692fa870a1dc3343cc2c: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:41544 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41558 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60706 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46316 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35252 - "GET / HTTP/1.0" 200 OK 2026-03-13 13:08:55,858 - lava_callback - INFO - Received callback for node 69b16953a870a1dc3343cc3b INFO: 172.21.0.1:40532 - "POST /node/69b16953a870a1dc3343cc3b HTTP/1.0" 202 Accepted 2026-03-13 13:08:55,864 - lava_callback - INFO - Starting async job submit for node 69b16953a870a1dc3343cc3b 2026-03-13 13:08:55,864 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 13:08:55,879 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b16953a870a1dc3343cc3b HTTP/1.1" 200 None 2026-03-13 13:08:55,880 - lava_callback - DEBUG - Processing node 69b16953a870a1dc3343cc3b: baseline-arm-clabbe 2026-03-13 13:08:55,880 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b16953a870a1dc3343cc3b 2026-03-13 13:08:55,881 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 13:08:55,894 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b16953a870a1dc3343cc3b HTTP/1.1" 200 None 2026-03-13 13:08:55,895 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 13:08:55,909 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ae11668ef4424e487b2ea2 HTTP/1.1" 200 None 2026-03-13 13:08:55,911 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 13:08:55,931 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b16953a870a1dc3343cc3b HTTP/1.1" 200 None 2026-03-13 13:08:55,932 - lava_callback - ERROR - Error processing callback for node 69b16953a870a1dc3343cc3b: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:40548 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49790 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37768 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:37772 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37780 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60724 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35422 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46048 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60790 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40762 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43226 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:43232 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43248 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57510 - "GET / HTTP/1.0" 200 OK 2026-03-13 13:10:35,944 - lava_callback - INFO - Received callback for node 69b169c1a870a1dc3343cc4f INFO: 172.21.0.1:49300 - "POST /node/69b169c1a870a1dc3343cc4f HTTP/1.0" 202 Accepted 2026-03-13 13:10:35,949 - lava_callback - INFO - Starting async job submit for node 69b169c1a870a1dc3343cc4f 2026-03-13 13:10:35,950 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 13:10:35,965 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b169c1a870a1dc3343cc4f HTTP/1.1" 200 None 2026-03-13 13:10:35,966 - lava_callback - DEBUG - Processing node 69b169c1a870a1dc3343cc4f: baseline-arm-clabbe 2026-03-13 13:10:35,966 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b169c1a870a1dc3343cc4f 2026-03-13 13:10:35,966 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 13:10:35,979 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b169c1a870a1dc3343cc4f HTTP/1.1" 200 None 2026-03-13 13:10:35,981 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 13:10:35,995 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ae11668ef4424e487b2ea2 HTTP/1.1" 200 None 2026-03-13 13:10:35,997 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 13:10:36,019 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b169c1a870a1dc3343cc4f HTTP/1.1" 200 None 2026-03-13 13:10:36,030 - lava_callback - ERROR - Error processing callback for node 69b169c1a870a1dc3343cc4f: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:49312 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34884 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57332 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57560 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40160 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:40176 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40178 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41656 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33750 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40590 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38486 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37096 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42430 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:42432 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42448 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48330 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60930 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60942 - "GET /node/69944f565ae459b9df3dcef7%5Cn HTTP/1.0" 405 Method Not Allowed INFO: 172.21.0.1:59102 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40910 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36634 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37230 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:37246 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37260 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34356 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34652 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42834 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39592 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50368 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33362 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:33374 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33380 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54040 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49844 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56614 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39784 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58582 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46742 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:46750 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46762 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55954 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40910 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33880 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55956 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43696 - "GET / HTTP/1.0" 200 OK 2026-03-13 13:16:07,245 - lava_callback - INFO - Received callback for node 69b16b13a870a1dc3343cc87 INFO: 172.21.0.1:43700 - "POST /node/69b16b13a870a1dc3343cc87 HTTP/1.0" 202 Accepted 2026-03-13 13:16:07,251 - lava_callback - INFO - Starting async job submit for node 69b16b13a870a1dc3343cc87 2026-03-13 13:16:07,252 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 13:16:07,266 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b16b13a870a1dc3343cc87 HTTP/1.1" 200 None 2026-03-13 13:16:07,267 - lava_callback - DEBUG - Processing node 69b16b13a870a1dc3343cc87: baseline-arm64-baylibre 2026-03-13 13:16:07,268 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b16b13a870a1dc3343cc87 2026-03-13 13:16:07,268 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 13:16:07,281 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b16b13a870a1dc3343cc87 HTTP/1.1" 200 None 2026-03-13 13:16:07,282 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 13:16:07,303 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b0b5149d19175818251feb HTTP/1.1" 200 None 2026-03-13 13:16:07,305 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 13:16:07,325 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b16b13a870a1dc3343cc87 HTTP/1.1" 200 None 2026-03-13 13:16:07,330 - lava_callback - ERROR - Error processing callback for node 69b16b13a870a1dc3343cc87: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:41900 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:41916 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41922 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50034 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36526 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35930 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40210 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42788 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59864 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:59866 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59870 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52234 - "GET / HTTP/1.0" 200 OK 2026-03-13 13:17:36,275 - lava_callback - INFO - Received callback for node 69b16b62a870a1dc3343cc98 INFO: 172.21.0.1:57770 - "POST /node/69b16b62a870a1dc3343cc98 HTTP/1.0" 202 Accepted 2026-03-13 13:17:36,281 - lava_callback - INFO - Starting async job submit for node 69b16b62a870a1dc3343cc98 2026-03-13 13:17:36,282 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 13:17:36,295 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b16b62a870a1dc3343cc98 HTTP/1.1" 200 None 2026-03-13 13:17:36,296 - lava_callback - DEBUG - Processing node 69b16b62a870a1dc3343cc98: baseline-arm64-clabbe 2026-03-13 13:17:36,296 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b16b62a870a1dc3343cc98 2026-03-13 13:17:36,297 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 13:17:36,314 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b16b62a870a1dc3343cc98 HTTP/1.1" 200 None 2026-03-13 13:17:36,315 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 13:17:36,329 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b0b5149d19175818251feb HTTP/1.1" 200 None 2026-03-13 13:17:36,330 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 13:17:36,350 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b16b62a870a1dc3343cc98 HTTP/1.1" 200 None 2026-03-13 13:17:36,351 - lava_callback - ERROR - Error processing callback for node 69b16b62a870a1dc3343cc98: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:57778 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47374 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47428 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:32920 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58948 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:58960 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58976 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48050 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48916 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52464 - "GET / HTTP/1.0" 200 OK 2026-03-13 13:18:56,294 - lava_callback - INFO - Received callback for node 69b16bb6a870a1dc3343ccb4 INFO: 172.21.0.1:38348 - "POST /node/69b16bb6a870a1dc3343ccb4 HTTP/1.0" 202 Accepted 2026-03-13 13:18:56,300 - lava_callback - INFO - Starting async job submit for node 69b16bb6a870a1dc3343ccb4 2026-03-13 13:18:56,301 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 13:18:56,319 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b16bb6a870a1dc3343ccb4 HTTP/1.1" 200 None 2026-03-13 13:18:56,320 - lava_callback - DEBUG - Processing node 69b16bb6a870a1dc3343ccb4: baseline-arm64-clabbe 2026-03-13 13:18:56,320 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b16bb6a870a1dc3343ccb4 2026-03-13 13:18:56,321 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 13:18:56,335 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b16bb6a870a1dc3343ccb4 HTTP/1.1" 200 None 2026-03-13 13:18:56,337 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 13:18:56,350 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b0b5149d19175818251feb HTTP/1.1" 200 None 2026-03-13 13:18:56,351 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 13:18:56,372 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b16bb6a870a1dc3343ccb4 HTTP/1.1" 200 None 2026-03-13 13:18:56,382 - lava_callback - ERROR - Error processing callback for node 69b16bb6a870a1dc3343ccb4: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:38352 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55282 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34608 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:34616 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34624 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51950 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41840 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40156 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51330 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59838 - "GET / HTTP/1.0" 200 OK 2026-03-13 13:20:07,410 - lava_callback - INFO - Received callback for node 69b16bf9a870a1dc3343ccc9 INFO: 172.21.0.1:59852 - "POST /node/69b16bf9a870a1dc3343ccc9 HTTP/1.0" 202 Accepted 2026-03-13 13:20:07,416 - lava_callback - INFO - Starting async job submit for node 69b16bf9a870a1dc3343ccc9 2026-03-13 13:20:07,417 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 13:20:07,432 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b16bf9a870a1dc3343ccc9 HTTP/1.1" 200 None 2026-03-13 13:20:07,433 - lava_callback - DEBUG - Processing node 69b16bf9a870a1dc3343ccc9: baseline-arm64-baylibre 2026-03-13 13:20:07,433 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b16bf9a870a1dc3343ccc9 2026-03-13 13:20:07,434 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 13:20:07,449 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b16bf9a870a1dc3343ccc9 HTTP/1.1" 200 None 2026-03-13 13:20:07,451 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 13:20:07,468 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aeba41feb96b28aa34a78b HTTP/1.1" 200 None 2026-03-13 13:20:07,470 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 13:20:07,497 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b16bf9a870a1dc3343ccc9 HTTP/1.1" 200 None 2026-03-13 13:20:07,499 - lava_callback - ERROR - Error processing callback for node 69b16bf9a870a1dc3343ccc9: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:53806 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:53808 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53820 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60444 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39672 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58760 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50068 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33328 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55106 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:55114 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55128 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39402 - "GET / HTTP/1.0" 200 OK 2026-03-13 13:21:27,499 - lava_callback - INFO - Received callback for node 69b16c45a870a1dc3343ccd7 INFO: 172.21.0.1:39404 - "POST /node/69b16c45a870a1dc3343ccd7 HTTP/1.0" 202 Accepted 2026-03-13 13:21:27,505 - lava_callback - INFO - Starting async job submit for node 69b16c45a870a1dc3343ccd7 2026-03-13 13:21:27,506 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 13:21:27,520 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b16c45a870a1dc3343ccd7 HTTP/1.1" 200 None 2026-03-13 13:21:27,521 - lava_callback - DEBUG - Processing node 69b16c45a870a1dc3343ccd7: baseline-arm64-baylibre 2026-03-13 13:21:27,521 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b16c45a870a1dc3343ccd7 2026-03-13 13:21:27,522 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 13:21:27,535 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b16c45a870a1dc3343ccd7 HTTP/1.1" 200 None 2026-03-13 13:21:27,536 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 13:21:27,549 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aeba41feb96b28aa34a78b HTTP/1.1" 200 None 2026-03-13 13:21:27,551 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 13:21:27,604 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b16c45a870a1dc3343ccd7 HTTP/1.1" 200 None 2026-03-13 13:21:27,605 - lava_callback - ERROR - Error processing callback for node 69b16c45a870a1dc3343ccd7: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:53496 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47282 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57682 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44786 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60008 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:60024 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60040 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58114 - "GET / HTTP/1.0" 200 OK 2026-03-13 13:22:27,485 - lava_callback - INFO - Received callback for node 69b16c90a870a1dc3343ccde INFO: 172.21.0.1:58120 - "POST /node/69b16c90a870a1dc3343ccde HTTP/1.0" 202 Accepted 2026-03-13 13:22:27,490 - lava_callback - INFO - Starting async job submit for node 69b16c90a870a1dc3343ccde 2026-03-13 13:22:27,491 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 13:22:27,507 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b16c90a870a1dc3343ccde HTTP/1.1" 200 None 2026-03-13 13:22:27,508 - lava_callback - DEBUG - Processing node 69b16c90a870a1dc3343ccde: baseline-arm64-baylibre 2026-03-13 13:22:27,508 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b16c90a870a1dc3343ccde 2026-03-13 13:22:27,509 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 13:22:27,526 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b16c90a870a1dc3343ccde HTTP/1.1" 200 None 2026-03-13 13:22:27,529 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 13:22:27,549 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aeba41feb96b28aa34a78b HTTP/1.1" 200 None 2026-03-13 13:22:27,550 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 13:22:27,575 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b16c90a870a1dc3343ccde HTTP/1.1" 200 None 2026-03-13 13:22:27,576 - lava_callback - ERROR - Error processing callback for node 69b16c90a870a1dc3343ccde: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:47332 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48342 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50158 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53442 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56468 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:56480 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56488 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52996 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36770 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52832 - "GET / HTTP/1.0" 200 OK 2026-03-13 13:23:47,648 - lava_callback - INFO - Received callback for node 69b16cdfa870a1dc3343ccf0 INFO: 172.21.0.1:52846 - "POST /node/69b16cdfa870a1dc3343ccf0 HTTP/1.0" 202 Accepted 2026-03-13 13:23:47,653 - lava_callback - INFO - Starting async job submit for node 69b16cdfa870a1dc3343ccf0 2026-03-13 13:23:47,654 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 13:23:47,669 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b16cdfa870a1dc3343ccf0 HTTP/1.1" 200 None 2026-03-13 13:23:47,670 - lava_callback - DEBUG - Processing node 69b16cdfa870a1dc3343ccf0: baseline-arm64-baylibre 2026-03-13 13:23:47,670 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b16cdfa870a1dc3343ccf0 2026-03-13 13:23:47,670 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 13:23:47,683 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b16cdfa870a1dc3343ccf0 HTTP/1.1" 200 None 2026-03-13 13:23:47,685 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 13:23:47,698 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aeba41feb96b28aa34a78b HTTP/1.1" 200 None 2026-03-13 13:23:47,699 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 13:23:47,721 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b16cdfa870a1dc3343ccf0 HTTP/1.1" 200 None 2026-03-13 13:23:47,730 - lava_callback - ERROR - Error processing callback for node 69b16cdfa870a1dc3343ccf0: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:34474 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57078 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37768 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:37770 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37782 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59454 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43556 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44916 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48950 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52506 - "GET / HTTP/1.0" 200 OK 2026-03-13 13:25:07,702 - lava_callback - INFO - Received callback for node 69b16d2ca870a1dc3343ccf8 INFO: 172.21.0.1:52512 - "POST /node/69b16d2ca870a1dc3343ccf8 HTTP/1.0" 202 Accepted 2026-03-13 13:25:07,710 - lava_callback - INFO - Starting async job submit for node 69b16d2ca870a1dc3343ccf8 2026-03-13 13:25:07,710 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 13:25:07,724 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b16d2ca870a1dc3343ccf8 HTTP/1.1" 200 None 2026-03-13 13:25:07,725 - lava_callback - DEBUG - Processing node 69b16d2ca870a1dc3343ccf8: baseline-arm64-baylibre 2026-03-13 13:25:07,725 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b16d2ca870a1dc3343ccf8 2026-03-13 13:25:07,726 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 13:25:07,738 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b16d2ca870a1dc3343ccf8 HTTP/1.1" 200 None 2026-03-13 13:25:07,740 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 13:25:07,752 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aeba41feb96b28aa34a78b HTTP/1.1" 200 None 2026-03-13 13:25:07,754 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 13:25:07,775 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b16d2ca870a1dc3343ccf8 HTTP/1.1" 200 None 2026-03-13 13:25:07,781 - lava_callback - ERROR - Error processing callback for node 69b16d2ca870a1dc3343ccf8: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:37926 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:37932 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37948 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34632 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59458 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41926 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53794 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43260 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56624 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:56628 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56640 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57118 - "GET / HTTP/1.0" 200 OK 2026-03-13 13:26:27,729 - lava_callback - INFO - Received callback for node 69b16d7ba870a1dc3343cd0a INFO: 172.21.0.1:57128 - "POST /node/69b16d7ba870a1dc3343cd0a HTTP/1.0" 202 Accepted 2026-03-13 13:26:27,734 - lava_callback - INFO - Starting async job submit for node 69b16d7ba870a1dc3343cd0a 2026-03-13 13:26:27,736 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 13:26:27,750 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b16d7ba870a1dc3343cd0a HTTP/1.1" 200 None 2026-03-13 13:26:27,752 - lava_callback - DEBUG - Processing node 69b16d7ba870a1dc3343cd0a: baseline-arm64-baylibre 2026-03-13 13:26:27,752 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b16d7ba870a1dc3343cd0a 2026-03-13 13:26:27,753 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 13:26:27,768 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b16d7ba870a1dc3343cd0a HTTP/1.1" 200 None 2026-03-13 13:26:27,770 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 13:26:27,785 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aeba41feb96b28aa34a78b HTTP/1.1" 200 None 2026-03-13 13:26:27,787 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 13:26:27,811 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b16d7ba870a1dc3343cd0a HTTP/1.1" 200 None 2026-03-13 13:26:27,813 - lava_callback - ERROR - Error processing callback for node 69b16d7ba870a1dc3343cd0a: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:52144 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46738 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50540 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45410 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47064 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:47078 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47094 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46304 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33178 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50630 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33846 - "GET / HTTP/1.0" 200 OK 2026-03-13 13:27:56,690 - lava_callback - INFO - Received callback for node 69b16dcda870a1dc3343cd1e INFO: 172.21.0.1:33850 - "POST /node/69b16dcda870a1dc3343cd1e HTTP/1.0" 202 Accepted 2026-03-13 13:27:56,696 - lava_callback - INFO - Starting async job submit for node 69b16dcda870a1dc3343cd1e 2026-03-13 13:27:56,696 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 13:27:56,734 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b16dcda870a1dc3343cd1e HTTP/1.1" 200 None 2026-03-13 13:27:56,735 - lava_callback - DEBUG - Processing node 69b16dcda870a1dc3343cd1e: baseline-arm64-clabbe 2026-03-13 13:27:56,735 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b16dcda870a1dc3343cd1e 2026-03-13 13:27:56,736 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 13:27:56,749 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b16dcda870a1dc3343cd1e HTTP/1.1" 200 None 2026-03-13 13:27:56,751 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 13:27:56,764 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aeba41feb96b28aa34a78b HTTP/1.1" 200 None 2026-03-13 13:27:56,765 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 13:27:56,785 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b16dcda870a1dc3343cd1e HTTP/1.1" 200 None 2026-03-13 13:27:56,786 - lava_callback - ERROR - Error processing callback for node 69b16dcda870a1dc3343cd1e: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:41512 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41268 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:41282 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41292 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41302 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48144 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38466 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52466 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47290 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53500 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:53512 - "GET / HTTP/1.0" 200 OK 2026-03-13 13:29:16,781 - lava_callback - INFO - Received callback for node 69b16e1aa870a1dc3343cd24 INFO: 172.21.0.1:53518 - "POST /node/69b16e1aa870a1dc3343cd24 HTTP/1.0" 202 Accepted 2026-03-13 13:29:16,786 - lava_callback - INFO - Starting async job submit for node 69b16e1aa870a1dc3343cd24 2026-03-13 13:29:16,787 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 13:29:16,802 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b16e1aa870a1dc3343cd24 HTTP/1.1" 200 None 2026-03-13 13:29:16,803 - lava_callback - DEBUG - Processing node 69b16e1aa870a1dc3343cd24: baseline-arm64-clabbe 2026-03-13 13:29:16,803 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b16e1aa870a1dc3343cd24 2026-03-13 13:29:16,804 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 13:29:16,818 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b16e1aa870a1dc3343cd24 HTTP/1.1" 200 None 2026-03-13 13:29:16,819 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 13:29:16,839 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aeba41feb96b28aa34a78b HTTP/1.1" 200 None 2026-03-13 13:29:16,841 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 13:29:16,862 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b16e1aa870a1dc3343cd24 HTTP/1.1" 200 None 2026-03-13 13:29:16,863 - lava_callback - ERROR - Error processing callback for node 69b16e1aa870a1dc3343cd24: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:53520 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42222 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41398 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50678 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52602 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36308 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57778 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:57794 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57804 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38518 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52654 - "GET / HTTP/1.0" 200 OK 2026-03-13 13:30:36,786 - lava_callback - INFO - Received callback for node 69b16e67a870a1dc3343cd33 INFO: 172.21.0.1:52664 - "POST /node/69b16e67a870a1dc3343cd33 HTTP/1.0" 202 Accepted 2026-03-13 13:30:36,792 - lava_callback - INFO - Starting async job submit for node 69b16e67a870a1dc3343cd33 2026-03-13 13:30:36,793 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 13:30:36,808 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b16e67a870a1dc3343cd33 HTTP/1.1" 200 None 2026-03-13 13:30:36,809 - lava_callback - DEBUG - Processing node 69b16e67a870a1dc3343cd33: baseline-arm64-clabbe 2026-03-13 13:30:36,809 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b16e67a870a1dc3343cd33 2026-03-13 13:30:36,810 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 13:30:36,827 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b16e67a870a1dc3343cd33 HTTP/1.1" 200 None 2026-03-13 13:30:36,829 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 13:30:36,843 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aeba41feb96b28aa34a78b HTTP/1.1" 200 None 2026-03-13 13:30:36,845 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 13:30:36,879 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b16e67a870a1dc3343cd33 HTTP/1.1" 200 None 2026-03-13 13:30:36,880 - lava_callback - ERROR - Error processing callback for node 69b16e67a870a1dc3343cd33: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:37104 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52942 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45380 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39372 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:39382 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39384 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50006 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40826 - "GET / HTTP/1.0" 200 OK 2026-03-13 13:31:36,856 - lava_callback - INFO - Received callback for node 69b16eb5a870a1dc3343cd41 INFO: 172.21.0.1:40840 - "POST /node/69b16eb5a870a1dc3343cd41 HTTP/1.0" 202 Accepted 2026-03-13 13:31:36,861 - lava_callback - INFO - Starting async job submit for node 69b16eb5a870a1dc3343cd41 2026-03-13 13:31:36,862 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 13:31:36,880 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b16eb5a870a1dc3343cd41 HTTP/1.1" 200 None 2026-03-13 13:31:36,881 - lava_callback - DEBUG - Processing node 69b16eb5a870a1dc3343cd41: baseline-arm64-clabbe 2026-03-13 13:31:36,882 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b16eb5a870a1dc3343cd41 2026-03-13 13:31:36,882 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 13:31:36,897 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b16eb5a870a1dc3343cd41 HTTP/1.1" 200 None 2026-03-13 13:31:36,899 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 13:31:36,913 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aeba41feb96b28aa34a78b HTTP/1.1" 200 None 2026-03-13 13:31:36,915 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 13:31:36,963 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b16eb5a870a1dc3343cd41 HTTP/1.1" 200 None 2026-03-13 13:31:36,964 - lava_callback - ERROR - Error processing callback for node 69b16eb5a870a1dc3343cd41: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:37124 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52438 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51008 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56562 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:56576 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56582 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51878 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41468 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44460 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49530 - "GET / HTTP/1.0" 200 OK 2026-03-13 13:32:56,935 - lava_callback - INFO - Received callback for node 69b16f02a870a1dc3343cd4f INFO: 172.21.0.1:49532 - "POST /node/69b16f02a870a1dc3343cd4f HTTP/1.0" 202 Accepted 2026-03-13 13:32:56,941 - lava_callback - INFO - Starting async job submit for node 69b16f02a870a1dc3343cd4f 2026-03-13 13:32:56,941 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 13:32:56,957 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b16f02a870a1dc3343cd4f HTTP/1.1" 200 None 2026-03-13 13:32:56,958 - lava_callback - DEBUG - Processing node 69b16f02a870a1dc3343cd4f: baseline-arm64-clabbe 2026-03-13 13:32:56,958 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b16f02a870a1dc3343cd4f 2026-03-13 13:32:56,959 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 13:32:56,972 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b16f02a870a1dc3343cd4f HTTP/1.1" 200 None 2026-03-13 13:32:56,974 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 13:32:56,995 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aeba41feb96b28aa34a78b HTTP/1.1" 200 None 2026-03-13 13:32:56,996 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 13:32:57,030 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b16f02a870a1dc3343cd4f HTTP/1.1" 200 None 2026-03-13 13:32:57,031 - lava_callback - ERROR - Error processing callback for node 69b16f02a870a1dc3343cd4f: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:34710 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58418 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:58428 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58436 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33254 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40190 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39080 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56934 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57654 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51962 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:51974 - "GET / HTTP/1.0" 200 OK 2026-03-13 13:34:16,977 - lava_callback - INFO - Received callback for node 69b16f4da870a1dc3343cd5b INFO: 172.21.0.1:51976 - "POST /node/69b16f4da870a1dc3343cd5b HTTP/1.0" 202 Accepted 2026-03-13 13:34:16,982 - lava_callback - INFO - Starting async job submit for node 69b16f4da870a1dc3343cd5b 2026-03-13 13:34:16,983 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 13:34:16,997 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b16f4da870a1dc3343cd5b HTTP/1.1" 200 None 2026-03-13 13:34:16,998 - lava_callback - DEBUG - Processing node 69b16f4da870a1dc3343cd5b: baseline-arm64-clabbe 2026-03-13 13:34:16,998 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b16f4da870a1dc3343cd5b 2026-03-13 13:34:16,999 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 13:34:17,012 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b16f4da870a1dc3343cd5b HTTP/1.1" 200 None 2026-03-13 13:34:17,013 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 13:34:17,027 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aeba41feb96b28aa34a78b HTTP/1.1" 200 None 2026-03-13 13:34:17,028 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 13:34:17,049 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b16f4da870a1dc3343cd5b HTTP/1.1" 200 None 2026-03-13 13:34:17,050 - lava_callback - ERROR - Error processing callback for node 69b16f4da870a1dc3343cd5b: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:51988 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:32986 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39822 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39512 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55284 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60168 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48378 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:48392 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48402 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57094 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39014 - "GET / HTTP/1.0" 200 OK 2026-03-13 13:35:37,019 - lava_callback - INFO - Received callback for node 69b16f99a870a1dc3343cd69 INFO: 172.21.0.1:39020 - "POST /node/69b16f99a870a1dc3343cd69 HTTP/1.0" 202 Accepted 2026-03-13 13:35:37,025 - lava_callback - INFO - Starting async job submit for node 69b16f99a870a1dc3343cd69 2026-03-13 13:35:37,026 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 13:35:37,065 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b16f99a870a1dc3343cd69 HTTP/1.1" 200 None 2026-03-13 13:35:37,066 - lava_callback - DEBUG - Processing node 69b16f99a870a1dc3343cd69: baseline-arm64-clabbe 2026-03-13 13:35:37,066 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b16f99a870a1dc3343cd69 2026-03-13 13:35:37,067 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 13:35:37,080 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b16f99a870a1dc3343cd69 HTTP/1.1" 200 None 2026-03-13 13:35:37,081 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 13:35:37,095 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b0b5149d19175818251feb HTTP/1.1" 200 None 2026-03-13 13:35:37,096 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 13:35:37,116 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b16f99a870a1dc3343cd69 HTTP/1.1" 200 None 2026-03-13 13:35:37,117 - lava_callback - ERROR - Error processing callback for node 69b16f99a870a1dc3343cd69: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:34004 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53540 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35626 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45612 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:45624 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45634 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45690 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33464 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56080 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52388 - "GET / HTTP/1.0" 200 OK 2026-03-13 13:36:57,099 - lava_callback - INFO - Received callback for node 69b16fe6a870a1dc3343cd75 INFO: 172.21.0.1:52392 - "POST /node/69b16fe6a870a1dc3343cd75 HTTP/1.0" 202 Accepted 2026-03-13 13:36:57,104 - lava_callback - INFO - Starting async job submit for node 69b16fe6a870a1dc3343cd75 2026-03-13 13:36:57,105 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 13:36:57,139 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b16fe6a870a1dc3343cd75 HTTP/1.1" 200 None 2026-03-13 13:36:57,140 - lava_callback - DEBUG - Processing node 69b16fe6a870a1dc3343cd75: baseline-arm64-clabbe 2026-03-13 13:36:57,140 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b16fe6a870a1dc3343cd75 2026-03-13 13:36:57,141 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 13:36:57,166 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b16fe6a870a1dc3343cd75 HTTP/1.1" 200 None 2026-03-13 13:36:57,168 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 13:36:57,182 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b0b5149d19175818251feb HTTP/1.1" 200 None 2026-03-13 13:36:57,184 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 13:36:57,206 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b16fe6a870a1dc3343cd75 HTTP/1.1" 200 None 2026-03-13 13:36:57,212 - lava_callback - ERROR - Error processing callback for node 69b16fe6a870a1dc3343cd75: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:53268 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36614 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:36628 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36638 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53540 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40970 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35534 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46994 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42836 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49856 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:49864 - "GET / HTTP/1.0" 200 OK 2026-03-13 13:38:17,157 - lava_callback - INFO - Received callback for node 69b17033a870a1dc3343cd7f INFO: 172.21.0.1:49872 - "POST /node/69b17033a870a1dc3343cd7f HTTP/1.0" 202 Accepted 2026-03-13 13:38:17,163 - lava_callback - INFO - Starting async job submit for node 69b17033a870a1dc3343cd7f 2026-03-13 13:38:17,164 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 13:38:17,199 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b17033a870a1dc3343cd7f HTTP/1.1" 200 None 2026-03-13 13:38:17,200 - lava_callback - DEBUG - Processing node 69b17033a870a1dc3343cd7f: baseline-arm64-clabbe 2026-03-13 13:38:17,200 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b17033a870a1dc3343cd7f 2026-03-13 13:38:17,201 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 13:38:17,216 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b17033a870a1dc3343cd7f HTTP/1.1" 200 None 2026-03-13 13:38:17,218 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 13:38:17,254 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b0b5149d19175818251feb HTTP/1.1" 200 None 2026-03-13 13:38:17,256 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 13:38:17,285 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b17033a870a1dc3343cd7f HTTP/1.1" 200 None 2026-03-13 13:38:17,290 - lava_callback - ERROR - Error processing callback for node 69b17033a870a1dc3343cd7f: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:49876 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50954 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39734 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55834 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45472 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45868 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48616 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:48620 - "GET / HTTP/1.0" 200 OK 2026-03-13 13:39:17,208 - lava_callback - INFO - Received callback for node 69b1707ea870a1dc3343cd89 INFO: 172.21.0.1:48622 - "POST /node/69b1707ea870a1dc3343cd89 HTTP/1.0" 202 Accepted 2026-03-13 13:39:17,213 - lava_callback - INFO - Starting async job submit for node 69b1707ea870a1dc3343cd89 2026-03-13 13:39:17,214 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 13:39:17,229 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b1707ea870a1dc3343cd89 HTTP/1.1" 200 None 2026-03-13 13:39:17,230 - lava_callback - DEBUG - Processing node 69b1707ea870a1dc3343cd89: baseline-arm64-clabbe 2026-03-13 13:39:17,230 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b1707ea870a1dc3343cd89 2026-03-13 13:39:17,231 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 13:39:17,245 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b1707ea870a1dc3343cd89 HTTP/1.1" 200 None 2026-03-13 13:39:17,247 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 13:39:17,262 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b0b5149d19175818251feb HTTP/1.1" 200 None 2026-03-13 13:39:17,263 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 13:39:17,285 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b1707ea870a1dc3343cd89 HTTP/1.1" 200 None 2026-03-13 13:39:17,286 - lava_callback - ERROR - Error processing callback for node 69b1707ea870a1dc3343cd89: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:48626 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56750 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39518 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55650 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59584 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45804 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56056 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:56070 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56080 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57844 - "GET / HTTP/1.0" 200 OK 2026-03-13 13:40:28,631 - lava_callback - INFO - Received callback for node 69b170c2a870a1dc3343cd92 INFO: 172.21.0.1:57850 - "POST /node/69b170c2a870a1dc3343cd92 HTTP/1.0" 202 Accepted 2026-03-13 13:40:28,636 - lava_callback - INFO - Starting async job submit for node 69b170c2a870a1dc3343cd92 2026-03-13 13:40:28,637 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 13:40:28,652 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b170c2a870a1dc3343cd92 HTTP/1.1" 200 None 2026-03-13 13:40:28,652 - lava_callback - DEBUG - Processing node 69b170c2a870a1dc3343cd92: baseline-arm64-baylibre 2026-03-13 13:40:28,653 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b170c2a870a1dc3343cd92 2026-03-13 13:40:28,653 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 13:40:28,666 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b170c2a870a1dc3343cd92 HTTP/1.1" 200 None 2026-03-13 13:40:28,668 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 13:40:28,681 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ae11758ef4424e487b2eb1 HTTP/1.1" 200 None 2026-03-13 13:40:28,683 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 13:40:28,708 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b170c2a870a1dc3343cd92 HTTP/1.1" 200 None 2026-03-13 13:40:28,709 - lava_callback - ERROR - Error processing callback for node 69b170c2a870a1dc3343cd92: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:59086 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57624 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56930 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51504 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34772 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:34778 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34780 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54658 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37948 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50844 - "GET / HTTP/1.0" 200 OK 2026-03-13 13:41:48,587 - lava_callback - INFO - Received callback for node 69b1710ea870a1dc3343cd98 INFO: 172.21.0.1:50850 - "POST /node/69b1710ea870a1dc3343cd98 HTTP/1.0" 202 Accepted 2026-03-13 13:41:48,592 - lava_callback - INFO - Starting async job submit for node 69b1710ea870a1dc3343cd98 2026-03-13 13:41:48,593 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 13:41:48,608 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b1710ea870a1dc3343cd98 HTTP/1.1" 200 None 2026-03-13 13:41:48,609 - lava_callback - DEBUG - Processing node 69b1710ea870a1dc3343cd98: baseline-arm64-baylibre 2026-03-13 13:41:48,609 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b1710ea870a1dc3343cd98 2026-03-13 13:41:48,609 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 13:41:48,623 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b1710ea870a1dc3343cd98 HTTP/1.1" 200 None 2026-03-13 13:41:48,624 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 13:41:48,638 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ae11758ef4424e487b2eb1 HTTP/1.1" 200 None 2026-03-13 13:41:48,639 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 13:41:48,667 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b1710ea870a1dc3343cd98 HTTP/1.1" 200 None 2026-03-13 13:41:48,672 - lava_callback - ERROR - Error processing callback for node 69b1710ea870a1dc3343cd98: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:58566 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41590 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58006 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:58012 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58016 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42722 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36330 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39650 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51098 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60598 - "GET / HTTP/1.0" 200 OK 2026-03-13 13:43:08,626 - lava_callback - INFO - Received callback for node 69b1715aa870a1dc3343cda6 INFO: 172.21.0.1:60610 - "POST /node/69b1715aa870a1dc3343cda6 HTTP/1.0" 202 Accepted 2026-03-13 13:43:08,631 - lava_callback - INFO - Starting async job submit for node 69b1715aa870a1dc3343cda6 2026-03-13 13:43:08,632 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 13:43:08,656 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b1715aa870a1dc3343cda6 HTTP/1.1" 200 None 2026-03-13 13:43:08,656 - lava_callback - DEBUG - Processing node 69b1715aa870a1dc3343cda6: baseline-arm64-baylibre 2026-03-13 13:43:08,657 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b1715aa870a1dc3343cda6 2026-03-13 13:43:08,657 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 13:43:08,670 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b1715aa870a1dc3343cda6 HTTP/1.1" 200 None 2026-03-13 13:43:08,672 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 13:43:08,693 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ae11758ef4424e487b2eb1 HTTP/1.1" 200 None 2026-03-13 13:43:08,695 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 13:43:08,715 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b1715aa870a1dc3343cda6 HTTP/1.1" 200 None 2026-03-13 13:43:08,721 - lava_callback - ERROR - Error processing callback for node 69b1715aa870a1dc3343cda6: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:46614 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:46616 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43734 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43740 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38212 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50290 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34896 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33548 - "GET / HTTP/1.0" 200 OK 2026-03-13 13:44:08,646 - lava_callback - INFO - Received callback for node 69b171a7a870a1dc3343cdaf INFO: 172.21.0.1:33552 - "POST /node/69b171a7a870a1dc3343cdaf HTTP/1.0" 202 Accepted 2026-03-13 13:44:08,651 - lava_callback - INFO - Starting async job submit for node 69b171a7a870a1dc3343cdaf 2026-03-13 13:44:08,652 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 13:44:08,666 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b171a7a870a1dc3343cdaf HTTP/1.1" 200 None 2026-03-13 13:44:08,667 - lava_callback - DEBUG - Processing node 69b171a7a870a1dc3343cdaf: baseline-arm64-baylibre 2026-03-13 13:44:08,668 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b171a7a870a1dc3343cdaf 2026-03-13 13:44:08,668 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 13:44:08,681 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b171a7a870a1dc3343cdaf HTTP/1.1" 200 None 2026-03-13 13:44:08,683 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 13:44:08,696 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ae11758ef4424e487b2eb1 HTTP/1.1" 200 None 2026-03-13 13:44:08,698 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 13:44:08,718 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b171a7a870a1dc3343cdaf HTTP/1.1" 200 None 2026-03-13 13:44:08,719 - lava_callback - ERROR - Error processing callback for node 69b171a7a870a1dc3343cdaf: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:46000 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:46004 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35204 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35210 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43006 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35172 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46882 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57058 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44100 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:44110 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41890 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41896 - "GET / HTTP/1.0" 200 OK 2026-03-13 13:45:28,746 - lava_callback - INFO - Received callback for node 69b171f2a870a1dc3343cdbb INFO: 172.21.0.1:41902 - "POST /node/69b171f2a870a1dc3343cdbb HTTP/1.0" 202 Accepted 2026-03-13 13:45:28,751 - lava_callback - INFO - Starting async job submit for node 69b171f2a870a1dc3343cdbb 2026-03-13 13:45:28,752 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 13:45:28,771 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b171f2a870a1dc3343cdbb HTTP/1.1" 200 None 2026-03-13 13:45:28,772 - lava_callback - DEBUG - Processing node 69b171f2a870a1dc3343cdbb: baseline-arm64-baylibre 2026-03-13 13:45:28,772 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b171f2a870a1dc3343cdbb 2026-03-13 13:45:28,773 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 13:45:28,787 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b171f2a870a1dc3343cdbb HTTP/1.1" 200 None 2026-03-13 13:45:28,788 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 13:45:28,802 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ae11758ef4424e487b2eb1 HTTP/1.1" 200 None 2026-03-13 13:45:28,803 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 13:45:28,824 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b171f2a870a1dc3343cdbb HTTP/1.1" 200 None 2026-03-13 13:45:28,834 - lava_callback - ERROR - Error processing callback for node 69b171f2a870a1dc3343cdbb: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:52684 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47204 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51870 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53880 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40680 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:40690 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43490 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43498 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41108 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59790 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43120 - "GET / HTTP/1.0" 200 OK 2026-03-13 13:46:57,468 - lava_callback - INFO - Received callback for node 69b17243a870a1dc3343cdcc INFO: 172.21.0.1:43132 - "POST /node/69b17243a870a1dc3343cdcc HTTP/1.0" 202 Accepted 2026-03-13 13:46:57,478 - lava_callback - INFO - Starting async job submit for node 69b17243a870a1dc3343cdcc 2026-03-13 13:46:57,479 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 13:46:57,498 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b17243a870a1dc3343cdcc HTTP/1.1" 200 None 2026-03-13 13:46:57,499 - lava_callback - DEBUG - Processing node 69b17243a870a1dc3343cdcc: baseline-arm64-clabbe 2026-03-13 13:46:57,499 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b17243a870a1dc3343cdcc 2026-03-13 13:46:57,500 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 13:46:57,515 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b17243a870a1dc3343cdcc HTTP/1.1" 200 None 2026-03-13 13:46:57,516 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 13:46:57,531 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ae11758ef4424e487b2eb1 HTTP/1.1" 200 None 2026-03-13 13:46:57,532 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 13:46:57,553 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b17243a870a1dc3343cdcc HTTP/1.1" 200 None 2026-03-13 13:46:57,559 - lava_callback - ERROR - Error processing callback for node 69b17243a870a1dc3343cdcc: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:39838 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44770 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:44774 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49966 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49972 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55780 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47180 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:32856 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41512 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44250 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:44254 - "GET / HTTP/1.0" 200 OK 2026-03-13 13:48:17,539 - lava_callback - INFO - Received callback for node 69b1728fa870a1dc3343cdd5 INFO: 172.21.0.1:44262 - "POST /node/69b1728fa870a1dc3343cdd5 HTTP/1.0" 202 Accepted 2026-03-13 13:48:17,544 - lava_callback - INFO - Starting async job submit for node 69b1728fa870a1dc3343cdd5 2026-03-13 13:48:17,545 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 13:48:17,562 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b1728fa870a1dc3343cdd5 HTTP/1.1" 200 None 2026-03-13 13:48:17,563 - lava_callback - DEBUG - Processing node 69b1728fa870a1dc3343cdd5: baseline-arm64-clabbe 2026-03-13 13:48:17,563 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b1728fa870a1dc3343cdd5 2026-03-13 13:48:17,564 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 13:48:17,577 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b1728fa870a1dc3343cdd5 HTTP/1.1" 200 None 2026-03-13 13:48:17,578 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 13:48:17,593 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ae11758ef4424e487b2eb1 HTTP/1.1" 200 None 2026-03-13 13:48:17,594 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 13:48:17,615 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b1728fa870a1dc3343cdd5 HTTP/1.1" 200 None 2026-03-13 13:48:17,626 - lava_callback - ERROR - Error processing callback for node 69b1728fa870a1dc3343cdd5: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:45390 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45394 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39296 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35020 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43506 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45434 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36076 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:36092 - "GET / HTTP/1.0" 200 OK 2026-03-13 13:49:17,574 - lava_callback - INFO - Received callback for node 69b172daa870a1dc3343cde7 INFO: 172.21.0.1:36108 - "POST /node/69b172daa870a1dc3343cde7 HTTP/1.0" 202 Accepted 2026-03-13 13:49:17,580 - lava_callback - INFO - Starting async job submit for node 69b172daa870a1dc3343cde7 2026-03-13 13:49:17,580 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 13:49:17,601 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b172daa870a1dc3343cde7 HTTP/1.1" 200 None 2026-03-13 13:49:17,602 - lava_callback - DEBUG - Processing node 69b172daa870a1dc3343cde7: baseline-arm64-clabbe 2026-03-13 13:49:17,602 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b172daa870a1dc3343cde7 2026-03-13 13:49:17,603 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 13:49:17,622 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b172daa870a1dc3343cde7 HTTP/1.1" 200 None 2026-03-13 13:49:17,624 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 13:49:17,638 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ae11758ef4424e487b2eb1 HTTP/1.1" 200 None 2026-03-13 13:49:17,639 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 13:49:17,684 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b172daa870a1dc3343cde7 HTTP/1.1" 200 None 2026-03-13 13:49:17,693 - lava_callback - ERROR - Error processing callback for node 69b172daa870a1dc3343cde7: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:59020 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59032 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58348 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38068 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54938 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50900 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51010 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:51016 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52994 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53010 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39420 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42356 - "GET / HTTP/1.0" 200 OK 2026-03-13 13:50:49,504 - lava_callback - INFO - Received callback for node 69b17333a870a1dc3343cdf2 INFO: 172.21.0.1:42366 - "POST /node/69b17333a870a1dc3343cdf2 HTTP/1.0" 202 Accepted 2026-03-13 13:50:49,510 - lava_callback - INFO - Starting async job submit for node 69b17333a870a1dc3343cdf2 2026-03-13 13:50:49,511 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 13:50:49,530 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b17333a870a1dc3343cdf2 HTTP/1.1" 200 None 2026-03-13 13:50:49,531 - lava_callback - DEBUG - Processing node 69b17333a870a1dc3343cdf2: baseline-arm64-baylibre 2026-03-13 13:50:49,531 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b17333a870a1dc3343cdf2 2026-03-13 13:50:49,532 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 13:50:49,546 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b17333a870a1dc3343cdf2 HTTP/1.1" 200 None 2026-03-13 13:50:49,547 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 13:50:49,561 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ae11758ef4424e487b2eb1 HTTP/1.1" 200 None 2026-03-13 13:50:49,562 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 13:50:49,587 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b17333a870a1dc3343cdf2 HTTP/1.1" 200 None 2026-03-13 13:50:49,588 - lava_callback - ERROR - Error processing callback for node 69b17333a870a1dc3343cdf2: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:53464 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38118 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36516 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:36520 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37494 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37506 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49652 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53986 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60870 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60600 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47222 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:47232 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33178 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33182 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57830 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54420 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39724 - "GET / HTTP/1.0" 200 OK 2026-03-13 13:52:57,714 - lava_callback - INFO - Received callback for node 69b173b1a870a1dc3343ce00 INFO: 172.21.0.1:39738 - "POST /node/69b173b1a870a1dc3343ce00 HTTP/1.0" 202 Accepted 2026-03-13 13:52:57,720 - lava_callback - INFO - Starting async job submit for node 69b173b1a870a1dc3343ce00 2026-03-13 13:52:57,721 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 13:52:57,741 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b173b1a870a1dc3343ce00 HTTP/1.1" 200 None 2026-03-13 13:52:57,742 - lava_callback - DEBUG - Processing node 69b173b1a870a1dc3343ce00: baseline-arm64-clabbe 2026-03-13 13:52:57,742 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b173b1a870a1dc3343ce00 2026-03-13 13:52:57,743 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 13:52:57,757 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b173b1a870a1dc3343ce00 HTTP/1.1" 200 None 2026-03-13 13:52:57,759 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 13:52:57,775 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ae11758ef4424e487b2eb1 HTTP/1.1" 200 None 2026-03-13 13:52:57,777 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 13:52:57,806 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b173b1a870a1dc3343ce00 HTTP/1.1" 200 None 2026-03-13 13:52:57,808 - lava_callback - ERROR - Error processing callback for node 69b173b1a870a1dc3343ce00: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:34606 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42036 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:42046 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40814 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40816 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35328 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38502 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59724 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50738 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45532 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:45542 - "GET / HTTP/1.0" 200 OK 2026-03-13 13:54:17,767 - lava_callback - INFO - Received callback for node 69b173fca870a1dc3343ce0a INFO: 172.21.0.1:45544 - "POST /node/69b173fca870a1dc3343ce0a HTTP/1.0" 202 Accepted 2026-03-13 13:54:17,772 - lava_callback - INFO - Starting async job submit for node 69b173fca870a1dc3343ce0a 2026-03-13 13:54:17,773 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 13:54:17,788 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b173fca870a1dc3343ce0a HTTP/1.1" 200 None 2026-03-13 13:54:17,789 - lava_callback - DEBUG - Processing node 69b173fca870a1dc3343ce0a: baseline-arm64-clabbe 2026-03-13 13:54:17,789 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b173fca870a1dc3343ce0a 2026-03-13 13:54:17,790 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 13:54:17,804 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b173fca870a1dc3343ce0a HTTP/1.1" 200 None 2026-03-13 13:54:17,805 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 13:54:17,830 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ae11758ef4424e487b2eb1 HTTP/1.1" 200 None 2026-03-13 13:54:17,832 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 13:54:17,879 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b173fca870a1dc3343ce0a HTTP/1.1" 200 None 2026-03-13 13:54:17,881 - lava_callback - ERROR - Error processing callback for node 69b173fca870a1dc3343ce0a: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:39032 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39040 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53502 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56844 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59298 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44312 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35806 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35810 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:35820 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47918 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47932 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47306 - "GET / HTTP/1.0" 200 OK 2026-03-13 13:55:37,865 - lava_callback - INFO - Received callback for node 69b1744ca870a1dc3343ce19 INFO: 172.21.0.1:47310 - "POST /node/69b1744ca870a1dc3343ce19 HTTP/1.0" 202 Accepted 2026-03-13 13:55:37,871 - lava_callback - INFO - Starting async job submit for node 69b1744ca870a1dc3343ce19 2026-03-13 13:55:37,872 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 13:55:37,888 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b1744ca870a1dc3343ce19 HTTP/1.1" 200 None 2026-03-13 13:55:37,889 - lava_callback - DEBUG - Processing node 69b1744ca870a1dc3343ce19: baseline-arm64-clabbe 2026-03-13 13:55:37,889 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b1744ca870a1dc3343ce19 2026-03-13 13:55:37,889 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 13:55:37,902 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b1744ca870a1dc3343ce19 HTTP/1.1" 200 None 2026-03-13 13:55:37,904 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 13:55:37,919 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ae11758ef4424e487b2eb1 HTTP/1.1" 200 None 2026-03-13 13:55:37,921 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 13:55:37,941 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b1744ca870a1dc3343ce19 HTTP/1.1" 200 None 2026-03-13 13:55:37,942 - lava_callback - ERROR - Error processing callback for node 69b1744ca870a1dc3343ce19: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:57650 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37680 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48224 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44066 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:44072 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47268 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47280 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42210 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34154 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51410 - "GET / HTTP/1.0" 200 OK 2026-03-13 13:56:57,910 - lava_callback - INFO - Received callback for node 69b17498a870a1dc3343ce29 INFO: 172.21.0.1:51416 - "POST /node/69b17498a870a1dc3343ce29 HTTP/1.0" 202 Accepted 2026-03-13 13:56:57,915 - lava_callback - INFO - Starting async job submit for node 69b17498a870a1dc3343ce29 2026-03-13 13:56:57,917 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 13:56:57,931 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b17498a870a1dc3343ce29 HTTP/1.1" 200 None 2026-03-13 13:56:57,932 - lava_callback - DEBUG - Processing node 69b17498a870a1dc3343ce29: baseline-arm64-clabbe 2026-03-13 13:56:57,933 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b17498a870a1dc3343ce29 2026-03-13 13:56:57,933 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 13:56:57,960 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b17498a870a1dc3343ce29 HTTP/1.1" 200 None 2026-03-13 13:56:57,961 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 13:56:57,976 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ae11758ef4424e487b2eb1 HTTP/1.1" 200 None 2026-03-13 13:56:57,979 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 13:56:58,006 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b17498a870a1dc3343ce29 HTTP/1.1" 200 None 2026-03-13 13:56:58,008 - lava_callback - ERROR - Error processing callback for node 69b17498a870a1dc3343ce29: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:42870 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51244 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:51252 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58210 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58212 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40950 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51628 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34896 - "GET / HTTP/1.0" 200 OK 2026-03-13 13:57:57,930 - lava_callback - INFO - Received callback for node 69b174e3a870a1dc3343ce32 INFO: 172.21.0.1:34906 - "POST /node/69b174e3a870a1dc3343ce32 HTTP/1.0" 202 Accepted 2026-03-13 13:57:57,936 - lava_callback - INFO - Starting async job submit for node 69b174e3a870a1dc3343ce32 2026-03-13 13:57:57,936 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 13:57:57,951 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b174e3a870a1dc3343ce32 HTTP/1.1" 200 None 2026-03-13 13:57:57,952 - lava_callback - DEBUG - Processing node 69b174e3a870a1dc3343ce32: baseline-arm64-clabbe 2026-03-13 13:57:57,952 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b174e3a870a1dc3343ce32 2026-03-13 13:57:57,952 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 13:57:57,965 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b174e3a870a1dc3343ce32 HTTP/1.1" 200 None 2026-03-13 13:57:57,967 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 13:57:57,998 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ae11758ef4424e487b2eb1 HTTP/1.1" 200 None 2026-03-13 13:57:58,000 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 13:57:58,029 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b174e3a870a1dc3343ce32 HTTP/1.1" 200 None 2026-03-13 13:57:58,031 - lava_callback - ERROR - Error processing callback for node 69b174e3a870a1dc3343ce32: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:40004 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36552 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:36558 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49262 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49272 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57636 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56598 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37600 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42928 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57198 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:57204 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48488 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48498 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51064 - "GET / HTTP/1.0" 200 OK 2026-03-13 13:59:37,957 - lava_callback - INFO - Received callback for node 69b17533a870a1dc3343ce43 INFO: 172.21.0.1:51068 - "POST /node/69b17533a870a1dc3343ce43 HTTP/1.0" 202 Accepted 2026-03-13 13:59:37,962 - lava_callback - INFO - Starting async job submit for node 69b17533a870a1dc3343ce43 2026-03-13 13:59:37,963 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 13:59:37,998 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b17533a870a1dc3343ce43 HTTP/1.1" 200 None 2026-03-13 13:59:37,999 - lava_callback - DEBUG - Processing node 69b17533a870a1dc3343ce43: baseline-arm64-clabbe 2026-03-13 13:59:37,999 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b17533a870a1dc3343ce43 2026-03-13 13:59:38,000 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 13:59:38,014 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b17533a870a1dc3343ce43 HTTP/1.1" 200 None 2026-03-13 13:59:38,016 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 13:59:38,029 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ae11758ef4424e487b2eb1 HTTP/1.1" 200 None 2026-03-13 13:59:38,030 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 13:59:38,050 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b17533a870a1dc3343ce43 HTTP/1.1" 200 None 2026-03-13 13:59:38,056 - lava_callback - ERROR - Error processing callback for node 69b17533a870a1dc3343ce43: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:39224 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44340 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45074 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44212 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:44220 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48630 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48636 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38778 - "GET / HTTP/1.0" 200 OK 2026-03-13 14:00:38,000 - lava_callback - INFO - Received callback for node 69b17583a870a1dc3343ce4d INFO: 172.21.0.1:38792 - "POST /node/69b17583a870a1dc3343ce4d HTTP/1.0" 202 Accepted 2026-03-13 14:00:38,006 - lava_callback - INFO - Starting async job submit for node 69b17583a870a1dc3343ce4d 2026-03-13 14:00:38,007 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 14:00:38,022 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b17583a870a1dc3343ce4d HTTP/1.1" 200 None 2026-03-13 14:00:38,023 - lava_callback - DEBUG - Processing node 69b17583a870a1dc3343ce4d: baseline-arm64-clabbe 2026-03-13 14:00:38,024 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b17583a870a1dc3343ce4d 2026-03-13 14:00:38,024 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 14:00:38,039 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b17583a870a1dc3343ce4d HTTP/1.1" 200 None 2026-03-13 14:00:38,040 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 14:00:38,056 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ae11758ef4424e487b2eb1 HTTP/1.1" 200 None 2026-03-13 14:00:38,058 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 14:00:38,087 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b17583a870a1dc3343ce4d HTTP/1.1" 200 None 2026-03-13 14:00:38,089 - lava_callback - ERROR - Error processing callback for node 69b17583a870a1dc3343ce4d: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:60280 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38714 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60442 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44160 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:44162 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38066 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38072 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54130 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42092 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38192 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60934 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58100 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:58106 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34398 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34406 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55184 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43278 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50752 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35826 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60982 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:60992 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58738 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58744 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59018 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59028 - "GET /node/698f59213013abef95cf7205%5Cn HTTP/1.0" 405 Method Not Allowed INFO: 172.21.0.1:42294 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55670 - "GET / HTTP/1.0" 200 OK 2026-03-13 14:03:58,188 - lava_callback - INFO - Received callback for node 69b17647a870a1dc3343ce5e INFO: 172.21.0.1:55686 - "POST /node/69b17647a870a1dc3343ce5e HTTP/1.0" 202 Accepted 2026-03-13 14:03:58,195 - lava_callback - INFO - Starting async job submit for node 69b17647a870a1dc3343ce5e 2026-03-13 14:03:58,196 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 14:03:58,209 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b17647a870a1dc3343ce5e HTTP/1.1" 200 None 2026-03-13 14:03:58,209 - lava_callback - DEBUG - Processing node 69b17647a870a1dc3343ce5e: baseline-arm64-clabbe 2026-03-13 14:03:58,210 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b17647a870a1dc3343ce5e 2026-03-13 14:03:58,210 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 14:03:58,224 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b17647a870a1dc3343ce5e HTTP/1.1" 200 None 2026-03-13 14:03:58,226 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 14:03:58,251 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ae11758ef4424e487b2eb1 HTTP/1.1" 200 None 2026-03-13 14:03:58,253 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 14:03:58,273 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b17647a870a1dc3343ce5e HTTP/1.1" 200 None 2026-03-13 14:03:58,279 - lava_callback - ERROR - Error processing callback for node 69b17647a870a1dc3343ce5e: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:36484 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45204 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:45206 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58188 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58190 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43148 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60628 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35416 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39512 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51084 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:51088 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37162 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37164 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45358 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59412 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41832 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40124 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59968 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:59984 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50086 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50088 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54558 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56818 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40136 - "GET / HTTP/1.0" 200 OK 2026-03-13 14:06:58,286 - lava_callback - INFO - Received callback for node 69b176fda870a1dc3343ce6d INFO: 172.21.0.1:40152 - "POST /node/69b176fda870a1dc3343ce6d HTTP/1.0" 202 Accepted 2026-03-13 14:06:58,291 - lava_callback - INFO - Starting async job submit for node 69b176fda870a1dc3343ce6d 2026-03-13 14:06:58,292 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 14:06:58,306 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b176fda870a1dc3343ce6d HTTP/1.1" 200 None 2026-03-13 14:06:58,307 - lava_callback - DEBUG - Processing node 69b176fda870a1dc3343ce6d: baseline-arm64-clabbe 2026-03-13 14:06:58,308 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b176fda870a1dc3343ce6d 2026-03-13 14:06:58,308 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 14:06:58,321 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b176fda870a1dc3343ce6d HTTP/1.1" 200 None 2026-03-13 14:06:58,322 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 14:06:58,336 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ae11758ef4424e487b2eb1 HTTP/1.1" 200 None 2026-03-13 14:06:58,337 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 14:06:58,357 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b176fda870a1dc3343ce6d HTTP/1.1" 200 None 2026-03-13 14:06:58,359 - lava_callback - ERROR - Error processing callback for node 69b176fda870a1dc3343ce6d: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:35882 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49164 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:49166 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42482 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42498 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59278 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59622 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47202 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39826 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40546 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:40548 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40326 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40342 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40254 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41990 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33460 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54846 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36748 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:36752 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52986 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52988 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44928 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56182 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57578 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52686 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43790 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:43806 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45410 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45426 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33168 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37814 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49802 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54390 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40868 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:40882 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44420 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44422 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38234 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59592 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35000 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60954 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34986 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:34998 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46060 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46074 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38028 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36846 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42952 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33410 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35078 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:35088 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58826 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58840 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46190 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60450 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51324 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51692 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47038 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:47042 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47070 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47082 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40452 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39710 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35362 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60220 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48134 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:48150 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33340 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33354 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58828 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57106 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59482 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44386 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46994 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:46998 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:32970 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:32982 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56922 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34340 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35562 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43920 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42450 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:42466 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39650 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39658 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35440 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58618 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54810 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58128 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42066 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:42082 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35310 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35322 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39906 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54056 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47532 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33564 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34058 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:34068 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33422 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33430 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49336 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49470 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55062 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33056 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38222 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:38236 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52126 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52130 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44222 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33240 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42818 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41662 - "GET / HTTP/1.0" 200 OK 2026-03-13 14:21:11,140 - lava_callback - INFO - Received callback for node 69b17a55a870a1dc3343ce97 INFO: 172.21.0.1:35644 - "POST /node/69b17a55a870a1dc3343ce97 HTTP/1.0" 202 Accepted 2026-03-13 14:21:11,145 - lava_callback - INFO - Starting async job submit for node 69b17a55a870a1dc3343ce97 2026-03-13 14:21:11,146 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 14:21:11,160 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b17a55a870a1dc3343ce97 HTTP/1.1" 200 None 2026-03-13 14:21:11,161 - lava_callback - DEBUG - Processing node 69b17a55a870a1dc3343ce97: baseline-arm64-baylibre 2026-03-13 14:21:11,162 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b17a55a870a1dc3343ce97 2026-03-13 14:21:11,162 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 14:21:11,176 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b17a55a870a1dc3343ce97 HTTP/1.1" 200 None 2026-03-13 14:21:11,177 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 14:21:11,199 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ae11758ef4424e487b2eb1 HTTP/1.1" 200 None 2026-03-13 14:21:11,201 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 14:21:11,248 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b17a55a870a1dc3343ce97 HTTP/1.1" 200 None 2026-03-13 14:21:11,249 - lava_callback - ERROR - Error processing callback for node 69b17a55a870a1dc3343ce97: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:35654 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:35662 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39408 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39424 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58216 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47568 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49092 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55990 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39720 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:39736 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44654 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44670 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34026 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37580 - "GET / HTTP/1.0" 200 OK 2026-03-13 14:22:50,957 - lava_callback - INFO - Received callback for node 69b17aaea870a1dc3343cea3 INFO: 172.21.0.1:48854 - "POST /node/69b17aaea870a1dc3343cea3 HTTP/1.0" 202 Accepted 2026-03-13 14:22:50,963 - lava_callback - INFO - Starting async job submit for node 69b17aaea870a1dc3343cea3 2026-03-13 14:22:50,964 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 14:22:50,984 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b17aaea870a1dc3343cea3 HTTP/1.1" 200 None 2026-03-13 14:22:50,985 - lava_callback - DEBUG - Processing node 69b17aaea870a1dc3343cea3: baseline-arm64-baylibre 2026-03-13 14:22:50,986 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b17aaea870a1dc3343cea3 2026-03-13 14:22:50,986 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 14:22:51,000 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b17aaea870a1dc3343cea3 HTTP/1.1" 200 None 2026-03-13 14:22:51,001 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 14:22:51,020 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ae11758ef4424e487b2eb1 HTTP/1.1" 200 None 2026-03-13 14:22:51,021 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 14:22:51,048 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b17aaea870a1dc3343cea3 HTTP/1.1" 200 None 2026-03-13 14:22:51,050 - lava_callback - ERROR - Error processing callback for node 69b17aaea870a1dc3343cea3: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:48870 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36570 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36924 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:36940 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34750 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34764 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52168 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36294 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33396 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42890 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49526 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:49542 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55400 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55402 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46426 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46246 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44784 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41292 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36032 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:36040 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44172 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44180 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54462 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42644 - "GET / HTTP/1.0" 200 OK 2026-03-13 14:25:51,120 - lava_callback - INFO - Received callback for node 69b17b62a870a1dc3343ceb3 INFO: 172.21.0.1:39766 - "POST /node/69b17b62a870a1dc3343ceb3 HTTP/1.0" 202 Accepted 2026-03-13 14:25:51,125 - lava_callback - INFO - Starting async job submit for node 69b17b62a870a1dc3343ceb3 2026-03-13 14:25:51,126 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 14:25:51,144 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b17b62a870a1dc3343ceb3 HTTP/1.1" 200 None 2026-03-13 14:25:51,144 - lava_callback - DEBUG - Processing node 69b17b62a870a1dc3343ceb3: baseline-arm64-baylibre 2026-03-13 14:25:51,145 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b17b62a870a1dc3343ceb3 2026-03-13 14:25:51,145 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 14:25:51,158 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b17b62a870a1dc3343ceb3 HTTP/1.1" 200 None 2026-03-13 14:25:51,160 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 14:25:51,184 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ae11758ef4424e487b2eb1 HTTP/1.1" 200 None 2026-03-13 14:25:51,185 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 14:25:51,206 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b17b62a870a1dc3343ceb3 HTTP/1.1" 200 None 2026-03-13 14:25:51,211 - lava_callback - ERROR - Error processing callback for node 69b17b62a870a1dc3343ceb3: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:39768 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52200 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45116 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:45132 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44902 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44906 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44840 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45770 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36098 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52976 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36164 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:36174 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49822 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49826 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40706 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50784 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35124 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41338 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57664 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:57674 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46484 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46488 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38402 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46818 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33194 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36066 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56436 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:56438 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34776 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34788 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33278 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54938 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55114 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46348 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56178 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:56182 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55440 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55444 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59538 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58814 - "GET / HTTP/1.0" 200 OK 2026-03-13 14:30:51,415 - lava_callback - INFO - Received callback for node 69b17c86a870a1dc3343cebd INFO: 172.21.0.1:40604 - "POST /node/69b17c86a870a1dc3343cebd HTTP/1.0" 202 Accepted 2026-03-13 14:30:51,421 - lava_callback - INFO - Starting async job submit for node 69b17c86a870a1dc3343cebd 2026-03-13 14:30:51,422 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 14:30:51,437 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b17c86a870a1dc3343cebd HTTP/1.1" 200 None 2026-03-13 14:30:51,438 - lava_callback - DEBUG - Processing node 69b17c86a870a1dc3343cebd: baseline-arm64-baylibre 2026-03-13 14:30:51,438 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b17c86a870a1dc3343cebd 2026-03-13 14:30:51,439 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 14:30:51,460 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b17c86a870a1dc3343cebd HTTP/1.1" 200 None 2026-03-13 14:30:51,462 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 14:30:51,475 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ae11758ef4424e487b2eb1 HTTP/1.1" 200 None 2026-03-13 14:30:51,476 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 14:30:51,501 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b17c86a870a1dc3343cebd HTTP/1.1" 200 None 2026-03-13 14:30:51,503 - lava_callback - ERROR - Error processing callback for node 69b17c86a870a1dc3343cebd: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:40614 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46642 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36636 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:36650 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33508 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33512 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56178 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36226 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37776 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42062 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33050 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:33060 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52402 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52404 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47230 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58446 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48096 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40662 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59940 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:59954 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41962 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41964 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44122 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53552 - "GET / HTTP/1.0" 200 OK 2026-03-13 14:33:51,552 - lava_callback - INFO - Received callback for node 69b17d3ca870a1dc3343cecd INFO: 172.21.0.1:34712 - "POST /node/69b17d3ca870a1dc3343cecd HTTP/1.0" 202 Accepted 2026-03-13 14:33:51,558 - lava_callback - INFO - Starting async job submit for node 69b17d3ca870a1dc3343cecd 2026-03-13 14:33:51,559 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 14:33:51,579 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b17d3ca870a1dc3343cecd HTTP/1.1" 200 None 2026-03-13 14:33:51,580 - lava_callback - DEBUG - Processing node 69b17d3ca870a1dc3343cecd: baseline-arm64-baylibre 2026-03-13 14:33:51,580 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b17d3ca870a1dc3343cecd 2026-03-13 14:33:51,581 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 14:33:51,594 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b17d3ca870a1dc3343cecd HTTP/1.1" 200 None 2026-03-13 14:33:51,595 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 14:33:51,620 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ae11758ef4424e487b2eb1 HTTP/1.1" 200 None 2026-03-13 14:33:51,621 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 14:33:51,643 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b17d3ca870a1dc3343cecd HTTP/1.1" 200 None 2026-03-13 14:33:51,644 - lava_callback - ERROR - Error processing callback for node 69b17d3ca870a1dc3343cecd: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:34722 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43746 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54066 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:54082 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46982 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46990 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44670 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58226 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58498 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59896 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50252 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:50266 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58510 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58526 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57336 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35796 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36620 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48640 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49096 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:49108 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46790 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46804 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47860 - "GET / HTTP/1.0" 200 OK 2026-03-13 14:36:39,773 - lava_callback - INFO - Received callback for node 69b17de9a870a1dc3343cedc INFO: 172.21.0.1:56422 - "POST /node/69b17de9a870a1dc3343cedc HTTP/1.0" 202 Accepted 2026-03-13 14:36:39,779 - lava_callback - INFO - Starting async job submit for node 69b17de9a870a1dc3343cedc 2026-03-13 14:36:39,780 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 14:36:39,795 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b17de9a870a1dc3343cedc HTTP/1.1" 200 None 2026-03-13 14:36:39,796 - lava_callback - DEBUG - Processing node 69b17de9a870a1dc3343cedc: baseline-arm64-clabbe 2026-03-13 14:36:39,796 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b17de9a870a1dc3343cedc 2026-03-13 14:36:39,797 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 14:36:39,809 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b17de9a870a1dc3343cedc HTTP/1.1" 200 None 2026-03-13 14:36:39,811 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 14:36:39,824 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ae11758ef4424e487b2eb1 HTTP/1.1" 200 None 2026-03-13 14:36:39,826 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 14:36:39,851 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b17de9a870a1dc3343cedc HTTP/1.1" 200 None 2026-03-13 14:36:39,861 - lava_callback - ERROR - Error processing callback for node 69b17de9a870a1dc3343cedc: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:56434 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42814 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48966 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39432 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:39446 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51408 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51420 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43906 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52302 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57134 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41766 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37082 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:37090 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45174 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45186 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37582 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49202 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56936 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48160 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35922 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:35938 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60898 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60904 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57396 - "GET / HTTP/1.0" 200 OK 2026-03-13 14:39:39,616 - lava_callback - INFO - Received callback for node 69b17e9ba870a1dc3343cf01 INFO: 172.21.0.1:57410 - "POST /node/69b17e9ba870a1dc3343cf01 HTTP/1.0" 202 Accepted 2026-03-13 14:39:39,622 - lava_callback - INFO - Starting async job submit for node 69b17e9ba870a1dc3343cf01 2026-03-13 14:39:39,622 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 14:39:39,637 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b17e9ba870a1dc3343cf01 HTTP/1.1" 200 None 2026-03-13 14:39:39,638 - lava_callback - DEBUG - Processing node 69b17e9ba870a1dc3343cf01: baseline-arm64-clabbe 2026-03-13 14:39:39,639 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b17e9ba870a1dc3343cf01 2026-03-13 14:39:39,639 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 14:39:39,653 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b17e9ba870a1dc3343cf01 HTTP/1.1" 200 None 2026-03-13 14:39:39,654 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 14:39:39,671 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ae11758ef4424e487b2eb1 HTTP/1.1" 200 None 2026-03-13 14:39:39,673 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 14:39:39,708 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b17e9ba870a1dc3343cf01 HTTP/1.1" 200 None 2026-03-13 14:39:39,709 - lava_callback - ERROR - Error processing callback for node 69b17e9ba870a1dc3343cf01: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:58048 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39618 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45914 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42720 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:42732 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48042 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48050 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37298 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59052 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44142 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46636 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57748 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:57762 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42288 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42294 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40652 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46088 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39342 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57942 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45542 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:45550 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53210 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53216 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33712 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40184 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36972 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36980 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47786 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:47790 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35288 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35296 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59478 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56604 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47712 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49314 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53952 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:53962 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56480 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56488 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47884 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35286 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36658 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54956 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37154 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:37160 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43972 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43980 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57260 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56262 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60920 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47404 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51220 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:51234 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52592 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52604 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36290 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53894 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46550 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33196 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51092 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:51106 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54780 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54794 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36458 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38616 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58448 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59006 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36672 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:36680 - "GET / HTTP/1.0" 200 OK 2026-03-13 14:48:19,997 - lava_callback - INFO - Received callback for node 69b180aba870a1dc3343cf41 INFO: 172.21.0.1:36242 - "POST /node/69b180aba870a1dc3343cf41 HTTP/1.0" 202 Accepted 2026-03-13 14:48:20,003 - lava_callback - INFO - Starting async job submit for node 69b180aba870a1dc3343cf41 2026-03-13 14:48:20,004 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 14:48:20,018 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b180aba870a1dc3343cf41 HTTP/1.1" 200 None 2026-03-13 14:48:20,019 - lava_callback - DEBUG - Processing node 69b180aba870a1dc3343cf41: baseline-arm-clabbe 2026-03-13 14:48:20,019 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b180aba870a1dc3343cf41 2026-03-13 14:48:20,019 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 14:48:20,040 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b180aba870a1dc3343cf41 HTTP/1.1" 200 None 2026-03-13 14:48:20,041 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 14:48:20,055 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b12591a870a1dc3343ba82 HTTP/1.1" 200 None 2026-03-13 14:48:20,057 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 14:48:20,078 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b180aba870a1dc3343cf41 HTTP/1.1" 200 None 2026-03-13 14:48:20,080 - lava_callback - ERROR - Error processing callback for node 69b180aba870a1dc3343cf41: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:36244 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36252 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55794 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54722 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46276 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35614 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52622 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:52632 - "GET / HTTP/1.0" 200 OK 2026-03-13 14:49:20,063 - lava_callback - INFO - Received callback for node 69b180e2a870a1dc3343cf4a INFO: 172.21.0.1:58252 - "POST /node/69b180e2a870a1dc3343cf4a HTTP/1.0" 202 Accepted 2026-03-13 14:49:20,069 - lava_callback - INFO - Starting async job submit for node 69b180e2a870a1dc3343cf4a 2026-03-13 14:49:20,070 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 14:49:20,084 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b180e2a870a1dc3343cf4a HTTP/1.1" 200 None 2026-03-13 14:49:20,085 - lava_callback - DEBUG - Processing node 69b180e2a870a1dc3343cf4a: baseline-arm-clabbe 2026-03-13 14:49:20,085 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b180e2a870a1dc3343cf4a 2026-03-13 14:49:20,086 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 14:49:20,098 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b180e2a870a1dc3343cf4a HTTP/1.1" 200 None 2026-03-13 14:49:20,100 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 14:49:20,120 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b12591a870a1dc3343ba82 HTTP/1.1" 200 None 2026-03-13 14:49:20,122 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 14:49:20,142 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b180e2a870a1dc3343cf4a HTTP/1.1" 200 None 2026-03-13 14:49:20,143 - lava_callback - ERROR - Error processing callback for node 69b180e2a870a1dc3343cf4a: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:58266 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58268 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45226 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41958 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45756 - "GET / HTTP/1.0" 200 OK 2026-03-13 14:50:00,062 - lava_callback - INFO - Received callback for node 69b18113a870a1dc3343cf56 INFO: 172.21.0.1:55774 - "POST /node/69b18113a870a1dc3343cf56 HTTP/1.0" 202 Accepted 2026-03-13 14:50:00,068 - lava_callback - INFO - Starting async job submit for node 69b18113a870a1dc3343cf56 2026-03-13 14:50:00,069 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 14:50:00,083 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b18113a870a1dc3343cf56 HTTP/1.1" 200 None 2026-03-13 14:50:00,084 - lava_callback - DEBUG - Processing node 69b18113a870a1dc3343cf56: baseline-arm-clabbe 2026-03-13 14:50:00,084 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b18113a870a1dc3343cf56 2026-03-13 14:50:00,085 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 14:50:00,107 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b18113a870a1dc3343cf56 HTTP/1.1" 200 None 2026-03-13 14:50:00,108 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 14:50:00,126 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b12591a870a1dc3343ba82 HTTP/1.1" 200 None 2026-03-13 14:50:00,127 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 14:50:00,149 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b18113a870a1dc3343cf56 HTTP/1.1" 200 None 2026-03-13 14:50:00,154 - lava_callback - ERROR - Error processing callback for node 69b18113a870a1dc3343cf56: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:55780 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41994 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:42006 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46802 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46812 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36680 - "GET / HTTP/1.0" 200 OK 2026-03-13 14:50:40,131 - lava_callback - INFO - Received callback for node 69b18138a870a1dc3343cf61 INFO: 172.21.0.1:53704 - "POST /node/69b18138a870a1dc3343cf61 HTTP/1.0" 202 Accepted 2026-03-13 14:50:40,136 - lava_callback - INFO - Starting async job submit for node 69b18138a870a1dc3343cf61 2026-03-13 14:50:40,137 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 14:50:40,151 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b18138a870a1dc3343cf61 HTTP/1.1" 200 None 2026-03-13 14:50:40,152 - lava_callback - DEBUG - Processing node 69b18138a870a1dc3343cf61: baseline-arm-clabbe 2026-03-13 14:50:40,152 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b18138a870a1dc3343cf61 2026-03-13 14:50:40,153 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 14:50:40,168 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b18138a870a1dc3343cf61 HTTP/1.1" 200 None 2026-03-13 14:50:40,169 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 14:50:40,187 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b12591a870a1dc3343ba82 HTTP/1.1" 200 None 2026-03-13 14:50:40,189 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 14:50:40,220 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b18138a870a1dc3343cf61 HTTP/1.1" 200 None 2026-03-13 14:50:40,222 - lava_callback - ERROR - Error processing callback for node 69b18138a870a1dc3343cf61: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:53720 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33500 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33082 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38148 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:38164 - "GET / HTTP/1.0" 200 OK 2026-03-13 14:51:20,123 - lava_callback - INFO - Received callback for node 69b1815ca870a1dc3343cf6d INFO: 172.21.0.1:38054 - "POST /node/69b1815ca870a1dc3343cf6d HTTP/1.0" 202 Accepted 2026-03-13 14:51:20,128 - lava_callback - INFO - Starting async job submit for node 69b1815ca870a1dc3343cf6d 2026-03-13 14:51:20,129 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 14:51:20,143 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b1815ca870a1dc3343cf6d HTTP/1.1" 200 None 2026-03-13 14:51:20,144 - lava_callback - DEBUG - Processing node 69b1815ca870a1dc3343cf6d: baseline-arm-clabbe 2026-03-13 14:51:20,144 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b1815ca870a1dc3343cf6d 2026-03-13 14:51:20,145 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 14:51:20,163 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b1815ca870a1dc3343cf6d HTTP/1.1" 200 None 2026-03-13 14:51:20,164 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 14:51:20,178 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b12591a870a1dc3343ba82 HTTP/1.1" 200 None 2026-03-13 14:51:20,179 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 14:51:20,199 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b1815ca870a1dc3343cf6d HTTP/1.1" 200 None 2026-03-13 14:51:20,200 - lava_callback - ERROR - Error processing callback for node 69b1815ca870a1dc3343cf6d: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:38070 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38080 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57722 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44642 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39018 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58666 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33712 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:33724 - "GET / HTTP/1.0" 200 OK 2026-03-13 14:52:20,212 - lava_callback - INFO - Received callback for node 69b1818ea870a1dc3343cf78 INFO: 172.21.0.1:39708 - "POST /node/69b1818ea870a1dc3343cf78 HTTP/1.0" 202 Accepted 2026-03-13 14:52:20,218 - lava_callback - INFO - Starting async job submit for node 69b1818ea870a1dc3343cf78 2026-03-13 14:52:20,219 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 14:52:20,235 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b1818ea870a1dc3343cf78 HTTP/1.1" 200 None 2026-03-13 14:52:20,236 - lava_callback - DEBUG - Processing node 69b1818ea870a1dc3343cf78: baseline-arm64-clabbe 2026-03-13 14:52:20,236 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b1818ea870a1dc3343cf78 2026-03-13 14:52:20,237 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 14:52:20,251 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b1818ea870a1dc3343cf78 HTTP/1.1" 200 None 2026-03-13 14:52:20,254 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 14:52:20,295 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ae11758ef4424e487b2eb1 HTTP/1.1" 200 None 2026-03-13 14:52:20,297 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 14:52:20,317 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b1818ea870a1dc3343cf78 HTTP/1.1" 200 None 2026-03-13 14:52:20,319 - lava_callback - ERROR - Error processing callback for node 69b1818ea870a1dc3343cf78: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:39718 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39726 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55290 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51904 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46130 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56122 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59230 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:59236 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45816 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45832 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52032 - "GET / HTTP/1.0" 200 OK 2026-03-13 14:53:40,284 - lava_callback - INFO - Received callback for node 69b181dea870a1dc3343cf88 INFO: 172.21.0.1:40954 - "POST /node/69b181dea870a1dc3343cf88 HTTP/1.0" 202 Accepted 2026-03-13 14:53:40,290 - lava_callback - INFO - Starting async job submit for node 69b181dea870a1dc3343cf88 2026-03-13 14:53:40,290 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 14:53:40,306 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b181dea870a1dc3343cf88 HTTP/1.1" 200 None 2026-03-13 14:53:40,307 - lava_callback - DEBUG - Processing node 69b181dea870a1dc3343cf88: baseline-arm64-clabbe 2026-03-13 14:53:40,308 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b181dea870a1dc3343cf88 2026-03-13 14:53:40,308 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 14:53:40,321 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b181dea870a1dc3343cf88 HTTP/1.1" 200 None 2026-03-13 14:53:40,323 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 14:53:40,339 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ae11758ef4424e487b2eb1 HTTP/1.1" 200 None 2026-03-13 14:53:40,341 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 14:53:40,361 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b181dea870a1dc3343cf88 HTTP/1.1" 200 None 2026-03-13 14:53:40,362 - lava_callback - ERROR - Error processing callback for node 69b181dea870a1dc3343cf88: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:40960 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52828 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59624 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41256 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:41266 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60706 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60720 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55962 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41906 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60044 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48110 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48474 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:48478 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48894 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48910 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53668 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:32786 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44330 - "GET / HTTP/1.0" 200 OK 2026-03-13 14:56:00,397 - lava_callback - INFO - Received callback for node 69b1826fa870a1dc3343cf9e INFO: 172.21.0.1:40412 - "POST /node/69b1826fa870a1dc3343cf9e HTTP/1.0" 202 Accepted 2026-03-13 14:56:00,402 - lava_callback - INFO - Starting async job submit for node 69b1826fa870a1dc3343cf9e 2026-03-13 14:56:00,403 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 14:56:00,439 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b1826fa870a1dc3343cf9e HTTP/1.1" 200 None 2026-03-13 14:56:00,440 - lava_callback - DEBUG - Processing node 69b1826fa870a1dc3343cf9e: baseline-arm64-clabbe 2026-03-13 14:56:00,440 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b1826fa870a1dc3343cf9e 2026-03-13 14:56:00,441 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 14:56:00,454 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b1826fa870a1dc3343cf9e HTTP/1.1" 200 None 2026-03-13 14:56:00,456 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 14:56:00,469 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ae11758ef4424e487b2eb1 HTTP/1.1" 200 None 2026-03-13 14:56:00,470 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 14:56:00,500 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b1826fa870a1dc3343cf9e HTTP/1.1" 200 None 2026-03-13 14:56:00,507 - lava_callback - ERROR - Error processing callback for node 69b1826fa870a1dc3343cf9e: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:40416 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56574 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:56582 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45288 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45292 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60308 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56620 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56892 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58264 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60824 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:60832 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48748 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48752 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44444 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50828 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33234 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59146 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39936 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:39942 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48852 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48862 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58776 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51458 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43190 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37466 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57860 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:57868 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57444 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57452 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55362 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49366 - "GET / HTTP/1.0" 200 OK 2026-03-13 14:59:53,120 - lava_callback - INFO - Received callback for node 69b18365a870a1dc3343cfc5 INFO: 172.21.0.1:41462 - "POST /node/69b18365a870a1dc3343cfc5 HTTP/1.0" 202 Accepted 2026-03-13 14:59:53,126 - lava_callback - INFO - Starting async job submit for node 69b18365a870a1dc3343cfc5 2026-03-13 14:59:53,127 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 14:59:53,141 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b18365a870a1dc3343cfc5 HTTP/1.1" 200 None 2026-03-13 14:59:53,141 - lava_callback - DEBUG - Processing node 69b18365a870a1dc3343cfc5: baseline-arm-baylibre 2026-03-13 14:59:53,142 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b18365a870a1dc3343cfc5 2026-03-13 14:59:53,142 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 14:59:53,155 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b18365a870a1dc3343cfc5 HTTP/1.1" 200 None 2026-03-13 14:59:53,156 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 14:59:53,170 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ae8223c660ead8a389aafd HTTP/1.1" 200 None 2026-03-13 14:59:53,172 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 14:59:53,202 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b18365a870a1dc3343cfc5 HTTP/1.1" 200 None 2026-03-13 14:59:53,207 - lava_callback - ERROR - Error processing callback for node 69b18365a870a1dc3343cfc5: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:41474 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42356 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59142 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:59152 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36696 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36700 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33548 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57126 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41456 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57190 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33182 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:33190 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57128 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57138 - "GET / HTTP/1.0" 200 OK 2026-03-13 15:01:33,015 - lava_callback - INFO - Received callback for node 69b183c3a870a1dc3343cfd6 INFO: 172.21.0.1:51508 - "POST /node/69b183c3a870a1dc3343cfd6 HTTP/1.0" 202 Accepted 2026-03-13 15:01:33,020 - lava_callback - INFO - Starting async job submit for node 69b183c3a870a1dc3343cfd6 2026-03-13 15:01:33,021 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 15:01:33,039 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b183c3a870a1dc3343cfd6 HTTP/1.1" 200 None 2026-03-13 15:01:33,040 - lava_callback - DEBUG - Processing node 69b183c3a870a1dc3343cfd6: baseline-arm-baylibre 2026-03-13 15:01:33,041 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b183c3a870a1dc3343cfd6 2026-03-13 15:01:33,041 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 15:01:33,058 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b183c3a870a1dc3343cfd6 HTTP/1.1" 200 None 2026-03-13 15:01:33,060 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 15:01:33,091 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ae8223c660ead8a389aafd HTTP/1.1" 200 None 2026-03-13 15:01:33,093 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 15:01:33,113 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b183c3a870a1dc3343cfd6 HTTP/1.1" 200 None 2026-03-13 15:01:33,114 - lava_callback - ERROR - Error processing callback for node 69b183c3a870a1dc3343cfd6: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:51512 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52426 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37182 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56124 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60424 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:60428 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49426 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49436 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50142 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51524 - "GET / HTTP/1.0" 200 OK 2026-03-13 15:02:53,122 - lava_callback - INFO - Received callback for node 69b1840ca870a1dc3343cfe9 INFO: 172.21.0.1:54698 - "POST /node/69b1840ca870a1dc3343cfe9 HTTP/1.0" 202 Accepted 2026-03-13 15:02:53,127 - lava_callback - INFO - Starting async job submit for node 69b1840ca870a1dc3343cfe9 2026-03-13 15:02:53,128 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 15:02:53,142 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b1840ca870a1dc3343cfe9 HTTP/1.1" 200 None 2026-03-13 15:02:53,143 - lava_callback - DEBUG - Processing node 69b1840ca870a1dc3343cfe9: baseline-arm-baylibre 2026-03-13 15:02:53,143 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b1840ca870a1dc3343cfe9 2026-03-13 15:02:53,144 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 15:02:53,160 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b1840ca870a1dc3343cfe9 HTTP/1.1" 200 None 2026-03-13 15:02:53,161 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 15:02:53,174 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ae8223c660ead8a389aafd HTTP/1.1" 200 None 2026-03-13 15:02:53,176 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 15:02:53,196 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b1840ca870a1dc3343cfe9 HTTP/1.1" 200 None 2026-03-13 15:02:53,206 - lava_callback - ERROR - Error processing callback for node 69b1840ca870a1dc3343cfe9: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:54710 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42466 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44118 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:44122 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45490 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45500 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49240 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49750 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36580 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53772 - "GET / HTTP/1.0" 200 OK 2026-03-13 15:04:13,309 - lava_callback - INFO - Received callback for node 69b1846ba870a1dc3343d006 INFO: 172.21.0.1:59932 - "POST /node/69b1846ba870a1dc3343d006 HTTP/1.0" 202 Accepted 2026-03-13 15:04:13,315 - lava_callback - INFO - Starting async job submit for node 69b1846ba870a1dc3343d006 2026-03-13 15:04:13,316 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 15:04:13,329 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b1846ba870a1dc3343d006 HTTP/1.1" 200 None 2026-03-13 15:04:13,330 - lava_callback - DEBUG - Processing node 69b1846ba870a1dc3343d006: baseline-arm-baylibre 2026-03-13 15:04:13,330 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b1846ba870a1dc3343d006 2026-03-13 15:04:13,331 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 15:04:13,343 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b1846ba870a1dc3343d006 HTTP/1.1" 200 None 2026-03-13 15:04:13,344 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 15:04:13,375 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69abdf2740deb775998f3ba4 HTTP/1.1" 200 None 2026-03-13 15:04:13,377 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 15:04:13,405 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b1846ba870a1dc3343d006 HTTP/1.1" 200 None 2026-03-13 15:04:13,410 - lava_callback - ERROR - Error processing callback for node 69b1846ba870a1dc3343d006: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:59934 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:59944 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53678 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53692 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41754 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48146 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38018 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53832 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48420 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:48422 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51784 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51786 - "GET / HTTP/1.0" 200 OK 2026-03-13 15:05:33,395 - lava_callback - INFO - Received callback for node 69b184b2a870a1dc3343d011 INFO: 172.21.0.1:53878 - "POST /node/69b184b2a870a1dc3343d011 HTTP/1.0" 202 Accepted 2026-03-13 15:05:33,401 - lava_callback - INFO - Starting async job submit for node 69b184b2a870a1dc3343d011 2026-03-13 15:05:33,401 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 15:05:33,416 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b184b2a870a1dc3343d011 HTTP/1.1" 200 None 2026-03-13 15:05:33,417 - lava_callback - DEBUG - Processing node 69b184b2a870a1dc3343d011: baseline-arm-baylibre 2026-03-13 15:05:33,417 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b184b2a870a1dc3343d011 2026-03-13 15:05:33,418 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 15:05:33,432 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b184b2a870a1dc3343d011 HTTP/1.1" 200 None 2026-03-13 15:05:33,433 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 15:05:33,446 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ae8223c660ead8a389aafd HTTP/1.1" 200 None 2026-03-13 15:05:33,448 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 15:05:33,469 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b184b2a870a1dc3343d011 HTTP/1.1" 200 None 2026-03-13 15:05:33,474 - lava_callback - ERROR - Error processing callback for node 69b184b2a870a1dc3343d011: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:53888 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39698 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56236 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34622 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42732 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:42736 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38982 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38992 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54888 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48208 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33578 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59038 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39298 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:39300 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49386 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49402 - "GET / HTTP/1.0" 200 OK 2026-03-13 15:07:33,328 - lava_callback - INFO - Received callback for node 69b18521a870a1dc3343d025 INFO: 172.21.0.1:37534 - "POST /node/69b18521a870a1dc3343d025 HTTP/1.0" 202 Accepted 2026-03-13 15:07:33,333 - lava_callback - INFO - Starting async job submit for node 69b18521a870a1dc3343d025 2026-03-13 15:07:33,334 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 15:07:33,349 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b18521a870a1dc3343d025 HTTP/1.1" 200 None 2026-03-13 15:07:33,350 - lava_callback - DEBUG - Processing node 69b18521a870a1dc3343d025: baseline-arm-baylibre 2026-03-13 15:07:33,350 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b18521a870a1dc3343d025 2026-03-13 15:07:33,351 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 15:07:33,369 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b18521a870a1dc3343d025 HTTP/1.1" 200 None 2026-03-13 15:07:33,370 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 15:07:33,413 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ae8223c660ead8a389aafd HTTP/1.1" 200 None 2026-03-13 15:07:33,415 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 15:07:33,440 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b18521a870a1dc3343d025 HTTP/1.1" 200 None 2026-03-13 15:07:33,441 - lava_callback - ERROR - Error processing callback for node 69b18521a870a1dc3343d025: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:37550 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53868 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43362 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47212 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57754 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:57760 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46646 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46654 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52576 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59230 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45260 - "GET / HTTP/1.0" 200 OK 2026-03-13 15:09:00,967 - lava_callback - INFO - Received callback for node 69b18584a870a1dc3343d034 INFO: 172.21.0.1:42308 - "POST /node/69b18584a870a1dc3343d034 HTTP/1.0" 202 Accepted 2026-03-13 15:09:00,972 - lava_callback - INFO - Starting async job submit for node 69b18584a870a1dc3343d034 2026-03-13 15:09:00,973 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 15:09:00,988 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b18584a870a1dc3343d034 HTTP/1.1" 200 None 2026-03-13 15:09:00,988 - lava_callback - DEBUG - Processing node 69b18584a870a1dc3343d034: baseline-arm-clabbe 2026-03-13 15:09:00,989 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b18584a870a1dc3343d034 2026-03-13 15:09:00,989 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 15:09:01,005 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b18584a870a1dc3343d034 HTTP/1.1" 200 None 2026-03-13 15:09:01,007 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 15:09:01,021 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ae8223c660ead8a389aafd HTTP/1.1" 200 None 2026-03-13 15:09:01,022 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 15:09:01,050 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b18584a870a1dc3343d034 HTTP/1.1" 200 None 2026-03-13 15:09:01,051 - lava_callback - ERROR - Error processing callback for node 69b18584a870a1dc3343d034: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:42310 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33854 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:33864 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57942 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57952 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38638 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34782 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46094 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52782 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53080 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:53090 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60750 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60756 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58048 - "GET / HTTP/1.0" 200 OK 2026-03-13 15:10:40,967 - lava_callback - INFO - Received callback for node 69b185e5a870a1dc3343d043 INFO: 172.21.0.1:35828 - "POST /node/69b185e5a870a1dc3343d043 HTTP/1.0" 202 Accepted 2026-03-13 15:10:40,973 - lava_callback - INFO - Starting async job submit for node 69b185e5a870a1dc3343d043 2026-03-13 15:10:40,973 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 15:10:40,987 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b185e5a870a1dc3343d043 HTTP/1.1" 200 None 2026-03-13 15:10:40,988 - lava_callback - DEBUG - Processing node 69b185e5a870a1dc3343d043: baseline-arm-clabbe 2026-03-13 15:10:40,988 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b185e5a870a1dc3343d043 2026-03-13 15:10:40,989 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 15:10:41,004 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b185e5a870a1dc3343d043 HTTP/1.1" 200 None 2026-03-13 15:10:41,005 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 15:10:41,018 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ae8223c660ead8a389aafd HTTP/1.1" 200 None 2026-03-13 15:10:41,020 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 15:10:41,040 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b185e5a870a1dc3343d043 HTTP/1.1" 200 None 2026-03-13 15:10:41,047 - lava_callback - ERROR - Error processing callback for node 69b185e5a870a1dc3343d043: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:35844 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36270 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39300 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41808 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:41810 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55016 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55024 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33410 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50026 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33816 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53296 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48624 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:48640 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:32874 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:32884 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49316 - "GET / HTTP/1.0" 200 OK 2026-03-13 15:12:41,072 - lava_callback - INFO - Received callback for node 69b18657a870a1dc3343d058 INFO: 172.21.0.1:57386 - "POST /node/69b18657a870a1dc3343d058 HTTP/1.0" 202 Accepted 2026-03-13 15:12:41,077 - lava_callback - INFO - Starting async job submit for node 69b18657a870a1dc3343d058 2026-03-13 15:12:41,078 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 15:12:41,101 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b18657a870a1dc3343d058 HTTP/1.1" 200 None 2026-03-13 15:12:41,102 - lava_callback - DEBUG - Processing node 69b18657a870a1dc3343d058: baseline-arm64-clabbe 2026-03-13 15:12:41,102 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b18657a870a1dc3343d058 2026-03-13 15:12:41,103 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 15:12:41,116 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b18657a870a1dc3343d058 HTTP/1.1" 200 None 2026-03-13 15:12:41,117 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 15:12:41,131 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ae11758ef4424e487b2eb1 HTTP/1.1" 200 None 2026-03-13 15:12:41,133 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 15:12:41,153 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b18657a870a1dc3343d058 HTTP/1.1" 200 None 2026-03-13 15:12:41,159 - lava_callback - ERROR - Error processing callback for node 69b18657a870a1dc3343d058: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:57394 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35740 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45226 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58240 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:58242 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41166 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41174 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56982 - "GET / HTTP/1.0" 200 OK 2026-03-13 15:13:41,093 - lava_callback - INFO - Received callback for node 69b186a1a870a1dc3343d062 INFO: 172.21.0.1:40436 - "POST /node/69b186a1a870a1dc3343d062 HTTP/1.0" 202 Accepted 2026-03-13 15:13:41,098 - lava_callback - INFO - Starting async job submit for node 69b186a1a870a1dc3343d062 2026-03-13 15:13:41,099 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 15:13:41,114 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b186a1a870a1dc3343d062 HTTP/1.1" 200 None 2026-03-13 15:13:41,115 - lava_callback - DEBUG - Processing node 69b186a1a870a1dc3343d062: baseline-arm-clabbe 2026-03-13 15:13:41,115 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b186a1a870a1dc3343d062 2026-03-13 15:13:41,116 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 15:13:41,132 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b186a1a870a1dc3343d062 HTTP/1.1" 200 None 2026-03-13 15:13:41,134 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 15:13:41,151 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ae8223c660ead8a389aafd HTTP/1.1" 200 None 2026-03-13 15:13:41,153 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 15:13:41,174 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b186a1a870a1dc3343d062 HTTP/1.1" 200 None 2026-03-13 15:13:41,181 - lava_callback - ERROR - Error processing callback for node 69b186a1a870a1dc3343d062: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:40444 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44988 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52082 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55268 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:55276 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36888 - "GET / HTTP/1.0" 200 OK 2026-03-13 15:14:21,080 - lava_callback - INFO - Received callback for node 69b186c5a870a1dc3343d072 INFO: 172.21.0.1:36896 - "POST /node/69b186c5a870a1dc3343d072 HTTP/1.0" 202 Accepted 2026-03-13 15:14:21,085 - lava_callback - INFO - Starting async job submit for node 69b186c5a870a1dc3343d072 2026-03-13 15:14:21,086 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 15:14:21,100 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b186c5a870a1dc3343d072 HTTP/1.1" 200 None 2026-03-13 15:14:21,101 - lava_callback - DEBUG - Processing node 69b186c5a870a1dc3343d072: baseline-arm-clabbe 2026-03-13 15:14:21,101 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b186c5a870a1dc3343d072 2026-03-13 15:14:21,102 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 15:14:21,114 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b186c5a870a1dc3343d072 HTTP/1.1" 200 None 2026-03-13 15:14:21,116 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 15:14:21,135 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ae8223c660ead8a389aafd HTTP/1.1" 200 None 2026-03-13 15:14:21,136 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 15:14:21,163 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b186c5a870a1dc3343d072 HTTP/1.1" 200 None 2026-03-13 15:14:21,165 - lava_callback - ERROR - Error processing callback for node 69b186c5a870a1dc3343d072: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:36910 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37336 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44544 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37200 - "GET / HTTP/1.0" 200 OK 2026-03-13 15:15:01,151 - lava_callback - INFO - Received callback for node 69b186eaa870a1dc3343d07c INFO: 172.21.0.1:60516 - "POST /node/69b186eaa870a1dc3343d07c HTTP/1.0" 202 Accepted 2026-03-13 15:15:01,157 - lava_callback - INFO - Starting async job submit for node 69b186eaa870a1dc3343d07c 2026-03-13 15:15:01,158 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 15:15:01,172 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b186eaa870a1dc3343d07c HTTP/1.1" 200 None 2026-03-13 15:15:01,173 - lava_callback - DEBUG - Processing node 69b186eaa870a1dc3343d07c: baseline-arm-clabbe 2026-03-13 15:15:01,173 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b186eaa870a1dc3343d07c 2026-03-13 15:15:01,174 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 15:15:01,193 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b186eaa870a1dc3343d07c HTTP/1.1" 200 None 2026-03-13 15:15:01,194 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 15:15:01,207 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ae8223c660ead8a389aafd HTTP/1.1" 200 None 2026-03-13 15:15:01,208 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 15:15:01,229 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b186eaa870a1dc3343d07c HTTP/1.1" 200 None 2026-03-13 15:15:01,234 - lava_callback - ERROR - Error processing callback for node 69b186eaa870a1dc3343d07c: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:60524 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44746 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:44756 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43654 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43660 - "GET / HTTP/1.0" 200 OK 2026-03-13 15:15:33,771 - lava_callback - INFO - Received callback for node 69b18709a870a1dc3343d088 INFO: 172.21.0.1:41632 - "POST /node/69b18709a870a1dc3343d088 HTTP/1.0" 202 Accepted 2026-03-13 15:15:33,781 - lava_callback - INFO - Starting async job submit for node 69b18709a870a1dc3343d088 2026-03-13 15:15:33,781 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 15:15:33,798 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b18709a870a1dc3343d088 HTTP/1.1" 200 None 2026-03-13 15:15:33,799 - lava_callback - DEBUG - Processing node 69b18709a870a1dc3343d088: baseline-arm-baylibre 2026-03-13 15:15:33,799 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b18709a870a1dc3343d088 2026-03-13 15:15:33,800 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 15:15:33,822 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b18709a870a1dc3343d088 HTTP/1.1" 200 None 2026-03-13 15:15:33,823 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 15:15:33,837 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69abdf2740deb775998f3ba4 HTTP/1.1" 200 None 2026-03-13 15:15:33,838 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 15:15:33,858 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b18709a870a1dc3343d088 HTTP/1.1" 200 None 2026-03-13 15:15:33,871 - lava_callback - ERROR - Error processing callback for node 69b18709a870a1dc3343d088: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:41638 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54782 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45812 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57226 - "GET / HTTP/1.0" 200 OK 2026-03-13 15:16:13,758 - lava_callback - INFO - Received callback for node 69b1872da870a1dc3343d094 INFO: 172.21.0.1:60370 - "POST /node/69b1872da870a1dc3343d094 HTTP/1.0" 202 Accepted 2026-03-13 15:16:13,763 - lava_callback - INFO - Starting async job submit for node 69b1872da870a1dc3343d094 2026-03-13 15:16:13,764 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 15:16:13,780 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b1872da870a1dc3343d094 HTTP/1.1" 200 None 2026-03-13 15:16:13,781 - lava_callback - DEBUG - Processing node 69b1872da870a1dc3343d094: baseline-arm-baylibre 2026-03-13 15:16:13,781 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b1872da870a1dc3343d094 2026-03-13 15:16:13,782 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 15:16:13,799 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b1872da870a1dc3343d094 HTTP/1.1" 200 None 2026-03-13 15:16:13,800 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 15:16:13,814 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69abdf2740deb775998f3ba4 HTTP/1.1" 200 None 2026-03-13 15:16:13,816 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 15:16:13,836 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b1872da870a1dc3343d094 HTTP/1.1" 200 None 2026-03-13 15:16:13,837 - lava_callback - ERROR - Error processing callback for node 69b1872da870a1dc3343d094: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:60386 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:60400 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48050 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48064 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50094 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45300 - "GET / HTTP/1.0" 200 OK 2026-03-13 15:16:53,866 - lava_callback - INFO - Received callback for node 69b18751a870a1dc3343d09f INFO: 172.21.0.1:41966 - "POST /node/69b18751a870a1dc3343d09f HTTP/1.0" 202 Accepted 2026-03-13 15:16:53,871 - lava_callback - INFO - Starting async job submit for node 69b18751a870a1dc3343d09f 2026-03-13 15:16:53,872 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 15:16:53,888 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b18751a870a1dc3343d09f HTTP/1.1" 200 None 2026-03-13 15:16:53,888 - lava_callback - DEBUG - Processing node 69b18751a870a1dc3343d09f: baseline-arm-baylibre 2026-03-13 15:16:53,889 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b18751a870a1dc3343d09f 2026-03-13 15:16:53,889 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 15:16:53,911 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b18751a870a1dc3343d09f HTTP/1.1" 200 None 2026-03-13 15:16:53,913 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 15:16:53,925 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69abdf2740deb775998f3ba4 HTTP/1.1" 200 None 2026-03-13 15:16:53,927 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 15:16:53,947 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b18751a870a1dc3343d09f HTTP/1.1" 200 None 2026-03-13 15:16:53,948 - lava_callback - ERROR - Error processing callback for node 69b18751a870a1dc3343d09f: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:41982 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39742 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40512 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:40520 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47840 - "GET / HTTP/1.0" 200 OK 2026-03-13 15:17:21,271 - lava_callback - INFO - Received callback for node 69b18777a870a1dc3343d0ac INFO: 172.21.0.1:47850 - "POST /node/69b18777a870a1dc3343d0ac HTTP/1.0" 202 Accepted 2026-03-13 15:17:21,277 - lava_callback - INFO - Starting async job submit for node 69b18777a870a1dc3343d0ac 2026-03-13 15:17:21,278 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 15:17:21,314 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b18777a870a1dc3343d0ac HTTP/1.1" 200 None 2026-03-13 15:17:21,315 - lava_callback - DEBUG - Processing node 69b18777a870a1dc3343d0ac: baseline-arm-clabbe 2026-03-13 15:17:21,315 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b18777a870a1dc3343d0ac 2026-03-13 15:17:21,316 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 15:17:21,337 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b18777a870a1dc3343d0ac HTTP/1.1" 200 None 2026-03-13 15:17:21,338 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 15:17:21,351 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69abdf2740deb775998f3ba4 HTTP/1.1" 200 None 2026-03-13 15:17:21,353 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 15:17:21,381 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b18777a870a1dc3343d0ac HTTP/1.1" 200 None 2026-03-13 15:17:21,383 - lava_callback - ERROR - Error processing callback for node 69b18777a870a1dc3343d0ac: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:47858 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56094 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48604 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38864 - "GET / HTTP/1.0" 200 OK 2026-03-13 15:18:01,268 - lava_callback - INFO - Received callback for node 69b1879ba870a1dc3343d0b6 INFO: 172.21.0.1:40018 - "POST /node/69b1879ba870a1dc3343d0b6 HTTP/1.0" 202 Accepted 2026-03-13 15:18:01,274 - lava_callback - INFO - Starting async job submit for node 69b1879ba870a1dc3343d0b6 2026-03-13 15:18:01,275 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 15:18:01,295 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b1879ba870a1dc3343d0b6 HTTP/1.1" 200 None 2026-03-13 15:18:01,296 - lava_callback - DEBUG - Processing node 69b1879ba870a1dc3343d0b6: baseline-arm-clabbe 2026-03-13 15:18:01,296 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b1879ba870a1dc3343d0b6 2026-03-13 15:18:01,297 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 15:18:01,310 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b1879ba870a1dc3343d0b6 HTTP/1.1" 200 None 2026-03-13 15:18:01,311 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 15:18:01,326 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69abdf2740deb775998f3ba4 HTTP/1.1" 200 None 2026-03-13 15:18:01,327 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 15:18:01,347 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b1879ba870a1dc3343d0b6 HTTP/1.1" 200 None 2026-03-13 15:18:01,348 - lava_callback - ERROR - Error processing callback for node 69b1879ba870a1dc3343d0b6: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:40020 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59290 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:59296 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60744 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60752 - "GET / HTTP/1.0" 200 OK 2026-03-13 15:18:33,943 - lava_callback - INFO - Received callback for node 69b187bda870a1dc3343d0c1 INFO: 172.21.0.1:43436 - "POST /node/69b187bda870a1dc3343d0c1 HTTP/1.0" 202 Accepted 2026-03-13 15:18:33,948 - lava_callback - INFO - Starting async job submit for node 69b187bda870a1dc3343d0c1 2026-03-13 15:18:33,949 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 15:18:33,963 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b187bda870a1dc3343d0c1 HTTP/1.1" 200 None 2026-03-13 15:18:33,964 - lava_callback - DEBUG - Processing node 69b187bda870a1dc3343d0c1: baseline-arm-baylibre 2026-03-13 15:18:33,964 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b187bda870a1dc3343d0c1 2026-03-13 15:18:33,965 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 15:18:33,978 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b187bda870a1dc3343d0c1 HTTP/1.1" 200 None 2026-03-13 15:18:33,980 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 15:18:33,992 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69abdf2740deb775998f3ba4 HTTP/1.1" 200 None 2026-03-13 15:18:33,994 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 15:18:34,017 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b187bda870a1dc3343d0c1 HTTP/1.1" 200 None 2026-03-13 15:18:34,023 - lava_callback - ERROR - Error processing callback for node 69b187bda870a1dc3343d0c1: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:43450 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50670 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33360 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41072 - "GET / HTTP/1.0" 200 OK 2026-03-13 15:19:13,932 - lava_callback - INFO - Received callback for node 69b187e2a870a1dc3343d0d5 INFO: 172.21.0.1:38374 - "POST /node/69b187e2a870a1dc3343d0d5 HTTP/1.0" 202 Accepted 2026-03-13 15:19:13,938 - lava_callback - INFO - Starting async job submit for node 69b187e2a870a1dc3343d0d5 2026-03-13 15:19:13,939 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 15:19:13,953 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b187e2a870a1dc3343d0d5 HTTP/1.1" 200 None 2026-03-13 15:19:13,954 - lava_callback - DEBUG - Processing node 69b187e2a870a1dc3343d0d5: baseline-arm-baylibre 2026-03-13 15:19:13,954 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b187e2a870a1dc3343d0d5 2026-03-13 15:19:13,955 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 15:19:13,968 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b187e2a870a1dc3343d0d5 HTTP/1.1" 200 None 2026-03-13 15:19:13,970 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 15:19:13,984 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69abdf2740deb775998f3ba4 HTTP/1.1" 200 None 2026-03-13 15:19:13,986 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 15:19:14,020 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b187e2a870a1dc3343d0d5 HTTP/1.1" 200 None 2026-03-13 15:19:14,025 - lava_callback - ERROR - Error processing callback for node 69b187e2a870a1dc3343d0d5: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:38380 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:38388 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50356 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50372 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44224 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40724 - "GET / HTTP/1.0" 200 OK 2026-03-13 15:19:54,570 - lava_callback - INFO - Received callback for node 69b1880ca870a1dc3343d0e7 INFO: 172.21.0.1:51110 - "POST /node/69b1880ca870a1dc3343d0e7 HTTP/1.0" 202 Accepted 2026-03-13 15:19:54,575 - lava_callback - INFO - Starting async job submit for node 69b1880ca870a1dc3343d0e7 2026-03-13 15:19:54,576 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 15:19:54,617 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b1880ca870a1dc3343d0e7 HTTP/1.1" 200 None 2026-03-13 15:19:54,618 - lava_callback - DEBUG - Processing node 69b1880ca870a1dc3343d0e7: baseline-arm64-baylibre 2026-03-13 15:19:54,618 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b1880ca870a1dc3343d0e7 2026-03-13 15:19:54,619 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 15:19:54,635 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b1880ca870a1dc3343d0e7 HTTP/1.1" 200 None 2026-03-13 15:19:54,636 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 15:19:54,649 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ae822fc660ead8a389ab0e HTTP/1.1" 200 None 2026-03-13 15:19:54,651 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 15:19:54,671 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b1880ca870a1dc3343d0e7 HTTP/1.1" 200 None 2026-03-13 15:19:54,676 - lava_callback - ERROR - Error processing callback for node 69b1880ca870a1dc3343d0e7: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:51120 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56020 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42452 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:42464 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51092 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51102 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44584 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41766 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36054 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54674 - "GET / HTTP/1.0" 200 OK 2026-03-13 15:21:14,076 - lava_callback - INFO - Received callback for node 69b18857a870a1dc3343d0f3 INFO: 172.21.0.1:50162 - "POST /node/69b18857a870a1dc3343d0f3 HTTP/1.0" 202 Accepted 2026-03-13 15:21:14,081 - lava_callback - INFO - Starting async job submit for node 69b18857a870a1dc3343d0f3 2026-03-13 15:21:14,082 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 15:21:14,098 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b18857a870a1dc3343d0f3 HTTP/1.1" 200 None 2026-03-13 15:21:14,099 - lava_callback - DEBUG - Processing node 69b18857a870a1dc3343d0f3: baseline-arm64-baylibre 2026-03-13 15:21:14,099 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b18857a870a1dc3343d0f3 2026-03-13 15:21:14,100 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 15:21:14,119 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b18857a870a1dc3343d0f3 HTTP/1.1" 200 None 2026-03-13 15:21:14,120 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 15:21:14,133 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ae822fc660ead8a389ab0e HTTP/1.1" 200 None 2026-03-13 15:21:14,135 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 15:21:14,155 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b18857a870a1dc3343d0f3 HTTP/1.1" 200 None 2026-03-13 15:21:14,161 - lava_callback - ERROR - Error processing callback for node 69b18857a870a1dc3343d0f3: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:50164 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:50172 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37048 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37050 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60146 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54032 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43684 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37790 - "GET / HTTP/1.0" 200 OK 2026-03-13 15:22:14,111 - lava_callback - INFO - Received callback for node 69b188a2a870a1dc3343d0ff 2026-03-13 15:22:14,128 - lava_callback - INFO - Starting async job submit for node 69b188a2a870a1dc3343d0ff INFO: 172.21.0.1:39354 - "POST /node/69b188a2a870a1dc3343d0ff HTTP/1.0" 202 Accepted 2026-03-13 15:22:14,131 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 15:22:14,181 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b188a2a870a1dc3343d0ff HTTP/1.1" 200 None 2026-03-13 15:22:14,182 - lava_callback - DEBUG - Processing node 69b188a2a870a1dc3343d0ff: baseline-arm64-baylibre 2026-03-13 15:22:14,183 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b188a2a870a1dc3343d0ff 2026-03-13 15:22:14,184 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 15:22:14,209 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b188a2a870a1dc3343d0ff HTTP/1.1" 200 None 2026-03-13 15:22:14,210 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 15:22:14,227 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ae822fc660ead8a389ab0e HTTP/1.1" 200 None 2026-03-13 15:22:14,229 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 15:22:14,254 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b188a2a870a1dc3343d0ff HTTP/1.1" 200 None 2026-03-13 15:22:14,255 - lava_callback - ERROR - Error processing callback for node 69b188a2a870a1dc3343d0ff: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:39358 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:39366 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34490 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34500 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40564 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40906 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52784 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42926 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47816 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:47828 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44176 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44184 - "GET / HTTP/1.0" 200 OK 2026-03-13 15:23:34,318 - lava_callback - INFO - Received callback for node 69b188eda870a1dc3343d10b INFO: 172.21.0.1:36056 - "POST /node/69b188eda870a1dc3343d10b HTTP/1.0" 202 Accepted 2026-03-13 15:23:34,323 - lava_callback - INFO - Starting async job submit for node 69b188eda870a1dc3343d10b 2026-03-13 15:23:34,324 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 15:23:34,338 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b188eda870a1dc3343d10b HTTP/1.1" 200 None 2026-03-13 15:23:34,339 - lava_callback - DEBUG - Processing node 69b188eda870a1dc3343d10b: baseline-arm64-baylibre 2026-03-13 15:23:34,339 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b188eda870a1dc3343d10b 2026-03-13 15:23:34,340 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 15:23:34,353 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b188eda870a1dc3343d10b HTTP/1.1" 200 None 2026-03-13 15:23:34,355 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 15:23:34,368 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ae822fc660ead8a389ab0e HTTP/1.1" 200 None 2026-03-13 15:23:34,369 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 15:23:34,390 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b188eda870a1dc3343d10b HTTP/1.1" 200 None 2026-03-13 15:23:34,392 - lava_callback - ERROR - Error processing callback for node 69b188eda870a1dc3343d10b: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:36068 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:32952 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60312 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55296 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38524 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:38534 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54500 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54502 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53802 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42824 - "GET / HTTP/1.0" 200 OK 2026-03-13 15:24:54,322 - lava_callback - INFO - Received callback for node 69b18938a870a1dc3343d117 INFO: 172.21.0.1:40892 - "POST /node/69b18938a870a1dc3343d117 HTTP/1.0" 202 Accepted 2026-03-13 15:24:54,331 - lava_callback - INFO - Starting async job submit for node 69b18938a870a1dc3343d117 2026-03-13 15:24:54,332 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 15:24:54,346 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b18938a870a1dc3343d117 HTTP/1.1" 200 None 2026-03-13 15:24:54,347 - lava_callback - DEBUG - Processing node 69b18938a870a1dc3343d117: baseline-arm64-baylibre 2026-03-13 15:24:54,347 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b18938a870a1dc3343d117 2026-03-13 15:24:54,348 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 15:24:54,361 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b18938a870a1dc3343d117 HTTP/1.1" 200 None 2026-03-13 15:24:54,363 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 15:24:54,376 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ae822fc660ead8a389ab0e HTTP/1.1" 200 None 2026-03-13 15:24:54,377 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 15:24:54,398 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b18938a870a1dc3343d117 HTTP/1.1" 200 None 2026-03-13 15:24:54,408 - lava_callback - ERROR - Error processing callback for node 69b18938a870a1dc3343d117: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:40904 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35846 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44854 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:44856 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59284 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59294 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50400 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46260 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55766 - "GET / HTTP/1.0" 200 OK 2026-03-13 15:25:57,602 - lava_callback - INFO - Received callback for node 69b363c6974c91e64560ed58 INFO: 172.21.0.1:55778 - "POST /node/69b363c6974c91e64560ed58 HTTP/1.0" 202 Accepted 2026-03-13 15:25:57,607 - lava_callback - INFO - Starting async job submit for node 69b363c6974c91e64560ed58 2026-03-13 15:25:57,631 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 15:25:57,650 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b363c6974c91e64560ed58 HTTP/1.1" 200 None 2026-03-13 15:25:57,651 - lava_callback - DEBUG - Processing node 69b363c6974c91e64560ed58: baseline-arm64-broonie 2026-03-13 15:25:57,866 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-13 15:25:58,097 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-13 15:25:58,099 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69b363c6974c91e64560ed58/log.txt.gz 2026-03-13 15:25:58,230 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-13 15:25:58,439 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-13 15:25:58,441 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69b363c6974c91e64560ed58/lava-logs.yaml 2026-03-13 15:25:58,448 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-13 15:25:58,612 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-13 15:25:58,614 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69b363c6974c91e64560ed58/lava_callback.json.gz 2026-03-13 15:25:58,637 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 15:25:58,661 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b363c6974c91e64560ed58 HTTP/1.1" 200 None 2026-03-13 15:25:58,664 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 15:25:58,679 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b3594d974c91e64560e4b2 HTTP/1.1" 200 None 2026-03-13 15:25:58,681 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 15:25:58,726 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b363c6974c91e64560ed58 HTTP/1.1" 200 None 2026-03-13 15:25:58,728 - lava_callback - INFO - Completed processing callback for node 69b363c6974c91e64560ed58 INFO: 172.21.0.1:50530 - "GET / HTTP/1.0" 200 OK 2026-03-13 15:26:14,404 - lava_callback - INFO - Received callback for node 69b18982a870a1dc3343d121 INFO: 172.21.0.1:56770 - "POST /node/69b18982a870a1dc3343d121 HTTP/1.0" 202 Accepted 2026-03-13 15:26:14,409 - lava_callback - INFO - Starting async job submit for node 69b18982a870a1dc3343d121 2026-03-13 15:26:14,410 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 15:26:14,424 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b18982a870a1dc3343d121 HTTP/1.1" 200 None 2026-03-13 15:26:14,425 - lava_callback - DEBUG - Processing node 69b18982a870a1dc3343d121: baseline-arm64-baylibre 2026-03-13 15:26:14,425 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b18982a870a1dc3343d121 2026-03-13 15:26:14,426 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 15:26:14,439 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b18982a870a1dc3343d121 HTTP/1.1" 200 None 2026-03-13 15:26:14,441 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 15:26:14,454 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ae822fc660ead8a389ab0e HTTP/1.1" 200 None 2026-03-13 15:26:14,455 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 15:26:14,477 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b18982a870a1dc3343d121 HTTP/1.1" 200 None 2026-03-13 15:26:14,478 - lava_callback - ERROR - Error processing callback for node 69b18982a870a1dc3343d121: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:56786 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:56802 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44588 - "GET / HTTP/1.0" 200 OK 2026-03-13 15:26:22,170 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 15:26:22,186 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:44594 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45990 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42064 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50970 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57430 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41300 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:41302 - "GET / HTTP/1.0" 200 OK 2026-03-13 15:27:18,607 - lava_callback - INFO - Received callback for node 69b3bba8974c91e64560ffc8 INFO: 172.21.0.1:41306 - "POST /node/69b3bba8974c91e64560ffc8 HTTP/1.0" 202 Accepted 2026-03-13 15:27:18,613 - lava_callback - INFO - Starting async job submit for node 69b3bba8974c91e64560ffc8 2026-03-13 15:27:18,637 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 15:27:18,652 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b3bba8974c91e64560ffc8 HTTP/1.1" 200 None 2026-03-13 15:27:18,653 - lava_callback - DEBUG - Processing node 69b3bba8974c91e64560ffc8: baseline-arm64-broonie 2026-03-13 15:27:18,886 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-13 15:27:19,054 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-13 15:27:19,055 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69b3bba8974c91e64560ffc8/log.txt.gz 2026-03-13 15:27:19,184 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-13 15:27:19,394 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-13 15:27:19,396 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69b3bba8974c91e64560ffc8/lava-logs.yaml 2026-03-13 15:27:19,401 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-13 15:27:19,568 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-13 15:27:19,570 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69b3bba8974c91e64560ffc8/lava_callback.json.gz 2026-03-13 15:27:19,592 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 15:27:19,605 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b3bba8974c91e64560ffc8 HTTP/1.1" 200 None 2026-03-13 15:27:19,607 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 15:27:19,620 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b3594d974c91e64560e4b2 HTTP/1.1" 200 None 2026-03-13 15:27:19,622 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 15:27:19,651 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b3bba8974c91e64560ffc8 HTTP/1.1" 200 None 2026-03-13 15:27:19,653 - lava_callback - INFO - Completed processing callback for node 69b3bba8974c91e64560ffc8 INFO: 172.21.0.1:40986 - "GET / HTTP/1.0" 200 OK 2026-03-13 15:27:21,737 - lava_callback - INFO - Received callback for node 69b189c4a870a1dc3343d128 INFO: 172.21.0.1:40996 - "POST /node/69b189c4a870a1dc3343d128 HTTP/1.0" 202 Accepted 2026-03-13 15:27:21,743 - lava_callback - INFO - Starting async job submit for node 69b189c4a870a1dc3343d128 2026-03-13 15:27:21,743 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 15:27:21,757 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b189c4a870a1dc3343d128 HTTP/1.1" 200 None 2026-03-13 15:27:21,758 - lava_callback - DEBUG - Processing node 69b189c4a870a1dc3343d128: baseline-arm-clabbe 2026-03-13 15:27:21,758 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b189c4a870a1dc3343d128 2026-03-13 15:27:21,759 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 15:27:21,771 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b189c4a870a1dc3343d128 HTTP/1.1" 200 None 2026-03-13 15:27:21,773 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 15:27:21,788 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69abdf2740deb775998f3ba4 HTTP/1.1" 200 None 2026-03-13 15:27:21,790 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 15:27:21,811 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b189c4a870a1dc3343d128 HTTP/1.1" 200 None 2026-03-13 15:27:21,812 - lava_callback - ERROR - Error processing callback for node 69b189c4a870a1dc3343d128: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' 2026-03-13 15:27:22,188 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 15:27:22,207 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:41008 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60272 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34268 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46396 - "GET / HTTP/1.0" 200 OK 2026-03-13 15:28:01,770 - lava_callback - INFO - Received callback for node 69b189f5a870a1dc3343d138 INFO: 172.21.0.1:38894 - "POST /node/69b189f5a870a1dc3343d138 HTTP/1.0" 202 Accepted 2026-03-13 15:28:01,775 - lava_callback - INFO - Starting async job submit for node 69b189f5a870a1dc3343d138 2026-03-13 15:28:01,776 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 15:28:01,790 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b189f5a870a1dc3343d138 HTTP/1.1" 200 None 2026-03-13 15:28:01,791 - lava_callback - DEBUG - Processing node 69b189f5a870a1dc3343d138: baseline-arm64-clabbe 2026-03-13 15:28:01,791 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b189f5a870a1dc3343d138 2026-03-13 15:28:01,792 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 15:28:01,805 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b189f5a870a1dc3343d138 HTTP/1.1" 200 None 2026-03-13 15:28:01,806 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 15:28:01,819 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ae822fc660ead8a389ab0e HTTP/1.1" 200 None 2026-03-13 15:28:01,821 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 15:28:01,840 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b189f5a870a1dc3343d138 HTTP/1.1" 200 None 2026-03-13 15:28:01,846 - lava_callback - ERROR - Error processing callback for node 69b189f5a870a1dc3343d138: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:38898 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46310 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:46318 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41974 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41988 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60218 - "GET / HTTP/1.0" 200 OK 2026-03-13 15:28:37,141 - lava_callback - INFO - Received callback for node 69b3cffc1727ff69d6f2254a INFO: 172.21.0.1:60220 - "POST /node/69b3cffc1727ff69d6f2254a HTTP/1.0" 202 Accepted 2026-03-13 15:28:37,147 - lava_callback - INFO - Starting async job submit for node 69b3cffc1727ff69d6f2254a 2026-03-13 15:28:37,174 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 15:28:37,189 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b3cffc1727ff69d6f2254a HTTP/1.1" 200 None 2026-03-13 15:28:37,190 - lava_callback - DEBUG - Processing node 69b3cffc1727ff69d6f2254a: baseline-arm64-broonie 2026-03-13 15:28:37,402 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-13 15:28:37,554 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-13 15:28:37,556 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69b3cffc1727ff69d6f2254a/log.txt.gz 2026-03-13 15:28:37,685 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-13 15:28:37,885 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-13 15:28:37,887 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69b3cffc1727ff69d6f2254a/lava-logs.yaml 2026-03-13 15:28:37,893 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-13 15:28:38,039 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-13 15:28:38,041 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69b3cffc1727ff69d6f2254a/lava_callback.json.gz 2026-03-13 15:28:38,064 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 15:28:38,082 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b3cffc1727ff69d6f2254a HTTP/1.1" 200 None 2026-03-13 15:28:38,083 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 15:28:38,116 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b3c8061727ff69d6f21d98 HTTP/1.1" 200 None 2026-03-13 15:28:38,118 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 15:28:38,143 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b3cffc1727ff69d6f2254a HTTP/1.1" 200 None 2026-03-13 15:28:38,144 - lava_callback - INFO - Completed processing callback for node 69b3cffc1727ff69d6f2254a INFO: 172.21.0.1:48826 - "GET / HTTP/1.0" 200 OK 2026-03-13 15:28:52,210 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 15:28:52,227 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:38156 - "GET / HTTP/1.0" 200 OK 2026-03-13 15:28:57,485 - lava_callback - INFO - Received callback for node 69b412601727ff69d6f22f46 INFO: 172.21.0.1:38164 - "POST /node/69b412601727ff69d6f22f46 HTTP/1.0" 202 Accepted 2026-03-13 15:28:57,491 - lava_callback - INFO - Starting async job submit for node 69b412601727ff69d6f22f46 2026-03-13 15:28:57,513 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 15:28:57,534 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b412601727ff69d6f22f46 HTTP/1.1" 200 None 2026-03-13 15:28:57,535 - lava_callback - DEBUG - Processing node 69b412601727ff69d6f22f46: baseline-arm64-broonie 2026-03-13 15:28:57,747 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-13 15:28:57,862 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-13 15:28:57,864 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69b412601727ff69d6f22f46/log.txt.gz 2026-03-13 15:28:58,010 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-13 15:28:58,202 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-13 15:28:58,204 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69b412601727ff69d6f22f46/lava-logs.yaml 2026-03-13 15:28:58,210 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-13 15:28:58,359 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-13 15:28:58,361 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69b412601727ff69d6f22f46/lava_callback.json.gz 2026-03-13 15:28:58,384 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 15:28:58,398 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b412601727ff69d6f22f46 HTTP/1.1" 200 None 2026-03-13 15:28:58,399 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 15:28:58,413 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b3594d974c91e64560e4b2 HTTP/1.1" 200 None 2026-03-13 15:28:58,415 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 15:28:58,440 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b412601727ff69d6f22f46 HTTP/1.1" 200 None 2026-03-13 15:28:58,445 - lava_callback - INFO - Completed processing callback for node 69b412601727ff69d6f22f46 INFO: 172.21.0.1:45356 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58106 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:58114 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42378 - "GET / HTTP/1.0" 200 OK 2026-03-13 15:29:21,868 - lava_callback - INFO - Received callback for node 69b18a40a870a1dc3343d140 INFO: 172.21.0.1:42384 - "POST /node/69b18a40a870a1dc3343d140 HTTP/1.0" 202 Accepted 2026-03-13 15:29:21,873 - lava_callback - INFO - Starting async job submit for node 69b18a40a870a1dc3343d140 2026-03-13 15:29:21,874 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 15:29:21,887 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b18a40a870a1dc3343d140 HTTP/1.1" 200 None 2026-03-13 15:29:21,888 - lava_callback - DEBUG - Processing node 69b18a40a870a1dc3343d140: baseline-arm64-clabbe 2026-03-13 15:29:21,888 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b18a40a870a1dc3343d140 2026-03-13 15:29:21,889 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 15:29:21,903 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b18a40a870a1dc3343d140 HTTP/1.1" 200 None 2026-03-13 15:29:21,904 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 15:29:21,917 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ae822fc660ead8a389ab0e HTTP/1.1" 200 None 2026-03-13 15:29:21,918 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 15:29:21,938 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b18a40a870a1dc3343d140 HTTP/1.1" 200 None 2026-03-13 15:29:21,940 - lava_callback - ERROR - Error processing callback for node 69b18a40a870a1dc3343d140: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' 2026-03-13 15:29:22,230 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 15:29:22,245 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:42390 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49894 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56236 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42660 - "GET / HTTP/1.0" 200 OK 2026-03-13 15:29:57,302 - lava_callback - INFO - Received callback for node 69b428071727ff69d6f2329d INFO: 172.21.0.1:42662 - "POST /node/69b428071727ff69d6f2329d HTTP/1.0" 202 Accepted 2026-03-13 15:29:57,308 - lava_callback - INFO - Starting async job submit for node 69b428071727ff69d6f2329d 2026-03-13 15:29:57,330 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 15:29:57,343 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b428071727ff69d6f2329d HTTP/1.1" 200 None 2026-03-13 15:29:57,344 - lava_callback - DEBUG - Processing node 69b428071727ff69d6f2329d: baseline-arm64-broonie 2026-03-13 15:29:57,553 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-13 15:29:57,713 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-13 15:29:57,715 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69b428071727ff69d6f2329d/log.txt.gz 2026-03-13 15:29:57,889 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-13 15:29:58,109 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-13 15:29:58,111 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69b428071727ff69d6f2329d/lava-logs.yaml 2026-03-13 15:29:58,117 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-13 15:29:58,278 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-13 15:29:58,280 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69b428071727ff69d6f2329d/lava_callback.json.gz 2026-03-13 15:29:58,302 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 15:29:58,316 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b428071727ff69d6f2329d HTTP/1.1" 200 None 2026-03-13 15:29:58,317 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 15:29:58,330 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b3c8061727ff69d6f21d98 HTTP/1.1" 200 None 2026-03-13 15:29:58,332 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 15:29:58,356 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b428071727ff69d6f2329d HTTP/1.1" 200 None 2026-03-13 15:29:58,357 - lava_callback - INFO - Completed processing callback for node 69b428071727ff69d6f2329d INFO: 172.21.0.1:53236 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54084 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:54094 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47546 - "GET / HTTP/1.0" 200 OK 2026-03-13 15:30:22,248 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 15:30:22,264 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:47560 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37802 - "GET / HTTP/1.0" 200 OK 2026-03-13 15:30:41,922 - lava_callback - INFO - Received callback for node 69b18a8ca870a1dc3343d14b INFO: 172.21.0.1:47750 - "POST /node/69b18a8ca870a1dc3343d14b HTTP/1.0" 202 Accepted 2026-03-13 15:30:41,928 - lava_callback - INFO - Starting async job submit for node 69b18a8ca870a1dc3343d14b 2026-03-13 15:30:41,929 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 15:30:41,943 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b18a8ca870a1dc3343d14b HTTP/1.1" 200 None 2026-03-13 15:30:41,943 - lava_callback - DEBUG - Processing node 69b18a8ca870a1dc3343d14b: baseline-arm64-clabbe 2026-03-13 15:30:41,944 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b18a8ca870a1dc3343d14b 2026-03-13 15:30:41,944 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 15:30:41,958 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b18a8ca870a1dc3343d14b HTTP/1.1" 200 None 2026-03-13 15:30:41,960 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 15:30:41,974 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ae822fc660ead8a389ab0e HTTP/1.1" 200 None 2026-03-13 15:30:41,975 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 15:30:41,996 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b18a8ca870a1dc3343d14b HTTP/1.1" 200 None 2026-03-13 15:30:42,000 - lava_callback - ERROR - Error processing callback for node 69b18a8ca870a1dc3343d14b: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:47758 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48502 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56304 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35932 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:35944 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50496 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50504 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57998 - "GET / HTTP/1.0" 200 OK 2026-03-13 15:31:41,909 - lava_callback - INFO - Received callback for node 69b18ad6a870a1dc3343d150 INFO: 172.21.0.1:38476 - "POST /node/69b18ad6a870a1dc3343d150 HTTP/1.0" 202 Accepted 2026-03-13 15:31:41,915 - lava_callback - INFO - Starting async job submit for node 69b18ad6a870a1dc3343d150 2026-03-13 15:31:41,915 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 15:31:41,930 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b18ad6a870a1dc3343d150 HTTP/1.1" 200 None 2026-03-13 15:31:41,931 - lava_callback - DEBUG - Processing node 69b18ad6a870a1dc3343d150: baseline-arm64-clabbe 2026-03-13 15:31:41,931 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b18ad6a870a1dc3343d150 2026-03-13 15:31:41,932 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 15:31:41,946 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b18ad6a870a1dc3343d150 HTTP/1.1" 200 None 2026-03-13 15:31:41,947 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 15:31:41,960 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ae822fc660ead8a389ab0e HTTP/1.1" 200 None 2026-03-13 15:31:41,962 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 15:31:41,988 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b18ad6a870a1dc3343d150 HTTP/1.1" 200 None 2026-03-13 15:31:41,989 - lava_callback - ERROR - Error processing callback for node 69b18ad6a870a1dc3343d150: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:38478 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37274 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42136 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46254 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:46260 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60446 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60456 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46656 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52234 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48976 - "GET / HTTP/1.0" 200 OK 2026-03-13 15:33:01,969 - lava_callback - INFO - Received callback for node 69b18b20a870a1dc3343d160 INFO: 172.21.0.1:55190 - "POST /node/69b18b20a870a1dc3343d160 HTTP/1.0" 202 Accepted 2026-03-13 15:33:01,974 - lava_callback - INFO - Starting async job submit for node 69b18b20a870a1dc3343d160 2026-03-13 15:33:01,975 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 15:33:01,990 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b18b20a870a1dc3343d160 HTTP/1.1" 200 None 2026-03-13 15:33:01,990 - lava_callback - DEBUG - Processing node 69b18b20a870a1dc3343d160: baseline-arm64-clabbe 2026-03-13 15:33:01,991 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b18b20a870a1dc3343d160 2026-03-13 15:33:01,991 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 15:33:02,005 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b18b20a870a1dc3343d160 HTTP/1.1" 200 None 2026-03-13 15:33:02,006 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 15:33:02,019 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ae822fc660ead8a389ab0e HTTP/1.1" 200 None 2026-03-13 15:33:02,021 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 15:33:02,042 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b18b20a870a1dc3343d160 HTTP/1.1" 200 None 2026-03-13 15:33:02,049 - lava_callback - ERROR - Error processing callback for node 69b18b20a870a1dc3343d160: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:55202 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56370 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:56378 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35624 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35634 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44572 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40440 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33070 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53300 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39088 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:39096 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39102 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34490 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34502 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49924 - "GET /favicon.ico HTTP/1.0" 404 Not Found INFO: 172.21.0.1:49932 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51066 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51568 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40540 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34156 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:34162 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51258 - "GET / HTTP/1.0" 200 OK 2026-03-13 15:35:22,123 - lava_callback - INFO - Received callback for node 69b18baca870a1dc3343d16e INFO: 172.21.0.1:51274 - "POST /node/69b18baca870a1dc3343d16e HTTP/1.0" 202 Accepted 2026-03-13 15:35:22,128 - lava_callback - INFO - Starting async job submit for node 69b18baca870a1dc3343d16e 2026-03-13 15:35:22,129 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 15:35:22,144 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b18baca870a1dc3343d16e HTTP/1.1" 200 None 2026-03-13 15:35:22,144 - lava_callback - DEBUG - Processing node 69b18baca870a1dc3343d16e: baseline-arm64-clabbe 2026-03-13 15:35:22,145 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b18baca870a1dc3343d16e 2026-03-13 15:35:22,145 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 15:35:22,158 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b18baca870a1dc3343d16e HTTP/1.1" 200 None 2026-03-13 15:35:22,159 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 15:35:22,172 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ae822fc660ead8a389ab0e HTTP/1.1" 200 None 2026-03-13 15:35:22,174 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 15:35:22,194 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b18baca870a1dc3343d16e HTTP/1.1" 200 None 2026-03-13 15:35:22,196 - lava_callback - ERROR - Error processing callback for node 69b18baca870a1dc3343d16e: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:51282 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37832 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35062 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43638 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53108 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49450 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:49458 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50938 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50950 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53370 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56818 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57832 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46600 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44364 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:44366 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52114 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52120 - "GET / HTTP/1.0" 200 OK 2026-03-13 15:37:34,955 - lava_callback - INFO - Received callback for node 69b18c35a870a1dc3343d18a INFO: 172.21.0.1:41782 - "POST /node/69b18c35a870a1dc3343d18a HTTP/1.0" 202 Accepted 2026-03-13 15:37:34,960 - lava_callback - INFO - Starting async job submit for node 69b18c35a870a1dc3343d18a 2026-03-13 15:37:34,961 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 15:37:34,976 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b18c35a870a1dc3343d18a HTTP/1.1" 200 None 2026-03-13 15:37:34,977 - lava_callback - DEBUG - Processing node 69b18c35a870a1dc3343d18a: baseline-arm64-baylibre 2026-03-13 15:37:34,977 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b18c35a870a1dc3343d18a 2026-03-13 15:37:34,978 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 15:37:34,991 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b18c35a870a1dc3343d18a HTTP/1.1" 200 None 2026-03-13 15:37:34,993 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 15:37:35,014 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69abdf3340deb775998f3bb5 HTTP/1.1" 200 None 2026-03-13 15:37:35,015 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 15:37:35,056 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b18c35a870a1dc3343d18a HTTP/1.1" 200 None 2026-03-13 15:37:35,057 - lava_callback - ERROR - Error processing callback for node 69b18c35a870a1dc3343d18a: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:41796 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42198 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56786 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57518 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35266 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:35274 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47364 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47378 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54294 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58300 - "GET / HTTP/1.0" 200 OK 2026-03-13 15:38:55,002 - lava_callback - INFO - Received callback for node 69b18c85a870a1dc3343d198 INFO: 172.21.0.1:34042 - "POST /node/69b18c85a870a1dc3343d198 HTTP/1.0" 202 Accepted 2026-03-13 15:38:55,007 - lava_callback - INFO - Starting async job submit for node 69b18c85a870a1dc3343d198 2026-03-13 15:38:55,008 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 15:38:55,023 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b18c85a870a1dc3343d198 HTTP/1.1" 200 None 2026-03-13 15:38:55,024 - lava_callback - DEBUG - Processing node 69b18c85a870a1dc3343d198: baseline-arm64-baylibre 2026-03-13 15:38:55,024 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b18c85a870a1dc3343d198 2026-03-13 15:38:55,025 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 15:38:55,037 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b18c85a870a1dc3343d198 HTTP/1.1" 200 None 2026-03-13 15:38:55,039 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 15:38:55,051 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69abdf3340deb775998f3bb5 HTTP/1.1" 200 None 2026-03-13 15:38:55,053 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 15:38:55,073 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b18c85a870a1dc3343d198 HTTP/1.1" 200 None 2026-03-13 15:38:55,074 - lava_callback - ERROR - Error processing callback for node 69b18c85a870a1dc3343d198: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:34052 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33998 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43028 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:43030 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52870 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52880 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34994 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60248 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42370 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33760 - "GET / HTTP/1.0" 200 OK 2026-03-13 15:40:15,087 - lava_callback - INFO - Received callback for node 69b18cd3a870a1dc3343d1a3 INFO: 172.21.0.1:50810 - "POST /node/69b18cd3a870a1dc3343d1a3 HTTP/1.0" 202 Accepted 2026-03-13 15:40:15,093 - lava_callback - INFO - Starting async job submit for node 69b18cd3a870a1dc3343d1a3 2026-03-13 15:40:15,093 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 15:40:15,108 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b18cd3a870a1dc3343d1a3 HTTP/1.1" 200 None 2026-03-13 15:40:15,109 - lava_callback - DEBUG - Processing node 69b18cd3a870a1dc3343d1a3: baseline-arm64-baylibre 2026-03-13 15:40:15,109 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b18cd3a870a1dc3343d1a3 2026-03-13 15:40:15,109 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 15:40:15,123 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b18cd3a870a1dc3343d1a3 HTTP/1.1" 200 None 2026-03-13 15:40:15,124 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 15:40:15,137 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69abdf3340deb775998f3bb5 HTTP/1.1" 200 None 2026-03-13 15:40:15,138 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 15:40:15,158 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b18cd3a870a1dc3343d1a3 HTTP/1.1" 200 None 2026-03-13 15:40:15,164 - lava_callback - ERROR - Error processing callback for node 69b18cd3a870a1dc3343d1a3: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:50816 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:50824 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42174 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42176 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36260 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37146 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44204 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34558 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50052 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:50064 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43168 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43180 - "GET / HTTP/1.0" 200 OK 2026-03-13 15:41:35,154 - lava_callback - INFO - Received callback for node 69b18d25a870a1dc3343d1ae INFO: 172.21.0.1:50808 - "POST /node/69b18d25a870a1dc3343d1ae HTTP/1.0" 202 Accepted 2026-03-13 15:41:35,160 - lava_callback - INFO - Starting async job submit for node 69b18d25a870a1dc3343d1ae 2026-03-13 15:41:35,161 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 15:41:35,183 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b18d25a870a1dc3343d1ae HTTP/1.1" 200 None 2026-03-13 15:41:35,184 - lava_callback - DEBUG - Processing node 69b18d25a870a1dc3343d1ae: baseline-arm64-baylibre 2026-03-13 15:41:35,185 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b18d25a870a1dc3343d1ae 2026-03-13 15:41:35,185 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 15:41:35,198 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b18d25a870a1dc3343d1ae HTTP/1.1" 200 None 2026-03-13 15:41:35,199 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 15:41:35,213 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69abdf3340deb775998f3bb5 HTTP/1.1" 200 None 2026-03-13 15:41:35,214 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 15:41:35,235 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b18d25a870a1dc3343d1ae HTTP/1.1" 200 None 2026-03-13 15:41:35,244 - lava_callback - ERROR - Error processing callback for node 69b18d25a870a1dc3343d1ae: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:50812 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57690 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55366 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49104 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44496 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:44504 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55280 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55286 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55322 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46562 - "GET / HTTP/1.0" 200 OK 2026-03-13 15:42:55,235 - lava_callback - INFO - Received callback for node 69b18d74a870a1dc3343d1be INFO: 172.21.0.1:45998 - "POST /node/69b18d74a870a1dc3343d1be HTTP/1.0" 202 Accepted 2026-03-13 15:42:55,241 - lava_callback - INFO - Starting async job submit for node 69b18d74a870a1dc3343d1be 2026-03-13 15:42:55,242 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 15:42:55,256 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b18d74a870a1dc3343d1be HTTP/1.1" 200 None 2026-03-13 15:42:55,257 - lava_callback - DEBUG - Processing node 69b18d74a870a1dc3343d1be: baseline-arm64-baylibre 2026-03-13 15:42:55,257 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b18d74a870a1dc3343d1be 2026-03-13 15:42:55,258 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 15:42:55,271 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b18d74a870a1dc3343d1be HTTP/1.1" 200 None 2026-03-13 15:42:55,272 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 15:42:55,285 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69abdf3340deb775998f3bb5 HTTP/1.1" 200 None 2026-03-13 15:42:55,287 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 15:42:55,307 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b18d74a870a1dc3343d1be HTTP/1.1" 200 None 2026-03-13 15:42:55,313 - lava_callback - ERROR - Error processing callback for node 69b18d74a870a1dc3343d1be: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:46010 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46030 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42498 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:42506 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59902 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59908 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53702 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51068 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60842 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52374 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48798 - "GET /api/metrics HTTP/1.0" 200 OK 2026-03-13 15:44:15,352 - lava_callback - INFO - Received callback for node 69b18dc3a870a1dc3343d1c6 INFO: 172.21.0.1:48806 - "POST /node/69b18dc3a870a1dc3343d1c6 HTTP/1.0" 202 Accepted 2026-03-13 15:44:15,357 - lava_callback - INFO - Starting async job submit for node 69b18dc3a870a1dc3343d1c6 2026-03-13 15:44:15,358 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 15:44:15,372 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b18dc3a870a1dc3343d1c6 HTTP/1.1" 200 None 2026-03-13 15:44:15,373 - lava_callback - DEBUG - Processing node 69b18dc3a870a1dc3343d1c6: baseline-arm64-baylibre 2026-03-13 15:44:15,373 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b18dc3a870a1dc3343d1c6 2026-03-13 15:44:15,373 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 15:44:15,417 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b18dc3a870a1dc3343d1c6 HTTP/1.1" 200 None 2026-03-13 15:44:15,418 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 15:44:15,431 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69abdf3340deb775998f3bb5 HTTP/1.1" 200 None 2026-03-13 15:44:15,433 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 15:44:15,453 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b18dc3a870a1dc3343d1c6 HTTP/1.1" 200 None 2026-03-13 15:44:15,454 - lava_callback - ERROR - Error processing callback for node 69b18dc3a870a1dc3343d1c6: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:48818 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43246 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43260 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38120 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44358 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55476 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45314 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43060 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:43074 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42344 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42352 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58900 - "GET / HTTP/1.0" 200 OK 2026-03-13 15:45:42,692 - lava_callback - INFO - Received callback for node 69b18e19a870a1dc3343d1d2 INFO: 172.21.0.1:54394 - "POST /node/69b18e19a870a1dc3343d1d2 HTTP/1.0" 202 Accepted 2026-03-13 15:45:42,697 - lava_callback - INFO - Starting async job submit for node 69b18e19a870a1dc3343d1d2 2026-03-13 15:45:42,698 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 15:45:42,718 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b18e19a870a1dc3343d1d2 HTTP/1.1" 200 None 2026-03-13 15:45:42,719 - lava_callback - DEBUG - Processing node 69b18e19a870a1dc3343d1d2: baseline-arm64-clabbe 2026-03-13 15:45:42,720 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b18e19a870a1dc3343d1d2 2026-03-13 15:45:42,720 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 15:45:42,733 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b18e19a870a1dc3343d1d2 HTTP/1.1" 200 None 2026-03-13 15:45:42,735 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 15:45:42,747 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69abdf3340deb775998f3bb5 HTTP/1.1" 200 None 2026-03-13 15:45:42,749 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 15:45:42,770 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b18e19a870a1dc3343d1d2 HTTP/1.1" 200 None 2026-03-13 15:45:42,774 - lava_callback - ERROR - Error processing callback for node 69b18e19a870a1dc3343d1d2: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:54396 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55566 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43354 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47944 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:47960 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55732 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55742 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48030 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60772 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58926 - "GET / HTTP/1.0" 200 OK 2026-03-13 15:47:02,649 - lava_callback - INFO - Received callback for node 69b18e68a870a1dc3343d1e0 INFO: 172.21.0.1:53570 - "POST /node/69b18e68a870a1dc3343d1e0 HTTP/1.0" 202 Accepted 2026-03-13 15:47:02,655 - lava_callback - INFO - Starting async job submit for node 69b18e68a870a1dc3343d1e0 2026-03-13 15:47:02,656 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 15:47:02,670 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b18e68a870a1dc3343d1e0 HTTP/1.1" 200 None 2026-03-13 15:47:02,670 - lava_callback - DEBUG - Processing node 69b18e68a870a1dc3343d1e0: baseline-arm64-clabbe 2026-03-13 15:47:02,671 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b18e68a870a1dc3343d1e0 2026-03-13 15:47:02,671 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 15:47:02,684 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b18e68a870a1dc3343d1e0 HTTP/1.1" 200 None 2026-03-13 15:47:02,685 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 15:47:02,699 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69abdf3340deb775998f3bb5 HTTP/1.1" 200 None 2026-03-13 15:47:02,700 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 15:47:02,722 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b18e68a870a1dc3343d1e0 HTTP/1.1" 200 None 2026-03-13 15:47:02,724 - lava_callback - ERROR - Error processing callback for node 69b18e68a870a1dc3343d1e0: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:53574 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48916 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:48922 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49968 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49978 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53568 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57484 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50162 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34580 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56840 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:56854 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59214 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59218 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38658 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33844 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50058 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48072 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34264 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:34268 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52424 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52440 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34074 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57456 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49718 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49948 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56032 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:56034 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35332 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35334 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54142 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56652 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49142 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41698 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36204 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:36206 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36098 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36104 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43392 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45494 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40686 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42832 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50078 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:50088 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53602 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53616 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42712 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36494 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49030 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36766 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39946 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:39948 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37450 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37464 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41160 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33468 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37222 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47754 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38192 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:38200 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51936 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51940 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45386 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43852 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40002 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33068 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43196 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:43208 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46728 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46730 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49644 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48738 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53278 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50344 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50014 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:50018 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47982 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47996 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50784 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56328 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36496 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44710 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33882 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:33884 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45130 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45142 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34430 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40098 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46384 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47216 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36176 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:36182 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53114 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53122 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46448 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36638 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34370 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34064 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52454 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:52458 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39416 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39432 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57334 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55428 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38196 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42498 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51924 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:51938 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59892 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59896 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39642 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45348 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58304 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42920 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47978 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:47980 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55390 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55396 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50156 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48744 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40542 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33910 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58638 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:58654 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47674 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47682 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49418 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43468 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47488 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37626 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40734 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:40736 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42064 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42076 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48790 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44498 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46876 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58970 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54778 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:54792 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53108 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53118 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42760 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56054 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53808 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41518 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57064 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:57068 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51774 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51782 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44956 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42700 - "GET / HTTP/1.0" 200 OK 2026-03-13 16:05:56,517 - lava_callback - INFO - Received callback for node 69b192d3a870a1dc3343d250 INFO: 172.21.0.1:56640 - "POST /node/69b192d3a870a1dc3343d250 HTTP/1.0" 202 Accepted 2026-03-13 16:05:56,523 - lava_callback - INFO - Starting async job submit for node 69b192d3a870a1dc3343d250 INFO: 172.21.0.1:56646 - "GET / HTTP/1.0" 200 OK 2026-03-13 16:05:56,524 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 16:05:56,542 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b192d3a870a1dc3343d250 HTTP/1.1" 200 None 2026-03-13 16:05:56,543 - lava_callback - DEBUG - Processing node 69b192d3a870a1dc3343d250: baseline-arm64-baylibre 2026-03-13 16:05:56,544 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b192d3a870a1dc3343d250 2026-03-13 16:05:56,544 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 16:05:56,560 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b192d3a870a1dc3343d250 HTTP/1.1" 200 None 2026-03-13 16:05:56,562 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 16:05:56,589 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b125a3a870a1dc3343ba94 HTTP/1.1" 200 None 2026-03-13 16:05:56,590 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 16:05:56,613 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b192d3a870a1dc3343d250 HTTP/1.1" 200 None 2026-03-13 16:05:56,614 - lava_callback - ERROR - Error processing callback for node 69b192d3a870a1dc3343d250: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:47992 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51478 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:51484 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46506 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46522 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50342 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34102 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49182 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38402 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42074 - "GET /api/metrics HTTP/1.0" 200 OK 2026-03-13 16:07:16,491 - lava_callback - INFO - Received callback for node 69b19322a870a1dc3343d25c INFO: 172.21.0.1:42078 - "POST /node/69b19322a870a1dc3343d25c HTTP/1.0" 202 Accepted 2026-03-13 16:07:16,497 - lava_callback - INFO - Starting async job submit for node 69b19322a870a1dc3343d25c 2026-03-13 16:07:16,497 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 16:07:16,511 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b19322a870a1dc3343d25c HTTP/1.1" 200 None 2026-03-13 16:07:16,512 - lava_callback - DEBUG - Processing node 69b19322a870a1dc3343d25c: baseline-arm64-baylibre 2026-03-13 16:07:16,512 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b19322a870a1dc3343d25c 2026-03-13 16:07:16,513 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 16:07:16,525 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b19322a870a1dc3343d25c HTTP/1.1" 200 None 2026-03-13 16:07:16,527 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 INFO: 172.21.0.1:42088 - "GET / HTTP/1.0" 200 OK 2026-03-13 16:07:16,540 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b125a3a870a1dc3343ba94 HTTP/1.1" 200 None 2026-03-13 16:07:16,541 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 16:07:16,566 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b19322a870a1dc3343d25c HTTP/1.1" 200 None 2026-03-13 16:07:16,567 - lava_callback - ERROR - Error processing callback for node 69b19322a870a1dc3343d25c: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:56540 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56550 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39898 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49802 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39846 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49412 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35194 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:35210 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50210 - "GET / HTTP/1.0" 200 OK 2026-03-13 16:08:23,657 - lava_callback - INFO - Received callback for node 69b19374a870a1dc3343d268 INFO: 172.21.0.1:50216 - "POST /node/69b19374a870a1dc3343d268 HTTP/1.0" 202 Accepted 2026-03-13 16:08:23,663 - lava_callback - INFO - Starting async job submit for node 69b19374a870a1dc3343d268 2026-03-13 16:08:23,664 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 16:08:23,686 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b19374a870a1dc3343d268 HTTP/1.1" 200 None 2026-03-13 16:08:23,687 - lava_callback - DEBUG - Processing node 69b19374a870a1dc3343d268: baseline-arm64-clabbe 2026-03-13 16:08:23,687 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b19374a870a1dc3343d268 2026-03-13 16:08:23,688 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 16:08:23,714 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b19374a870a1dc3343d268 HTTP/1.1" 200 None 2026-03-13 16:08:23,716 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 16:08:23,736 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b125a3a870a1dc3343ba94 HTTP/1.1" 200 None 2026-03-13 16:08:23,737 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 16:08:23,786 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b19374a870a1dc3343d268 HTTP/1.1" 200 None 2026-03-13 16:08:23,797 - lava_callback - ERROR - Error processing callback for node 69b19374a870a1dc3343d268: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:50222 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39012 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37828 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41696 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36872 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41972 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:41980 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40850 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40856 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53650 - "GET / HTTP/1.0" 200 OK 2026-03-13 16:09:43,720 - lava_callback - INFO - Received callback for node 69b193c2a870a1dc3343d26f INFO: 172.21.0.1:36992 - "POST /node/69b193c2a870a1dc3343d26f HTTP/1.0" 202 Accepted 2026-03-13 16:09:43,726 - lava_callback - INFO - Starting async job submit for node 69b193c2a870a1dc3343d26f 2026-03-13 16:09:43,727 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 16:09:43,742 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b193c2a870a1dc3343d26f HTTP/1.1" 200 None 2026-03-13 16:09:43,742 - lava_callback - DEBUG - Processing node 69b193c2a870a1dc3343d26f: baseline-arm64-clabbe 2026-03-13 16:09:43,743 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b193c2a870a1dc3343d26f 2026-03-13 16:09:43,743 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 16:09:43,762 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b193c2a870a1dc3343d26f HTTP/1.1" 200 None 2026-03-13 16:09:43,763 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 16:09:43,776 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b125a3a870a1dc3343ba94 HTTP/1.1" 200 None 2026-03-13 16:09:43,777 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 16:09:43,798 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b193c2a870a1dc3343d26f HTTP/1.1" 200 None 2026-03-13 16:09:43,804 - lava_callback - ERROR - Error processing callback for node 69b193c2a870a1dc3343d26f: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:36998 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53072 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58246 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33182 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:33186 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45416 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45430 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39430 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40760 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49970 - "GET / HTTP/1.0" 200 OK 2026-03-13 16:11:03,786 - lava_callback - INFO - Received callback for node 69b19410a870a1dc3343d27b INFO: 172.21.0.1:39094 - "POST /node/69b19410a870a1dc3343d27b HTTP/1.0" 202 Accepted 2026-03-13 16:11:03,792 - lava_callback - INFO - Starting async job submit for node 69b19410a870a1dc3343d27b 2026-03-13 16:11:03,792 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 16:11:03,812 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b19410a870a1dc3343d27b HTTP/1.1" 200 None 2026-03-13 16:11:03,813 - lava_callback - DEBUG - Processing node 69b19410a870a1dc3343d27b: baseline-arm64-clabbe 2026-03-13 16:11:03,814 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b19410a870a1dc3343d27b 2026-03-13 16:11:03,814 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 16:11:03,827 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b19410a870a1dc3343d27b HTTP/1.1" 200 None 2026-03-13 16:11:03,829 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 16:11:03,842 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b125a3a870a1dc3343ba94 HTTP/1.1" 200 None 2026-03-13 16:11:03,844 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 16:11:03,866 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b19410a870a1dc3343d27b HTTP/1.1" 200 None 2026-03-13 16:11:03,867 - lava_callback - ERROR - Error processing callback for node 69b19410a870a1dc3343d27b: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:39096 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42962 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:42972 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50710 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50720 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38780 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57038 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41922 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33058 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36984 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:36992 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49294 - "GET / HTTP/1.0" 200 OK 2026-03-13 16:12:23,805 - lava_callback - INFO - Received callback for node 69b1945da870a1dc3343d289 INFO: 172.21.0.1:49298 - "POST /node/69b1945da870a1dc3343d289 HTTP/1.0" 202 Accepted 2026-03-13 16:12:23,811 - lava_callback - INFO - Starting async job submit for node 69b1945da870a1dc3343d289 2026-03-13 16:12:23,812 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 16:12:23,825 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b1945da870a1dc3343d289 HTTP/1.1" 200 None 2026-03-13 16:12:23,826 - lava_callback - DEBUG - Processing node 69b1945da870a1dc3343d289: baseline-arm64-clabbe 2026-03-13 16:12:23,826 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b1945da870a1dc3343d289 2026-03-13 16:12:23,827 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 16:12:23,842 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b1945da870a1dc3343d289 HTTP/1.1" 200 None 2026-03-13 16:12:23,844 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 16:12:23,858 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b125a3a870a1dc3343ba94 HTTP/1.1" 200 None 2026-03-13 16:12:23,859 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 16:12:23,879 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b1945da870a1dc3343d289 HTTP/1.1" 200 None 2026-03-13 16:12:23,883 - lava_callback - ERROR - Error processing callback for node 69b1945da870a1dc3343d289: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:49300 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40560 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57052 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33578 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59034 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33414 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:33428 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44534 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44536 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37254 - "GET / HTTP/1.0" 200 OK 2026-03-13 16:13:43,885 - lava_callback - INFO - Received callback for node 69b194b0a870a1dc3343d28e INFO: 172.21.0.1:39604 - "POST /node/69b194b0a870a1dc3343d28e HTTP/1.0" 202 Accepted 2026-03-13 16:13:43,893 - lava_callback - INFO - Starting async job submit for node 69b194b0a870a1dc3343d28e 2026-03-13 16:13:43,894 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 16:13:43,912 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b194b0a870a1dc3343d28e HTTP/1.1" 200 None 2026-03-13 16:13:43,913 - lava_callback - DEBUG - Processing node 69b194b0a870a1dc3343d28e: baseline-arm64-clabbe 2026-03-13 16:13:43,913 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b194b0a870a1dc3343d28e 2026-03-13 16:13:43,914 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 16:13:43,961 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b194b0a870a1dc3343d28e HTTP/1.1" 200 None 2026-03-13 16:13:43,962 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 16:13:43,975 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b125a3a870a1dc3343ba94 HTTP/1.1" 200 None 2026-03-13 16:13:43,977 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 16:13:43,998 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b194b0a870a1dc3343d28e HTTP/1.1" 200 None 2026-03-13 16:13:43,999 - lava_callback - ERROR - Error processing callback for node 69b194b0a870a1dc3343d28e: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:39610 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54082 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38682 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42052 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:42054 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60154 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60158 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40822 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37172 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36042 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60388 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35284 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:35292 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57486 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57488 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56868 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51722 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56606 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58602 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38888 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:38892 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48512 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48524 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43564 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53140 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59602 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57970 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45196 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:45210 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46662 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46666 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40198 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36932 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54014 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43934 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36192 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:36202 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49898 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49904 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48892 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33930 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52804 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39312 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57696 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:57704 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39742 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39748 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50890 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55422 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53334 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41254 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45066 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:45068 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40656 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40672 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36884 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43302 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55874 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39970 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38266 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:38268 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45066 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45072 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58194 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56378 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38420 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59812 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58282 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:58296 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42934 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42938 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55400 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48182 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34550 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49298 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36286 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:36302 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33922 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33928 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36608 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35062 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60874 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36708 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49726 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:49734 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43090 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43104 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39502 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34514 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51286 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37776 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53006 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:53018 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50630 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50640 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47738 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38400 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52792 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43038 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47092 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:47102 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47004 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47010 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51724 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38282 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41882 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35912 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45822 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:45832 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44568 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44570 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33214 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43720 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47356 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35230 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33418 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:33424 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43864 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43866 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53016 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48134 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52330 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45322 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35360 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:35366 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40592 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40608 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41542 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35864 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41378 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42310 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42384 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:42386 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47658 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47674 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56660 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55076 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41726 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38380 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42150 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:42160 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36120 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36124 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51828 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47212 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36510 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51266 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53538 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:53552 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34178 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34182 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51752 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45618 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43302 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53614 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52886 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:52888 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38792 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38800 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48628 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45044 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37500 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:32838 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55478 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:55486 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39682 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39684 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33022 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41582 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37640 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56884 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40390 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:40402 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34534 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34544 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54100 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33888 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44162 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43534 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52294 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:52308 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51512 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51526 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38500 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54758 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49906 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36726 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50170 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:50184 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41030 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41032 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50770 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46722 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46808 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:32820 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36898 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:36906 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57832 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57842 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53716 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59822 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51334 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49226 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40082 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:40086 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38002 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38014 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53570 - "GET / HTTP/1.0" 200 OK 2026-03-13 16:39:38,261 - lava_callback - INFO - Received callback for node 69b19abca26b422765ba3763 INFO: 172.21.0.1:53576 - "POST /node/69b19abca26b422765ba3763 HTTP/1.0" 202 Accepted 2026-03-13 16:39:38,266 - lava_callback - INFO - Starting async job submit for node 69b19abca26b422765ba3763 2026-03-13 16:39:38,267 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 16:39:38,303 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b19abca26b422765ba3763 HTTP/1.1" 200 None 2026-03-13 16:39:38,304 - lava_callback - DEBUG - Processing node 69b19abca26b422765ba3763: baseline-arm-baylibre 2026-03-13 16:39:38,304 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b19abca26b422765ba3763 2026-03-13 16:39:38,305 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 16:39:38,342 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b19abca26b422765ba3763 HTTP/1.1" 200 None 2026-03-13 16:39:38,343 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 16:39:38,356 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b195f7a26b422765ba3705 HTTP/1.1" 200 None 2026-03-13 16:39:38,358 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 16:39:38,382 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b19abca26b422765ba3763 HTTP/1.1" 200 None 2026-03-13 16:39:38,384 - lava_callback - ERROR - Error processing callback for node 69b19abca26b422765ba3763: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' 2026-03-13 16:39:38,945 - lava_callback - INFO - Received callback for node 69b19abea26b422765ba3766 INFO: 172.21.0.1:53584 - "POST /node/69b19abea26b422765ba3766 HTTP/1.0" 202 Accepted 2026-03-13 16:39:38,950 - lava_callback - INFO - Starting async job submit for node 69b19abea26b422765ba3766 2026-03-13 16:39:38,951 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 16:39:38,966 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b19abea26b422765ba3766 HTTP/1.1" 200 None 2026-03-13 16:39:38,967 - lava_callback - DEBUG - Processing node 69b19abea26b422765ba3766: baseline-arm-baylibre 2026-03-13 16:39:38,967 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b19abea26b422765ba3766 2026-03-13 16:39:38,968 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 16:39:38,980 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b19abea26b422765ba3766 HTTP/1.1" 200 None 2026-03-13 16:39:38,982 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 16:39:38,995 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b195f7a26b422765ba3705 HTTP/1.1" 200 None 2026-03-13 16:39:38,996 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 16:39:39,018 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b19abea26b422765ba3766 HTTP/1.1" 200 None 2026-03-13 16:39:39,020 - lava_callback - ERROR - Error processing callback for node 69b19abea26b422765ba3766: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' 2026-03-13 16:39:39,632 - lava_callback - INFO - Received callback for node 69b19abfa26b422765ba3769 INFO: 172.21.0.1:53598 - "POST /node/69b19abfa26b422765ba3769 HTTP/1.0" 202 Accepted 2026-03-13 16:39:39,637 - lava_callback - INFO - Starting async job submit for node 69b19abfa26b422765ba3769 2026-03-13 16:39:39,638 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 16:39:39,653 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b19abfa26b422765ba3769 HTTP/1.1" 200 None 2026-03-13 16:39:39,654 - lava_callback - DEBUG - Processing node 69b19abfa26b422765ba3769: baseline-arm-baylibre 2026-03-13 16:39:39,654 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b19abfa26b422765ba3769 2026-03-13 16:39:39,654 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 16:39:39,667 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b19abfa26b422765ba3769 HTTP/1.1" 200 None 2026-03-13 16:39:39,669 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 16:39:39,683 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b195f7a26b422765ba3705 HTTP/1.1" 200 None 2026-03-13 16:39:39,684 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 16:39:39,710 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b19abfa26b422765ba3769 HTTP/1.1" 200 None 2026-03-13 16:39:39,711 - lava_callback - ERROR - Error processing callback for node 69b19abfa26b422765ba3769: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' 2026-03-13 16:39:40,300 - lava_callback - INFO - Received callback for node 69b19ac1a26b422765ba376c INFO: 172.21.0.1:38840 - "POST /node/69b19ac1a26b422765ba376c HTTP/1.0" 202 Accepted 2026-03-13 16:39:40,306 - lava_callback - INFO - Starting async job submit for node 69b19ac1a26b422765ba376c 2026-03-13 16:39:40,307 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 16:39:40,331 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b19ac1a26b422765ba376c HTTP/1.1" 200 None 2026-03-13 16:39:40,332 - lava_callback - DEBUG - Processing node 69b19ac1a26b422765ba376c: baseline-arm-baylibre 2026-03-13 16:39:40,332 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b19ac1a26b422765ba376c 2026-03-13 16:39:40,332 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 16:39:40,345 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b19ac1a26b422765ba376c HTTP/1.1" 200 None 2026-03-13 16:39:40,347 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 16:39:40,360 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b195f7a26b422765ba3705 HTTP/1.1" 200 None 2026-03-13 16:39:40,362 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 16:39:40,387 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b19ac1a26b422765ba376c HTTP/1.1" 200 None 2026-03-13 16:39:40,392 - lava_callback - ERROR - Error processing callback for node 69b19ac1a26b422765ba376c: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' 2026-03-13 16:39:40,943 - lava_callback - INFO - Received callback for node 69b19ac4a26b422765ba3777 INFO: 172.21.0.1:38854 - "POST /node/69b19ac4a26b422765ba3777 HTTP/1.0" 202 Accepted 2026-03-13 16:39:40,948 - lava_callback - INFO - Starting async job submit for node 69b19ac4a26b422765ba3777 2026-03-13 16:39:40,949 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 16:39:40,964 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b19ac4a26b422765ba3777 HTTP/1.1" 200 None 2026-03-13 16:39:40,964 - lava_callback - DEBUG - Processing node 69b19ac4a26b422765ba3777: baseline-arm-baylibre 2026-03-13 16:39:40,965 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b19ac4a26b422765ba3777 2026-03-13 16:39:40,965 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 16:39:40,997 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b19ac4a26b422765ba3777 HTTP/1.1" 200 None 2026-03-13 16:39:40,999 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 16:39:41,012 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b195f7a26b422765ba3705 HTTP/1.1" 200 None 2026-03-13 16:39:41,014 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 16:39:41,035 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b19ac4a26b422765ba3777 HTTP/1.1" 200 None 2026-03-13 16:39:41,036 - lava_callback - ERROR - Error processing callback for node 69b19ac4a26b422765ba3777: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' 2026-03-13 16:39:41,630 - lava_callback - INFO - Received callback for node 69b19ac7a26b422765ba3792 INFO: 172.21.0.1:38856 - "POST /node/69b19ac7a26b422765ba3792 HTTP/1.0" 202 Accepted 2026-03-13 16:39:41,635 - lava_callback - INFO - Starting async job submit for node 69b19ac7a26b422765ba3792 2026-03-13 16:39:41,636 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 16:39:41,652 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b19ac7a26b422765ba3792 HTTP/1.1" 200 None 2026-03-13 16:39:41,653 - lava_callback - DEBUG - Processing node 69b19ac7a26b422765ba3792: baseline-arm-baylibre 2026-03-13 16:39:41,654 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b19ac7a26b422765ba3792 2026-03-13 16:39:41,654 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 16:39:41,669 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b19ac7a26b422765ba3792 HTTP/1.1" 200 None 2026-03-13 16:39:41,671 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 16:39:41,684 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b195f7a26b422765ba3705 HTTP/1.1" 200 None 2026-03-13 16:39:41,686 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 16:39:41,706 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b19ac7a26b422765ba3792 HTTP/1.1" 200 None 2026-03-13 16:39:41,707 - lava_callback - ERROR - Error processing callback for node 69b19ac7a26b422765ba3792: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:38860 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53868 - "GET / HTTP/1.0" 200 OK 2026-03-13 16:40:05,566 - lava_callback - INFO - Received callback for node 69b19ad1a26b422765ba37ab INFO: 172.21.0.1:57450 - "POST /node/69b19ad1a26b422765ba37ab HTTP/1.0" 202 Accepted 2026-03-13 16:40:05,572 - lava_callback - INFO - Starting async job submit for node 69b19ad1a26b422765ba37ab 2026-03-13 16:40:05,572 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 16:40:05,586 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b19ad1a26b422765ba37ab HTTP/1.1" 200 None 2026-03-13 16:40:05,587 - lava_callback - DEBUG - Processing node 69b19ad1a26b422765ba37ab: baseline-arm-clabbe 2026-03-13 16:40:05,587 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b19ad1a26b422765ba37ab 2026-03-13 16:40:05,588 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 16:40:05,601 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b19ad1a26b422765ba37ab HTTP/1.1" 200 None 2026-03-13 16:40:05,602 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 16:40:05,630 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b195f7a26b422765ba3705 HTTP/1.1" 200 None 2026-03-13 16:40:05,632 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 16:40:05,653 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b19ad1a26b422765ba37ab HTTP/1.1" 200 None 2026-03-13 16:40:05,654 - lava_callback - ERROR - Error processing callback for node 69b19ad1a26b422765ba37ab: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' 2026-03-13 16:40:06,259 - lava_callback - INFO - Received callback for node 69b19ad6a26b422765ba37b8 INFO: 172.21.0.1:57458 - "POST /node/69b19ad6a26b422765ba37b8 HTTP/1.0" 202 Accepted 2026-03-13 16:40:06,264 - lava_callback - INFO - Starting async job submit for node 69b19ad6a26b422765ba37b8 2026-03-13 16:40:06,265 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 16:40:06,280 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b19ad6a26b422765ba37b8 HTTP/1.1" 200 None 2026-03-13 16:40:06,281 - lava_callback - DEBUG - Processing node 69b19ad6a26b422765ba37b8: baseline-arm-clabbe 2026-03-13 16:40:06,282 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b19ad6a26b422765ba37b8 2026-03-13 16:40:06,282 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 16:40:06,294 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b19ad6a26b422765ba37b8 HTTP/1.1" 200 None 2026-03-13 16:40:06,296 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 16:40:06,314 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b195f7a26b422765ba3705 HTTP/1.1" 200 None 2026-03-13 16:40:06,316 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 16:40:06,348 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b19ad6a26b422765ba37b8 HTTP/1.1" 200 None 2026-03-13 16:40:06,350 - lava_callback - ERROR - Error processing callback for node 69b19ad6a26b422765ba37b8: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:57474 - "GET / HTTP/1.0" 200 OK 2026-03-13 16:40:06,949 - lava_callback - INFO - Received callback for node 69b19ad7a26b422765ba37bb INFO: 172.21.0.1:57478 - "POST /node/69b19ad7a26b422765ba37bb HTTP/1.0" 202 Accepted 2026-03-13 16:40:06,955 - lava_callback - INFO - Starting async job submit for node 69b19ad7a26b422765ba37bb 2026-03-13 16:40:06,956 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 16:40:06,971 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b19ad7a26b422765ba37bb HTTP/1.1" 200 None 2026-03-13 16:40:06,972 - lava_callback - DEBUG - Processing node 69b19ad7a26b422765ba37bb: baseline-arm-clabbe 2026-03-13 16:40:06,973 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b19ad7a26b422765ba37bb 2026-03-13 16:40:06,973 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 16:40:06,987 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b19ad7a26b422765ba37bb HTTP/1.1" 200 None 2026-03-13 16:40:06,988 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 16:40:07,007 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b195f7a26b422765ba3705 HTTP/1.1" 200 None 2026-03-13 16:40:07,008 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 16:40:07,031 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b19ad7a26b422765ba37bb HTTP/1.1" 200 None 2026-03-13 16:40:07,033 - lava_callback - ERROR - Error processing callback for node 69b19ad7a26b422765ba37bb: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' 2026-03-13 16:40:07,601 - lava_callback - INFO - Received callback for node 69b19ad8a26b422765ba37be INFO: 172.21.0.1:57488 - "POST /node/69b19ad8a26b422765ba37be HTTP/1.0" 202 Accepted 2026-03-13 16:40:07,607 - lava_callback - INFO - Starting async job submit for node 69b19ad8a26b422765ba37be 2026-03-13 16:40:07,608 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 16:40:07,621 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b19ad8a26b422765ba37be HTTP/1.1" 200 None 2026-03-13 16:40:07,622 - lava_callback - DEBUG - Processing node 69b19ad8a26b422765ba37be: baseline-arm-clabbe 2026-03-13 16:40:07,622 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b19ad8a26b422765ba37be 2026-03-13 16:40:07,622 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 16:40:07,636 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b19ad8a26b422765ba37be HTTP/1.1" 200 None 2026-03-13 16:40:07,638 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 16:40:07,651 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b195f7a26b422765ba3705 HTTP/1.1" 200 None 2026-03-13 16:40:07,652 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 16:40:07,672 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b19ad8a26b422765ba37be HTTP/1.1" 200 None 2026-03-13 16:40:07,682 - lava_callback - ERROR - Error processing callback for node 69b19ad8a26b422765ba37be: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' 2026-03-13 16:40:08,236 - lava_callback - INFO - Received callback for node 69b19adca26b422765ba37c7 INFO: 172.21.0.1:57500 - "POST /node/69b19adca26b422765ba37c7 HTTP/1.0" 202 Accepted 2026-03-13 16:40:08,242 - lava_callback - INFO - Starting async job submit for node 69b19adca26b422765ba37c7 2026-03-13 16:40:08,243 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 16:40:08,257 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b19adca26b422765ba37c7 HTTP/1.1" 200 None 2026-03-13 16:40:08,258 - lava_callback - DEBUG - Processing node 69b19adca26b422765ba37c7: baseline-arm-clabbe 2026-03-13 16:40:08,258 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b19adca26b422765ba37c7 2026-03-13 16:40:08,259 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 16:40:08,276 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b19adca26b422765ba37c7 HTTP/1.1" 200 None 2026-03-13 16:40:08,277 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 16:40:08,290 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b195f7a26b422765ba3705 HTTP/1.1" 200 None 2026-03-13 16:40:08,292 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 16:40:08,311 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b19adca26b422765ba37c7 HTTP/1.1" 200 None 2026-03-13 16:40:08,312 - lava_callback - ERROR - Error processing callback for node 69b19adca26b422765ba37c7: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:49188 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:49196 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39390 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39404 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46448 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48234 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33076 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34652 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:32856 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:32860 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48410 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48418 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34476 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58200 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54770 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35990 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57794 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:57802 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47140 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47150 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53530 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35470 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40882 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49680 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49530 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:49538 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48504 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48520 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45242 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41668 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38530 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42772 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49172 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:49186 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36142 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36156 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41606 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43106 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56204 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40284 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55816 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:55830 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55058 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55070 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41662 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59200 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51552 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56352 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53356 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:53360 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51902 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51910 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36808 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53594 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57828 - "GET / HTTP/1.0" 200 OK 2026-03-13 16:46:58,872 - lava_callback - INFO - Received callback for node 69b19c71a26b422765ba3944 INFO: 172.21.0.1:57832 - "POST /node/69b19c71a26b422765ba3944 HTTP/1.0" 202 Accepted 2026-03-13 16:46:58,878 - lava_callback - INFO - Starting async job submit for node 69b19c71a26b422765ba3944 2026-03-13 16:46:58,879 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 16:46:58,893 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b19c71a26b422765ba3944 HTTP/1.1" 200 None 2026-03-13 16:46:58,894 - lava_callback - DEBUG - Processing node 69b19c71a26b422765ba3944: baseline-arm-baylibre 2026-03-13 16:46:58,894 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b19c71a26b422765ba3944 2026-03-13 16:46:58,895 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 16:46:58,909 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b19c71a26b422765ba3944 HTTP/1.1" 200 None 2026-03-13 16:46:58,910 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 16:46:58,927 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a9acd99c5f93e4f05eb2ac HTTP/1.1" 200 None 2026-03-13 16:46:58,928 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 16:46:58,948 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b19c71a26b422765ba3944 HTTP/1.1" 200 None 2026-03-13 16:46:58,950 - lava_callback - ERROR - Error processing callback for node 69b19c71a26b422765ba3944: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:58278 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39194 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:39208 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45402 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45418 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33280 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35260 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37352 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38506 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43466 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:43482 - "GET / HTTP/1.0" 200 OK 2026-03-13 16:48:18,701 - lava_callback - INFO - Received callback for node 69b19cbda26b422765ba395c INFO: 172.21.0.1:43492 - "POST /node/69b19cbda26b422765ba395c HTTP/1.0" 202 Accepted 2026-03-13 16:48:18,706 - lava_callback - INFO - Starting async job submit for node 69b19cbda26b422765ba395c 2026-03-13 16:48:18,707 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 16:48:18,753 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b19cbda26b422765ba395c HTTP/1.1" 200 None 2026-03-13 16:48:18,754 - lava_callback - DEBUG - Processing node 69b19cbda26b422765ba395c: baseline-arm-baylibre 2026-03-13 16:48:18,754 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b19cbda26b422765ba395c 2026-03-13 16:48:18,754 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 16:48:18,767 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b19cbda26b422765ba395c HTTP/1.1" 200 None 2026-03-13 16:48:18,769 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 16:48:18,781 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a9acd99c5f93e4f05eb2ac HTTP/1.1" 200 None 2026-03-13 16:48:18,783 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 16:48:18,803 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b19cbda26b422765ba395c HTTP/1.1" 200 None 2026-03-13 16:48:18,805 - lava_callback - ERROR - Error processing callback for node 69b19cbda26b422765ba395c: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:60756 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60760 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39494 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51382 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33472 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49232 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51944 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:51952 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59908 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59924 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48872 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40262 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39678 - "GET / HTTP/1.0" 200 OK 2026-03-13 16:49:58,772 - lava_callback - INFO - Received callback for node 69b19d31a26b422765ba399c INFO: 172.21.0.1:39686 - "POST /node/69b19d31a26b422765ba399c HTTP/1.0" 202 Accepted 2026-03-13 16:49:58,778 - lava_callback - INFO - Starting async job submit for node 69b19d31a26b422765ba399c 2026-03-13 16:49:58,779 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 16:49:58,819 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b19d31a26b422765ba399c HTTP/1.1" 200 None 2026-03-13 16:49:58,820 - lava_callback - DEBUG - Processing node 69b19d31a26b422765ba399c: baseline-arm-baylibre 2026-03-13 16:49:58,820 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b19d31a26b422765ba399c 2026-03-13 16:49:58,821 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 16:49:58,836 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b19d31a26b422765ba399c HTTP/1.1" 200 None 2026-03-13 16:49:58,838 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 16:49:58,857 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a9acd99c5f93e4f05eb2ac HTTP/1.1" 200 None 2026-03-13 16:49:58,859 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 16:49:58,882 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b19d31a26b422765ba399c HTTP/1.1" 200 None 2026-03-13 16:49:58,888 - lava_callback - ERROR - Error processing callback for node 69b19d31a26b422765ba399c: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:45796 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34002 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:34004 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50414 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50430 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50042 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36480 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34040 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46384 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40786 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:40798 - "GET / HTTP/1.0" 200 OK 2026-03-13 16:51:18,825 - lava_callback - INFO - Received callback for node 69b19d7aa26b422765ba39bc INFO: 172.21.0.1:40804 - "POST /node/69b19d7aa26b422765ba39bc HTTP/1.0" 202 Accepted 2026-03-13 16:51:18,834 - lava_callback - INFO - Starting async job submit for node 69b19d7aa26b422765ba39bc 2026-03-13 16:51:18,835 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 16:51:18,857 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b19d7aa26b422765ba39bc HTTP/1.1" 200 None 2026-03-13 16:51:18,858 - lava_callback - DEBUG - Processing node 69b19d7aa26b422765ba39bc: baseline-arm-baylibre 2026-03-13 16:51:18,859 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b19d7aa26b422765ba39bc 2026-03-13 16:51:18,859 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 16:51:18,872 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b19d7aa26b422765ba39bc HTTP/1.1" 200 None 2026-03-13 16:51:18,874 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 16:51:18,909 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ac4f6846f7ae8ff3364c2c HTTP/1.1" 200 None 2026-03-13 16:51:18,910 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 16:51:18,953 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b19d7aa26b422765ba39bc HTTP/1.1" 200 None 2026-03-13 16:51:18,954 - lava_callback - ERROR - Error processing callback for node 69b19d7aa26b422765ba39bc: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:46176 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46180 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58912 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53906 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50362 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37112 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54348 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:54358 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48124 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48138 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59388 - "GET / HTTP/1.0" 200 OK 2026-03-13 16:52:39,075 - lava_callback - INFO - Received callback for node 69b19dc7a26b422765ba39d4 INFO: 172.21.0.1:59402 - "POST /node/69b19dc7a26b422765ba39d4 HTTP/1.0" 202 Accepted 2026-03-13 16:52:39,080 - lava_callback - INFO - Starting async job submit for node 69b19dc7a26b422765ba39d4 2026-03-13 16:52:39,081 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 16:52:39,095 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b19dc7a26b422765ba39d4 HTTP/1.1" 200 None 2026-03-13 16:52:39,096 - lava_callback - DEBUG - Processing node 69b19dc7a26b422765ba39d4: baseline-arm-baylibre 2026-03-13 16:52:39,096 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b19dc7a26b422765ba39d4 2026-03-13 16:52:39,097 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 16:52:39,120 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b19dc7a26b422765ba39d4 HTTP/1.1" 200 None 2026-03-13 16:52:39,122 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 16:52:39,142 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ac4f6846f7ae8ff3364c2c HTTP/1.1" 200 None 2026-03-13 16:52:39,144 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 16:52:39,165 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b19dc7a26b422765ba39d4 HTTP/1.1" 200 None 2026-03-13 16:52:39,167 - lava_callback - ERROR - Error processing callback for node 69b19dc7a26b422765ba39d4: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:41796 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35078 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43294 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55270 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:55276 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:32928 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:32938 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43832 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39840 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41060 - "GET / HTTP/1.0" 200 OK 2026-03-13 16:53:58,958 - lava_callback - INFO - Received callback for node 69b19e1aa26b422765ba39e9 INFO: 172.21.0.1:41070 - "POST /node/69b19e1aa26b422765ba39e9 HTTP/1.0" 202 Accepted 2026-03-13 16:53:58,964 - lava_callback - INFO - Starting async job submit for node 69b19e1aa26b422765ba39e9 2026-03-13 16:53:58,964 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 16:53:59,014 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b19e1aa26b422765ba39e9 HTTP/1.1" 200 None 2026-03-13 16:53:59,014 - lava_callback - DEBUG - Processing node 69b19e1aa26b422765ba39e9: baseline-arm-baylibre 2026-03-13 16:53:59,015 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b19e1aa26b422765ba39e9 2026-03-13 16:53:59,015 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 16:53:59,028 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b19e1aa26b422765ba39e9 HTTP/1.1" 200 None 2026-03-13 16:53:59,030 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 16:53:59,043 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ac4f6846f7ae8ff3364c2c HTTP/1.1" 200 None 2026-03-13 16:53:59,044 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 16:53:59,065 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b19e1aa26b422765ba39e9 HTTP/1.1" 200 None 2026-03-13 16:53:59,066 - lava_callback - ERROR - Error processing callback for node 69b19e1aa26b422765ba39e9: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:44426 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36614 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:36622 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42704 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42708 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58094 - "GET / HTTP/1.0" 200 OK 2026-03-13 16:54:38,991 - lava_callback - INFO - Received callback for node 69b19e42a26b422765ba39f2 INFO: 172.21.0.1:58108 - "POST /node/69b19e42a26b422765ba39f2 HTTP/1.0" 202 Accepted 2026-03-13 16:54:38,996 - lava_callback - INFO - Starting async job submit for node 69b19e42a26b422765ba39f2 2026-03-13 16:54:38,997 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 16:54:39,013 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b19e42a26b422765ba39f2 HTTP/1.1" 200 None 2026-03-13 16:54:39,014 - lava_callback - DEBUG - Processing node 69b19e42a26b422765ba39f2: baseline-arm-baylibre 2026-03-13 16:54:39,015 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b19e42a26b422765ba39f2 2026-03-13 16:54:39,015 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 16:54:39,033 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b19e42a26b422765ba39f2 HTTP/1.1" 200 None 2026-03-13 16:54:39,035 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 16:54:39,048 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ac4f6846f7ae8ff3364c2c HTTP/1.1" 200 None 2026-03-13 16:54:39,049 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 16:54:39,069 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b19e42a26b422765ba39f2 HTTP/1.1" 200 None 2026-03-13 16:54:39,074 - lava_callback - ERROR - Error processing callback for node 69b19e42a26b422765ba39f2: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:48030 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45350 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50840 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40692 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:40698 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48776 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48778 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41748 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52646 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33192 - "GET / HTTP/1.0" 200 OK 2026-03-13 16:55:59,122 - lava_callback - INFO - Received callback for node 69b19e98a26b422765ba3a09 INFO: 172.21.0.1:33202 - "POST /node/69b19e98a26b422765ba3a09 HTTP/1.0" 202 Accepted 2026-03-13 16:55:59,127 - lava_callback - INFO - Starting async job submit for node 69b19e98a26b422765ba3a09 2026-03-13 16:55:59,128 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 16:55:59,143 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b19e98a26b422765ba3a09 HTTP/1.1" 200 None 2026-03-13 16:55:59,144 - lava_callback - DEBUG - Processing node 69b19e98a26b422765ba3a09: baseline-arm-baylibre 2026-03-13 16:55:59,145 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b19e98a26b422765ba3a09 2026-03-13 16:55:59,145 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 16:55:59,161 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b19e98a26b422765ba3a09 HTTP/1.1" 200 None 2026-03-13 16:55:59,163 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 16:55:59,178 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ac4f6846f7ae8ff3364c2c HTTP/1.1" 200 None 2026-03-13 16:55:59,180 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 16:55:59,204 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b19e98a26b422765ba3a09 HTTP/1.1" 200 None 2026-03-13 16:55:59,206 - lava_callback - ERROR - Error processing callback for node 69b19e98a26b422765ba3a09: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:34406 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46824 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:46830 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35596 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35598 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56158 - "GET / HTTP/1.0" 200 OK 2026-03-13 16:56:39,104 - lava_callback - INFO - Received callback for node 69b19ec2a26b422765ba3a19 INFO: 172.21.0.1:56160 - "POST /node/69b19ec2a26b422765ba3a19 HTTP/1.0" 202 Accepted 2026-03-13 16:56:39,109 - lava_callback - INFO - Starting async job submit for node 69b19ec2a26b422765ba3a19 2026-03-13 16:56:39,110 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 16:56:39,127 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b19ec2a26b422765ba3a19 HTTP/1.1" 200 None 2026-03-13 16:56:39,128 - lava_callback - DEBUG - Processing node 69b19ec2a26b422765ba3a19: baseline-arm-baylibre 2026-03-13 16:56:39,128 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b19ec2a26b422765ba3a19 2026-03-13 16:56:39,129 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 16:56:39,155 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b19ec2a26b422765ba3a19 HTTP/1.1" 200 None 2026-03-13 16:56:39,157 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 16:56:39,170 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ac4f6846f7ae8ff3364c2c HTTP/1.1" 200 None 2026-03-13 16:56:39,172 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 16:56:39,193 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b19ec2a26b422765ba3a19 HTTP/1.1" 200 None 2026-03-13 16:56:39,198 - lava_callback - ERROR - Error processing callback for node 69b19ec2a26b422765ba3a19: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:60904 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44432 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56534 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53732 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:53734 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40450 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40452 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47234 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51778 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37712 - "GET / HTTP/1.0" 200 OK 2026-03-13 16:58:05,833 - lava_callback - INFO - Received callback for node 69b19f13a26b422765ba3a2e INFO: 172.21.0.1:42228 - "POST /node/69b19f13a26b422765ba3a2e HTTP/1.0" 202 Accepted 2026-03-13 16:58:05,839 - lava_callback - INFO - Starting async job submit for node 69b19f13a26b422765ba3a2e 2026-03-13 16:58:05,840 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 16:58:05,855 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b19f13a26b422765ba3a2e HTTP/1.1" 200 None 2026-03-13 16:58:05,856 - lava_callback - DEBUG - Processing node 69b19f13a26b422765ba3a2e: baseline-arm-clabbe 2026-03-13 16:58:05,856 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b19f13a26b422765ba3a2e 2026-03-13 16:58:05,857 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 16:58:05,870 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b19f13a26b422765ba3a2e HTTP/1.1" 200 None 2026-03-13 16:58:05,872 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 16:58:05,894 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ac4f6846f7ae8ff3364c2c HTTP/1.1" 200 None 2026-03-13 16:58:05,895 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 16:58:05,916 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b19f13a26b422765ba3a2e HTTP/1.1" 200 None 2026-03-13 16:58:05,917 - lava_callback - ERROR - Error processing callback for node 69b19f13a26b422765ba3a2e: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:42242 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47108 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:47120 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50600 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50614 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44326 - "GET / HTTP/1.0" 200 OK 2026-03-13 16:58:45,831 - lava_callback - INFO - Received callback for node 69b19f3ba26b422765ba3a37 INFO: 172.21.0.1:48900 - "POST /node/69b19f3ba26b422765ba3a37 HTTP/1.0" 202 Accepted 2026-03-13 16:58:45,836 - lava_callback - INFO - Starting async job submit for node 69b19f3ba26b422765ba3a37 2026-03-13 16:58:45,837 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 16:58:45,872 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b19f3ba26b422765ba3a37 HTTP/1.1" 200 None 2026-03-13 16:58:45,873 - lava_callback - DEBUG - Processing node 69b19f3ba26b422765ba3a37: baseline-arm-clabbe 2026-03-13 16:58:45,873 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b19f3ba26b422765ba3a37 2026-03-13 16:58:45,874 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 16:58:45,886 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b19f3ba26b422765ba3a37 HTTP/1.1" 200 None 2026-03-13 16:58:45,888 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 16:58:45,912 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ac4f6846f7ae8ff3364c2c HTTP/1.1" 200 None 2026-03-13 16:58:45,913 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 16:58:45,953 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b19f3ba26b422765ba3a37 HTTP/1.1" 200 None 2026-03-13 16:58:45,955 - lava_callback - ERROR - Error processing callback for node 69b19f3ba26b422765ba3a37: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:48902 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55034 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41450 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48322 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:48332 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40174 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40176 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53152 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40272 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42876 - "GET / HTTP/1.0" 200 OK 2026-03-13 16:59:59,947 - lava_callback - INFO - Received callback for node 69b19f81a26b422765ba3a49 INFO: 172.21.0.1:45872 - "POST /node/69b19f81a26b422765ba3a49 HTTP/1.0" 202 Accepted 2026-03-13 16:59:59,952 - lava_callback - INFO - Starting async job submit for node 69b19f81a26b422765ba3a49 2026-03-13 16:59:59,953 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 16:59:59,968 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b19f81a26b422765ba3a49 HTTP/1.1" 200 None 2026-03-13 16:59:59,969 - lava_callback - DEBUG - Processing node 69b19f81a26b422765ba3a49: baseline-arm-baylibre 2026-03-13 16:59:59,970 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b19f81a26b422765ba3a49 2026-03-13 16:59:59,970 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 16:59:59,984 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b19f81a26b422765ba3a49 HTTP/1.1" 200 None 2026-03-13 16:59:59,986 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 17:00:00,004 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aef424ce46d8ec186ab80e HTTP/1.1" 200 None 2026-03-13 17:00:00,005 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 17:00:00,028 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b19f81a26b422765ba3a49 HTTP/1.1" 200 None 2026-03-13 17:00:00,034 - lava_callback - ERROR - Error processing callback for node 69b19f81a26b422765ba3a49: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:45878 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38282 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:38294 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44078 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44090 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52774 - "GET / HTTP/1.0" 200 OK 2026-03-13 17:00:45,989 - lava_callback - INFO - Received callback for node 69b19faca26b422765ba3a52 INFO: 172.21.0.1:41438 - "POST /node/69b19faca26b422765ba3a52 HTTP/1.0" 202 Accepted 2026-03-13 17:00:45,994 - lava_callback - INFO - Starting async job submit for node 69b19faca26b422765ba3a52 2026-03-13 17:00:45,995 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 17:00:46,009 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b19faca26b422765ba3a52 HTTP/1.1" 200 None 2026-03-13 17:00:46,010 - lava_callback - DEBUG - Processing node 69b19faca26b422765ba3a52: baseline-arm-clabbe 2026-03-13 17:00:46,010 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b19faca26b422765ba3a52 2026-03-13 17:00:46,011 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 17:00:46,032 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b19faca26b422765ba3a52 HTTP/1.1" 200 None 2026-03-13 17:00:46,034 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 17:00:46,047 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ac4f6846f7ae8ff3364c2c HTTP/1.1" 200 None 2026-03-13 17:00:46,048 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 17:00:46,069 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b19faca26b422765ba3a52 HTTP/1.1" 200 None 2026-03-13 17:00:46,071 - lava_callback - ERROR - Error processing callback for node 69b19faca26b422765ba3a52: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:41440 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57376 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52230 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56406 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:56420 - "GET / HTTP/1.0" 200 OK 2026-03-13 17:01:19,452 - lava_callback - INFO - Received callback for node 69b19fcda26b422765ba3a5b INFO: 172.21.0.1:56426 - "POST /node/69b19fcda26b422765ba3a5b HTTP/1.0" 202 Accepted 2026-03-13 17:01:19,458 - lava_callback - INFO - Starting async job submit for node 69b19fcda26b422765ba3a5b 2026-03-13 17:01:19,459 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 17:01:19,483 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b19fcda26b422765ba3a5b HTTP/1.1" 200 None 2026-03-13 17:01:19,484 - lava_callback - DEBUG - Processing node 69b19fcda26b422765ba3a5b: baseline-arm-baylibre 2026-03-13 17:01:19,485 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b19fcda26b422765ba3a5b 2026-03-13 17:01:19,485 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 17:01:19,498 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b19fcda26b422765ba3a5b HTTP/1.1" 200 None 2026-03-13 17:01:19,500 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 17:01:19,529 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aef424ce46d8ec186ab80e HTTP/1.1" 200 None 2026-03-13 17:01:19,530 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 17:01:19,576 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b19fcda26b422765ba3a5b HTTP/1.1" 200 None 2026-03-13 17:01:19,578 - lava_callback - ERROR - Error processing callback for node 69b19fcda26b422765ba3a5b: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:35902 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35914 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41720 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40426 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33428 - "GET / HTTP/1.0" 200 OK 2026-03-13 17:01:59,417 - lava_callback - INFO - Received callback for node 69b19ff5a26b422765ba3a64 INFO: 172.21.0.1:33430 - "POST /node/69b19ff5a26b422765ba3a64 HTTP/1.0" 202 Accepted 2026-03-13 17:01:59,423 - lava_callback - INFO - Starting async job submit for node 69b19ff5a26b422765ba3a64 2026-03-13 17:01:59,424 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 17:01:59,439 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b19ff5a26b422765ba3a64 HTTP/1.1" 200 None 2026-03-13 17:01:59,440 - lava_callback - DEBUG - Processing node 69b19ff5a26b422765ba3a64: baseline-arm-baylibre 2026-03-13 17:01:59,440 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b19ff5a26b422765ba3a64 2026-03-13 17:01:59,441 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 17:01:59,461 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b19ff5a26b422765ba3a64 HTTP/1.1" 200 None 2026-03-13 17:01:59,462 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 17:01:59,476 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aef424ce46d8ec186ab80e HTTP/1.1" 200 None 2026-03-13 17:01:59,478 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 17:01:59,499 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b19ff5a26b422765ba3a64 HTTP/1.1" 200 None 2026-03-13 17:01:59,510 - lava_callback - ERROR - Error processing callback for node 69b19ff5a26b422765ba3a64: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:58480 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42914 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:42920 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34690 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34700 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36750 - "GET / HTTP/1.0" 200 OK 2026-03-13 17:02:39,474 - lava_callback - INFO - Received callback for node 69b1a01da26b422765ba3a6d INFO: 172.21.0.1:36758 - "POST /node/69b1a01da26b422765ba3a6d HTTP/1.0" 202 Accepted 2026-03-13 17:02:39,480 - lava_callback - INFO - Starting async job submit for node 69b1a01da26b422765ba3a6d 2026-03-13 17:02:39,481 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 17:02:39,495 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b1a01da26b422765ba3a6d HTTP/1.1" 200 None 2026-03-13 17:02:39,496 - lava_callback - DEBUG - Processing node 69b1a01da26b422765ba3a6d: baseline-arm-baylibre 2026-03-13 17:02:39,496 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b1a01da26b422765ba3a6d 2026-03-13 17:02:39,497 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 17:02:39,514 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b1a01da26b422765ba3a6d HTTP/1.1" 200 None 2026-03-13 17:02:39,516 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 17:02:39,530 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aef424ce46d8ec186ab80e HTTP/1.1" 200 None 2026-03-13 17:02:39,532 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 17:02:39,575 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b1a01da26b422765ba3a6d HTTP/1.1" 200 None 2026-03-13 17:02:39,580 - lava_callback - ERROR - Error processing callback for node 69b1a01da26b422765ba3a6d: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:55216 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53148 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56062 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60538 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:60548 - "GET / HTTP/1.0" 200 OK 2026-03-13 17:03:19,519 - lava_callback - INFO - Received callback for node 69b1a044a26b422765ba3a77 INFO: 172.21.0.1:60554 - "POST /node/69b1a044a26b422765ba3a77 HTTP/1.0" 202 Accepted 2026-03-13 17:03:19,524 - lava_callback - INFO - Starting async job submit for node 69b1a044a26b422765ba3a77 2026-03-13 17:03:19,525 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 17:03:19,563 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b1a044a26b422765ba3a77 HTTP/1.1" 200 None 2026-03-13 17:03:19,564 - lava_callback - DEBUG - Processing node 69b1a044a26b422765ba3a77: baseline-arm-baylibre 2026-03-13 17:03:19,564 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b1a044a26b422765ba3a77 2026-03-13 17:03:19,565 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 17:03:19,578 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b1a044a26b422765ba3a77 HTTP/1.1" 200 None 2026-03-13 17:03:19,580 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 17:03:19,593 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aef424ce46d8ec186ab80e HTTP/1.1" 200 None 2026-03-13 17:03:19,594 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 17:03:19,614 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b1a044a26b422765ba3a77 HTTP/1.1" 200 None 2026-03-13 17:03:19,616 - lava_callback - ERROR - Error processing callback for node 69b1a044a26b422765ba3a77: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:49842 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49848 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50074 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41760 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39806 - "GET / HTTP/1.0" 200 OK 2026-03-13 17:03:59,610 - lava_callback - INFO - Received callback for node 69b1a06ba26b422765ba3a84 INFO: 172.21.0.1:39818 - "POST /node/69b1a06ba26b422765ba3a84 HTTP/1.0" 202 Accepted 2026-03-13 17:03:59,615 - lava_callback - INFO - Starting async job submit for node 69b1a06ba26b422765ba3a84 2026-03-13 17:03:59,616 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 17:03:59,631 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b1a06ba26b422765ba3a84 HTTP/1.1" 200 None 2026-03-13 17:03:59,631 - lava_callback - DEBUG - Processing node 69b1a06ba26b422765ba3a84: baseline-arm-baylibre 2026-03-13 17:03:59,632 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b1a06ba26b422765ba3a84 2026-03-13 17:03:59,632 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 17:03:59,645 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b1a06ba26b422765ba3a84 HTTP/1.1" 200 None 2026-03-13 17:03:59,647 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 17:03:59,692 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aef424ce46d8ec186ab80e HTTP/1.1" 200 None 2026-03-13 17:03:59,693 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 17:03:59,714 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b1a06ba26b422765ba3a84 HTTP/1.1" 200 None 2026-03-13 17:03:59,715 - lava_callback - ERROR - Error processing callback for node 69b1a06ba26b422765ba3a84: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:41462 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35716 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:35728 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58208 - "GET / HTTP/1.0" 200 OK 2026-03-13 17:04:26,156 - lava_callback - INFO - Received callback for node 69b1a093a26b422765ba3a90 INFO: 172.21.0.1:58212 - "POST /node/69b1a093a26b422765ba3a90 HTTP/1.0" 202 Accepted 2026-03-13 17:04:26,161 - lava_callback - INFO - Starting async job submit for node 69b1a093a26b422765ba3a90 2026-03-13 17:04:26,162 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 17:04:26,176 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b1a093a26b422765ba3a90 HTTP/1.1" 200 None 2026-03-13 17:04:26,177 - lava_callback - DEBUG - Processing node 69b1a093a26b422765ba3a90: baseline-arm-clabbe 2026-03-13 17:04:26,177 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b1a093a26b422765ba3a90 2026-03-13 17:04:26,178 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 17:04:26,205 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b1a093a26b422765ba3a90 HTTP/1.1" 200 None 2026-03-13 17:04:26,207 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 17:04:26,220 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aef424ce46d8ec186ab80e HTTP/1.1" 200 None 2026-03-13 17:04:26,222 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 17:04:26,244 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b1a093a26b422765ba3a90 HTTP/1.1" 200 None 2026-03-13 17:04:26,246 - lava_callback - ERROR - Error processing callback for node 69b1a093a26b422765ba3a90: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:58228 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44472 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49356 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40902 - "GET / HTTP/1.0" 200 OK 2026-03-13 17:05:06,193 - lava_callback - INFO - Received callback for node 69b1a0baa26b422765ba3a9c INFO: 172.21.0.1:51230 - "POST /node/69b1a0baa26b422765ba3a9c HTTP/1.0" 202 Accepted 2026-03-13 17:05:06,199 - lava_callback - INFO - Starting async job submit for node 69b1a0baa26b422765ba3a9c 2026-03-13 17:05:06,199 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 17:05:06,216 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b1a0baa26b422765ba3a9c HTTP/1.1" 200 None 2026-03-13 17:05:06,217 - lava_callback - DEBUG - Processing node 69b1a0baa26b422765ba3a9c: baseline-arm-clabbe 2026-03-13 17:05:06,217 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b1a0baa26b422765ba3a9c 2026-03-13 17:05:06,218 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 17:05:06,231 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b1a0baa26b422765ba3a9c HTTP/1.1" 200 None 2026-03-13 17:05:06,233 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 17:05:06,245 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aef424ce46d8ec186ab80e HTTP/1.1" 200 None 2026-03-13 17:05:06,247 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 17:05:06,267 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b1a0baa26b422765ba3a9c HTTP/1.1" 200 None 2026-03-13 17:05:06,272 - lava_callback - ERROR - Error processing callback for node 69b1a0baa26b422765ba3a9c: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:51246 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38554 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:38558 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45152 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45168 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56002 - "GET / HTTP/1.0" 200 OK 2026-03-13 17:05:46,199 - lava_callback - INFO - Received callback for node 69b1a0e0a26b422765ba3aad INFO: 172.21.0.1:35796 - "POST /node/69b1a0e0a26b422765ba3aad HTTP/1.0" 202 Accepted 2026-03-13 17:05:46,205 - lava_callback - INFO - Starting async job submit for node 69b1a0e0a26b422765ba3aad 2026-03-13 17:05:46,206 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 17:05:46,220 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b1a0e0a26b422765ba3aad HTTP/1.1" 200 None 2026-03-13 17:05:46,220 - lava_callback - DEBUG - Processing node 69b1a0e0a26b422765ba3aad: baseline-arm-clabbe 2026-03-13 17:05:46,221 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b1a0e0a26b422765ba3aad 2026-03-13 17:05:46,221 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 17:05:46,234 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b1a0e0a26b422765ba3aad HTTP/1.1" 200 None 2026-03-13 17:05:46,236 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 17:05:46,249 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aef424ce46d8ec186ab80e HTTP/1.1" 200 None 2026-03-13 17:05:46,251 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 17:05:46,275 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b1a0e0a26b422765ba3aad HTTP/1.1" 200 None 2026-03-13 17:05:46,284 - lava_callback - ERROR - Error processing callback for node 69b1a0e0a26b422765ba3aad: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:35810 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53844 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40370 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60078 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:60080 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44652 - "GET / HTTP/1.0" 200 OK 2026-03-13 17:06:26,220 - lava_callback - INFO - Received callback for node 69b1a106a26b422765ba3ab5 INFO: 172.21.0.1:44664 - "POST /node/69b1a106a26b422765ba3ab5 HTTP/1.0" 202 Accepted 2026-03-13 17:06:26,226 - lava_callback - INFO - Starting async job submit for node 69b1a106a26b422765ba3ab5 2026-03-13 17:06:26,227 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 17:06:26,241 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b1a106a26b422765ba3ab5 HTTP/1.1" 200 None 2026-03-13 17:06:26,242 - lava_callback - DEBUG - Processing node 69b1a106a26b422765ba3ab5: baseline-arm-clabbe 2026-03-13 17:06:26,242 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b1a106a26b422765ba3ab5 2026-03-13 17:06:26,243 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 17:06:26,255 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b1a106a26b422765ba3ab5 HTTP/1.1" 200 None 2026-03-13 17:06:26,257 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 17:06:26,270 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aef424ce46d8ec186ab80e HTTP/1.1" 200 None 2026-03-13 17:06:26,271 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 17:06:26,296 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b1a106a26b422765ba3ab5 HTTP/1.1" 200 None 2026-03-13 17:06:26,299 - lava_callback - ERROR - Error processing callback for node 69b1a106a26b422765ba3ab5: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:44676 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44786 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38144 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53568 - "GET / HTTP/1.0" 200 OK 2026-03-13 17:07:06,304 - lava_callback - INFO - Received callback for node 69b1a12ba26b422765ba3ac3 INFO: 172.21.0.1:43120 - "POST /node/69b1a12ba26b422765ba3ac3 HTTP/1.0" 202 Accepted 2026-03-13 17:07:06,309 - lava_callback - INFO - Starting async job submit for node 69b1a12ba26b422765ba3ac3 2026-03-13 17:07:06,310 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 17:07:06,360 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b1a12ba26b422765ba3ac3 HTTP/1.1" 200 None 2026-03-13 17:07:06,361 - lava_callback - DEBUG - Processing node 69b1a12ba26b422765ba3ac3: baseline-arm-clabbe 2026-03-13 17:07:06,361 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b1a12ba26b422765ba3ac3 2026-03-13 17:07:06,362 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 17:07:06,375 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b1a12ba26b422765ba3ac3 HTTP/1.1" 200 None 2026-03-13 17:07:06,377 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 17:07:06,390 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aef424ce46d8ec186ab80e HTTP/1.1" 200 None 2026-03-13 17:07:06,391 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 17:07:06,413 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b1a12ba26b422765ba3ac3 HTTP/1.1" 200 None 2026-03-13 17:07:06,414 - lava_callback - ERROR - Error processing callback for node 69b1a12ba26b422765ba3ac3: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:43128 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44336 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:44352 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48036 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48040 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54356 - "GET / HTTP/1.0" 200 OK 2026-03-13 17:07:39,870 - lava_callback - INFO - Received callback for node 69b1a14da26b422765ba3ace INFO: 172.21.0.1:36536 - "POST /node/69b1a14da26b422765ba3ace HTTP/1.0" 202 Accepted 2026-03-13 17:07:39,876 - lava_callback - INFO - Starting async job submit for node 69b1a14da26b422765ba3ace 2026-03-13 17:07:39,876 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 17:07:39,890 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b1a14da26b422765ba3ace HTTP/1.1" 200 None 2026-03-13 17:07:39,891 - lava_callback - DEBUG - Processing node 69b1a14da26b422765ba3ace: baseline-arm-baylibre 2026-03-13 17:07:39,892 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b1a14da26b422765ba3ace 2026-03-13 17:07:39,892 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 17:07:39,917 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b1a14da26b422765ba3ace HTTP/1.1" 200 None 2026-03-13 17:07:39,919 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 17:07:39,943 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a9acd99c5f93e4f05eb2ac HTTP/1.1" 200 None 2026-03-13 17:07:39,945 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 17:07:39,965 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b1a14da26b422765ba3ace HTTP/1.1" 200 None 2026-03-13 17:07:39,967 - lava_callback - ERROR - Error processing callback for node 69b1a14da26b422765ba3ace: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:36538 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33882 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35246 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54826 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:54840 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58606 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58614 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46734 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34250 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52040 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43794 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49002 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:49016 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42952 - "GET / HTTP/1.0" 200 OK 2026-03-13 17:09:26,348 - lava_callback - INFO - Received callback for node 69b1a1c1a26b422765ba3af1 INFO: 172.21.0.1:42966 - "POST /node/69b1a1c1a26b422765ba3af1 HTTP/1.0" 202 Accepted 2026-03-13 17:09:26,353 - lava_callback - INFO - Starting async job submit for node 69b1a1c1a26b422765ba3af1 2026-03-13 17:09:26,354 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 17:09:26,368 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b1a1c1a26b422765ba3af1 HTTP/1.1" 200 None 2026-03-13 17:09:26,369 - lava_callback - DEBUG - Processing node 69b1a1c1a26b422765ba3af1: baseline-arm-clabbe 2026-03-13 17:09:26,369 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b1a1c1a26b422765ba3af1 2026-03-13 17:09:26,370 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 17:09:26,397 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b1a1c1a26b422765ba3af1 HTTP/1.1" 200 None 2026-03-13 17:09:26,398 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 17:09:26,431 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a9acd99c5f93e4f05eb2ac HTTP/1.1" 200 None 2026-03-13 17:09:26,433 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 17:09:26,457 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b1a1c1a26b422765ba3af1 HTTP/1.1" 200 None 2026-03-13 17:09:26,459 - lava_callback - ERROR - Error processing callback for node 69b1a1c1a26b422765ba3af1: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:42972 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45434 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58280 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53416 - "GET / HTTP/1.0" 200 OK 2026-03-13 17:10:06,498 - lava_callback - INFO - Received callback for node 69b1a1e8a26b422765ba3afe INFO: 172.21.0.1:59802 - "POST /node/69b1a1e8a26b422765ba3afe HTTP/1.0" 202 Accepted 2026-03-13 17:10:06,504 - lava_callback - INFO - Starting async job submit for node 69b1a1e8a26b422765ba3afe 2026-03-13 17:10:06,505 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 INFO: 172.21.0.1:59810 - "GET / HTTP/1.0" 200 OK 2026-03-13 17:10:06,535 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b1a1e8a26b422765ba3afe HTTP/1.1" 200 None 2026-03-13 17:10:06,536 - lava_callback - DEBUG - Processing node 69b1a1e8a26b422765ba3afe: baseline-arm-clabbe 2026-03-13 17:10:06,537 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b1a1e8a26b422765ba3afe 2026-03-13 17:10:06,537 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 17:10:06,560 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b1a1e8a26b422765ba3afe HTTP/1.1" 200 None 2026-03-13 17:10:06,561 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 17:10:06,576 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a9acd99c5f93e4f05eb2ac HTTP/1.1" 200 None 2026-03-13 17:10:06,577 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 17:10:06,603 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b1a1e8a26b422765ba3afe HTTP/1.1" 200 None 2026-03-13 17:10:06,610 - lava_callback - ERROR - Error processing callback for node 69b1a1e8a26b422765ba3afe: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:39048 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:39054 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41060 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41064 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40966 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44354 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48978 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54564 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48940 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:48948 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58094 - "GET / HTTP/1.0" 200 OK 2026-03-13 17:11:26,489 - lava_callback - INFO - Received callback for node 69b1a235a26b422765ba3b1e INFO: 172.21.0.1:58096 - "POST /node/69b1a235a26b422765ba3b1e HTTP/1.0" 202 Accepted 2026-03-13 17:11:26,495 - lava_callback - INFO - Starting async job submit for node 69b1a235a26b422765ba3b1e 2026-03-13 17:11:26,495 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 17:11:26,510 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b1a235a26b422765ba3b1e HTTP/1.1" 200 None 2026-03-13 17:11:26,511 - lava_callback - DEBUG - Processing node 69b1a235a26b422765ba3b1e: baseline-arm-clabbe 2026-03-13 17:11:26,512 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b1a235a26b422765ba3b1e 2026-03-13 17:11:26,512 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 INFO: 172.21.0.1:58108 - "GET / HTTP/1.0" 200 OK 2026-03-13 17:11:26,527 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b1a235a26b422765ba3b1e HTTP/1.1" 200 None 2026-03-13 17:11:26,528 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 17:11:26,541 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a9acd99c5f93e4f05eb2ac HTTP/1.1" 200 None 2026-03-13 17:11:26,543 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 17:11:26,594 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b1a235a26b422765ba3b1e HTTP/1.1" 200 None 2026-03-13 17:11:26,596 - lava_callback - ERROR - Error processing callback for node 69b1a235a26b422765ba3b1e: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:47874 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43964 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41758 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37564 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34266 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:34282 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50774 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50778 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37656 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46758 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51864 - "GET / HTTP/1.0" 200 OK 2026-03-13 17:13:00,043 - lava_callback - INFO - Received callback for node 69b1a287a26b422765ba3b39 INFO: 172.21.0.1:44732 - "POST /node/69b1a287a26b422765ba3b39 HTTP/1.0" 202 Accepted 2026-03-13 17:13:00,049 - lava_callback - INFO - Starting async job submit for node 69b1a287a26b422765ba3b39 2026-03-13 17:13:00,049 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 17:13:00,066 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b1a287a26b422765ba3b39 HTTP/1.1" 200 None 2026-03-13 17:13:00,067 - lava_callback - DEBUG - Processing node 69b1a287a26b422765ba3b39: baseline-arm64-baylibre 2026-03-13 17:13:00,067 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b1a287a26b422765ba3b39 2026-03-13 17:13:00,068 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 17:13:00,100 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b1a287a26b422765ba3b39 HTTP/1.1" 200 None 2026-03-13 17:13:00,101 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 17:13:00,143 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ac4f7446f7ae8ff3364c45 HTTP/1.1" 200 None 2026-03-13 17:13:00,144 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 17:13:00,179 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b1a287a26b422765ba3b39 HTTP/1.1" 200 None 2026-03-13 17:13:00,181 - lava_callback - ERROR - Error processing callback for node 69b1a287a26b422765ba3b39: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:44734 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38612 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:38618 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54802 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54806 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39902 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56674 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58916 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43530 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59430 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:59434 - "GET / HTTP/1.0" 200 OK 2026-03-13 17:14:20,552 - lava_callback - INFO - Received callback for node 69b1a2d7a26b422765ba3b44 INFO: 172.21.0.1:59480 - "POST /node/69b1a2d7a26b422765ba3b44 HTTP/1.0" 202 Accepted 2026-03-13 17:14:20,557 - lava_callback - INFO - Starting async job submit for node 69b1a2d7a26b422765ba3b44 2026-03-13 17:14:20,558 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 17:14:20,573 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b1a2d7a26b422765ba3b44 HTTP/1.1" 200 None 2026-03-13 17:14:20,573 - lava_callback - DEBUG - Processing node 69b1a2d7a26b422765ba3b44: baseline-arm64-baylibre 2026-03-13 17:14:20,574 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b1a2d7a26b422765ba3b44 2026-03-13 17:14:20,574 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 17:14:20,587 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b1a2d7a26b422765ba3b44 HTTP/1.1" 200 None 2026-03-13 17:14:20,588 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 17:14:20,615 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ac4f7446f7ae8ff3364c45 HTTP/1.1" 200 None 2026-03-13 17:14:20,617 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 17:14:20,637 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b1a2d7a26b422765ba3b44 HTTP/1.1" 200 None 2026-03-13 17:14:20,644 - lava_callback - ERROR - Error processing callback for node 69b1a2d7a26b422765ba3b44: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:59488 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59490 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52556 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48558 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33802 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51106 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54436 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:54438 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41780 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41794 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54022 - "GET / HTTP/1.0" 200 OK 2026-03-13 17:15:40,532 - lava_callback - INFO - Received callback for node 69b1a328a26b422765ba3b58 INFO: 172.21.0.1:56228 - "POST /node/69b1a328a26b422765ba3b58 HTTP/1.0" 202 Accepted 2026-03-13 17:15:40,537 - lava_callback - INFO - Starting async job submit for node 69b1a328a26b422765ba3b58 2026-03-13 17:15:40,538 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 17:15:40,563 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b1a328a26b422765ba3b58 HTTP/1.1" 200 None 2026-03-13 17:15:40,564 - lava_callback - DEBUG - Processing node 69b1a328a26b422765ba3b58: baseline-arm64-baylibre 2026-03-13 17:15:40,564 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b1a328a26b422765ba3b58 2026-03-13 17:15:40,565 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 17:15:40,578 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b1a328a26b422765ba3b58 HTTP/1.1" 200 None 2026-03-13 17:15:40,579 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 17:15:40,592 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ac4f7446f7ae8ff3364c45 HTTP/1.1" 200 None 2026-03-13 17:15:40,594 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 17:15:40,623 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b1a328a26b422765ba3b58 HTTP/1.1" 200 None 2026-03-13 17:15:40,624 - lava_callback - ERROR - Error processing callback for node 69b1a328a26b422765ba3b58: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:56234 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45454 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60360 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43222 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:43234 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53156 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53166 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59804 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40054 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39564 - "GET / HTTP/1.0" 200 OK 2026-03-13 17:17:00,284 - lava_callback - INFO - Received callback for node 69b1a37da26b422765ba3b63 INFO: 172.21.0.1:47772 - "POST /node/69b1a37da26b422765ba3b63 HTTP/1.0" 202 Accepted 2026-03-13 17:17:00,290 - lava_callback - INFO - Starting async job submit for node 69b1a37da26b422765ba3b63 2026-03-13 17:17:00,291 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 17:17:00,305 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b1a37da26b422765ba3b63 HTTP/1.1" 200 None 2026-03-13 17:17:00,306 - lava_callback - DEBUG - Processing node 69b1a37da26b422765ba3b63: baseline-arm64-baylibre 2026-03-13 17:17:00,306 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b1a37da26b422765ba3b63 2026-03-13 17:17:00,306 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 17:17:00,319 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b1a37da26b422765ba3b63 HTTP/1.1" 200 None 2026-03-13 17:17:00,321 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 17:17:00,334 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ac4f7446f7ae8ff3364c45 HTTP/1.1" 200 None 2026-03-13 17:17:00,336 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 17:17:00,355 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b1a37da26b422765ba3b63 HTTP/1.1" 200 None 2026-03-13 17:17:00,365 - lava_callback - ERROR - Error processing callback for node 69b1a37da26b422765ba3b63: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:47786 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38362 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:38374 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60812 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60820 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51648 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52634 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33428 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36752 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49400 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:49414 - "GET / HTTP/1.0" 200 OK 2026-03-13 17:18:20,364 - lava_callback - INFO - Received callback for node 69b1a3cca26b422765ba3b71 INFO: 172.21.0.1:35452 - "POST /node/69b1a3cca26b422765ba3b71 HTTP/1.0" 202 Accepted 2026-03-13 17:18:20,369 - lava_callback - INFO - Starting async job submit for node 69b1a3cca26b422765ba3b71 2026-03-13 17:18:20,370 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 17:18:20,384 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b1a3cca26b422765ba3b71 HTTP/1.1" 200 None 2026-03-13 17:18:20,385 - lava_callback - DEBUG - Processing node 69b1a3cca26b422765ba3b71: baseline-arm64-baylibre 2026-03-13 17:18:20,385 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b1a3cca26b422765ba3b71 2026-03-13 17:18:20,386 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 17:18:20,399 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b1a3cca26b422765ba3b71 HTTP/1.1" 200 None 2026-03-13 17:18:20,401 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 17:18:20,435 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ac4f7446f7ae8ff3364c45 HTTP/1.1" 200 None 2026-03-13 17:18:20,437 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 17:18:20,457 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b1a3cca26b422765ba3b71 HTTP/1.1" 200 None 2026-03-13 17:18:20,463 - lava_callback - ERROR - Error processing callback for node 69b1a3cca26b422765ba3b71: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:35460 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35466 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49418 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44028 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58372 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44396 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47430 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:47444 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44588 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44604 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60788 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39960 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55186 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44530 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60034 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:60036 - "GET / HTTP/1.0" 200 OK 2026-03-13 17:20:20,500 - lava_callback - INFO - Received callback for node 69b1a441a26b422765ba3b8e INFO: 172.21.0.1:42280 - "POST /node/69b1a441a26b422765ba3b8e HTTP/1.0" 202 Accepted 2026-03-13 17:20:20,505 - lava_callback - INFO - Starting async job submit for node 69b1a441a26b422765ba3b8e 2026-03-13 17:20:20,506 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 17:20:20,524 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b1a441a26b422765ba3b8e HTTP/1.1" 200 None 2026-03-13 17:20:20,525 - lava_callback - DEBUG - Processing node 69b1a441a26b422765ba3b8e: baseline-arm64-baylibre 2026-03-13 17:20:20,525 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b1a441a26b422765ba3b8e 2026-03-13 17:20:20,526 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 17:20:20,569 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b1a441a26b422765ba3b8e HTTP/1.1" 200 None 2026-03-13 17:20:20,571 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 17:20:20,584 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ac4f7446f7ae8ff3364c45 HTTP/1.1" 200 None 2026-03-13 17:20:20,585 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 17:20:20,606 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b1a441a26b422765ba3b8e HTTP/1.1" 200 None 2026-03-13 17:20:20,615 - lava_callback - ERROR - Error processing callback for node 69b1a441a26b422765ba3b8e: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:42284 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42290 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42198 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52292 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60684 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42566 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51394 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:51398 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41222 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41232 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57390 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39884 - "GET / HTTP/1.0" 200 OK 2026-03-13 17:21:46,864 - lava_callback - INFO - Received callback for node 69b1a497a26b422765ba3b9d INFO: 172.21.0.1:39898 - "POST /node/69b1a497a26b422765ba3b9d HTTP/1.0" 202 Accepted 2026-03-13 17:21:46,869 - lava_callback - INFO - Starting async job submit for node 69b1a497a26b422765ba3b9d 2026-03-13 17:21:46,870 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 17:21:46,892 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b1a497a26b422765ba3b9d HTTP/1.1" 200 None 2026-03-13 17:21:46,893 - lava_callback - DEBUG - Processing node 69b1a497a26b422765ba3b9d: baseline-arm64-clabbe 2026-03-13 17:21:46,893 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b1a497a26b422765ba3b9d 2026-03-13 17:21:46,894 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 17:21:46,907 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b1a497a26b422765ba3b9d HTTP/1.1" 200 None 2026-03-13 17:21:46,908 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 17:21:46,926 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ac4f7446f7ae8ff3364c45 HTTP/1.1" 200 None 2026-03-13 17:21:46,927 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 17:21:46,950 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b1a497a26b422765ba3b9d HTTP/1.1" 200 None 2026-03-13 17:21:46,957 - lava_callback - ERROR - Error processing callback for node 69b1a497a26b422765ba3b9d: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:58326 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52306 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56878 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:56882 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48202 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48210 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46128 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45438 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43076 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41828 - "GET / HTTP/1.0" 200 OK 2026-03-13 17:23:06,959 - lava_callback - INFO - Received callback for node 69b1a4e9a26b422765ba3bc5 INFO: 172.21.0.1:41830 - "POST /node/69b1a4e9a26b422765ba3bc5 HTTP/1.0" 202 Accepted 2026-03-13 17:23:06,964 - lava_callback - INFO - Starting async job submit for node 69b1a4e9a26b422765ba3bc5 2026-03-13 17:23:06,965 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 17:23:06,978 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b1a4e9a26b422765ba3bc5 HTTP/1.1" 200 None 2026-03-13 17:23:06,979 - lava_callback - DEBUG - Processing node 69b1a4e9a26b422765ba3bc5: baseline-arm64-clabbe 2026-03-13 17:23:06,980 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b1a4e9a26b422765ba3bc5 2026-03-13 17:23:06,980 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 17:23:06,993 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b1a4e9a26b422765ba3bc5 HTTP/1.1" 200 None 2026-03-13 17:23:06,994 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 17:23:07,010 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ac4f7446f7ae8ff3364c45 HTTP/1.1" 200 None 2026-03-13 17:23:07,011 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 17:23:07,043 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b1a4e9a26b422765ba3bc5 HTTP/1.1" 200 None 2026-03-13 17:23:07,045 - lava_callback - ERROR - Error processing callback for node 69b1a4e9a26b422765ba3bc5: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:50254 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:50270 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34148 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34156 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45544 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59602 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35270 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53252 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52826 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:52830 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42244 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42258 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59944 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33814 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33714 - "GET / HTTP/1.0" 200 OK 2026-03-13 17:25:00,771 - lava_callback - INFO - Received callback for node 69b1a558a26b422765ba3bda INFO: 172.21.0.1:57360 - "POST /node/69b1a558a26b422765ba3bda HTTP/1.0" 202 Accepted 2026-03-13 17:25:00,776 - lava_callback - INFO - Starting async job submit for node 69b1a558a26b422765ba3bda 2026-03-13 17:25:00,777 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 17:25:00,795 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b1a558a26b422765ba3bda HTTP/1.1" 200 None 2026-03-13 17:25:00,795 - lava_callback - DEBUG - Processing node 69b1a558a26b422765ba3bda: baseline-arm64-baylibre 2026-03-13 17:25:00,796 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b1a558a26b422765ba3bda 2026-03-13 17:25:00,796 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 17:25:00,810 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b1a558a26b422765ba3bda HTTP/1.1" 200 None 2026-03-13 17:25:00,811 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 17:25:00,824 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aef431ce46d8ec186ab81d HTTP/1.1" 200 None 2026-03-13 17:25:00,825 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 17:25:00,850 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b1a558a26b422765ba3bda HTTP/1.1" 200 None 2026-03-13 17:25:00,851 - lava_callback - ERROR - Error processing callback for node 69b1a558a26b422765ba3bda: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:57366 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57824 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:57834 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51598 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51610 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45184 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38496 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35766 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38354 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42018 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:42034 - "GET / HTTP/1.0" 200 OK 2026-03-13 17:26:20,819 - lava_callback - INFO - Received callback for node 69b1a5a9a26b422765ba3bdf INFO: 172.21.0.1:52446 - "POST /node/69b1a5a9a26b422765ba3bdf HTTP/1.0" 202 Accepted 2026-03-13 17:26:20,825 - lava_callback - INFO - Starting async job submit for node 69b1a5a9a26b422765ba3bdf 2026-03-13 17:26:20,825 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 17:26:20,839 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b1a5a9a26b422765ba3bdf HTTP/1.1" 200 None 2026-03-13 17:26:20,839 - lava_callback - DEBUG - Processing node 69b1a5a9a26b422765ba3bdf: baseline-arm64-baylibre 2026-03-13 17:26:20,840 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b1a5a9a26b422765ba3bdf 2026-03-13 17:26:20,840 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 17:26:20,853 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b1a5a9a26b422765ba3bdf HTTP/1.1" 200 None 2026-03-13 17:26:20,855 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 17:26:20,868 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aef431ce46d8ec186ab81d HTTP/1.1" 200 None 2026-03-13 17:26:20,869 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 17:26:20,896 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b1a5a9a26b422765ba3bdf HTTP/1.1" 200 None 2026-03-13 17:26:20,897 - lava_callback - ERROR - Error processing callback for node 69b1a5a9a26b422765ba3bdf: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:52454 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52456 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39486 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58440 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35684 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57768 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38388 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:38390 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58944 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58954 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47138 - "GET / HTTP/1.0" 200 OK 2026-03-13 17:27:40,903 - lava_callback - INFO - Received callback for node 69b1a5fba26b422765ba3be9 INFO: 172.21.0.1:56110 - "POST /node/69b1a5fba26b422765ba3be9 HTTP/1.0" 202 Accepted 2026-03-13 17:27:40,908 - lava_callback - INFO - Starting async job submit for node 69b1a5fba26b422765ba3be9 2026-03-13 17:27:40,909 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 17:27:40,929 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b1a5fba26b422765ba3be9 HTTP/1.1" 200 None 2026-03-13 17:27:40,929 - lava_callback - DEBUG - Processing node 69b1a5fba26b422765ba3be9: baseline-arm64-baylibre 2026-03-13 17:27:40,930 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b1a5fba26b422765ba3be9 2026-03-13 17:27:40,930 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 17:27:40,943 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b1a5fba26b422765ba3be9 HTTP/1.1" 200 None 2026-03-13 17:27:40,944 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 17:27:40,957 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aef431ce46d8ec186ab81d HTTP/1.1" 200 None 2026-03-13 17:27:40,959 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 17:27:40,986 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b1a5fba26b422765ba3be9 HTTP/1.1" 200 None 2026-03-13 17:27:40,992 - lava_callback - ERROR - Error processing callback for node 69b1a5fba26b422765ba3be9: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:56126 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57798 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53362 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45404 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:45408 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52556 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52572 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35076 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55120 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43140 - "GET / HTTP/1.0" 200 OK 2026-03-13 17:29:00,976 - lava_callback - INFO - Received callback for node 69b1a64fa26b422765ba3bf3 INFO: 172.21.0.1:50548 - "POST /node/69b1a64fa26b422765ba3bf3 HTTP/1.0" 202 Accepted 2026-03-13 17:29:00,982 - lava_callback - INFO - Starting async job submit for node 69b1a64fa26b422765ba3bf3 2026-03-13 17:29:00,983 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 17:29:01,001 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b1a64fa26b422765ba3bf3 HTTP/1.1" 200 None 2026-03-13 17:29:01,002 - lava_callback - DEBUG - Processing node 69b1a64fa26b422765ba3bf3: baseline-arm64-baylibre 2026-03-13 17:29:01,002 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b1a64fa26b422765ba3bf3 2026-03-13 17:29:01,003 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 17:29:01,016 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b1a64fa26b422765ba3bf3 HTTP/1.1" 200 None 2026-03-13 17:29:01,017 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 17:29:01,041 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aef431ce46d8ec186ab81d HTTP/1.1" 200 None 2026-03-13 17:29:01,042 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 17:29:01,065 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b1a64fa26b422765ba3bf3 HTTP/1.1" 200 None 2026-03-13 17:29:01,067 - lava_callback - ERROR - Error processing callback for node 69b1a64fa26b422765ba3bf3: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:50564 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35920 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:35932 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40358 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40364 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53848 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49984 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43536 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60574 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55650 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:55656 - "GET / HTTP/1.0" 200 OK 2026-03-13 17:30:21,119 - lava_callback - INFO - Received callback for node 69b1a6a2a26b422765ba3c06 INFO: 172.21.0.1:39878 - "POST /node/69b1a6a2a26b422765ba3c06 HTTP/1.0" 202 Accepted 2026-03-13 17:30:21,125 - lava_callback - INFO - Starting async job submit for node 69b1a6a2a26b422765ba3c06 2026-03-13 17:30:21,126 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 17:30:21,140 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b1a6a2a26b422765ba3c06 HTTP/1.1" 200 None 2026-03-13 17:30:21,141 - lava_callback - DEBUG - Processing node 69b1a6a2a26b422765ba3c06: baseline-arm64-baylibre 2026-03-13 17:30:21,141 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b1a6a2a26b422765ba3c06 2026-03-13 17:30:21,142 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 17:30:21,155 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b1a6a2a26b422765ba3c06 HTTP/1.1" 200 None 2026-03-13 17:30:21,156 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 17:30:21,168 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aef431ce46d8ec186ab81d HTTP/1.1" 200 None 2026-03-13 17:30:21,170 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 17:30:21,190 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b1a6a2a26b422765ba3c06 HTTP/1.1" 200 None 2026-03-13 17:30:21,191 - lava_callback - ERROR - Error processing callback for node 69b1a6a2a26b422765ba3c06: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:39882 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39898 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47712 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53866 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54964 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53284 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44080 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:44096 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43048 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43052 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44366 - "GET / HTTP/1.0" 200 OK 2026-03-13 17:31:41,116 - lava_callback - INFO - Received callback for node 69b1a6f4a26b422765ba3c0d INFO: 172.21.0.1:52040 - "POST /node/69b1a6f4a26b422765ba3c0d HTTP/1.0" 202 Accepted 2026-03-13 17:31:41,122 - lava_callback - INFO - Starting async job submit for node 69b1a6f4a26b422765ba3c0d 2026-03-13 17:31:41,123 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 17:31:41,137 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b1a6f4a26b422765ba3c0d HTTP/1.1" 200 None 2026-03-13 17:31:41,138 - lava_callback - DEBUG - Processing node 69b1a6f4a26b422765ba3c0d: baseline-arm64-baylibre 2026-03-13 17:31:41,138 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b1a6f4a26b422765ba3c0d 2026-03-13 17:31:41,139 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 17:31:41,152 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b1a6f4a26b422765ba3c0d HTTP/1.1" 200 None 2026-03-13 17:31:41,153 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 17:31:41,166 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aef431ce46d8ec186ab81d HTTP/1.1" 200 None 2026-03-13 17:31:41,167 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 17:31:41,187 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b1a6f4a26b422765ba3c0d HTTP/1.1" 200 None 2026-03-13 17:31:41,188 - lava_callback - ERROR - Error processing callback for node 69b1a6f4a26b422765ba3c0d: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:52046 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47394 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49660 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39970 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:39984 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46714 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46722 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55148 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58144 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45360 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57668 - "GET / HTTP/1.0" 200 OK 2026-03-13 17:33:07,354 - lava_callback - INFO - Received callback for node 69b1a74ba26b422765ba3c16 INFO: 172.21.0.1:57676 - "POST /node/69b1a74ba26b422765ba3c16 HTTP/1.0" 202 Accepted 2026-03-13 17:33:07,360 - lava_callback - INFO - Starting async job submit for node 69b1a74ba26b422765ba3c16 2026-03-13 17:33:07,360 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 17:33:07,374 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b1a74ba26b422765ba3c16 HTTP/1.1" 200 None 2026-03-13 17:33:07,375 - lava_callback - DEBUG - Processing node 69b1a74ba26b422765ba3c16: baseline-arm64-clabbe 2026-03-13 17:33:07,375 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b1a74ba26b422765ba3c16 2026-03-13 17:33:07,376 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 17:33:07,389 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b1a74ba26b422765ba3c16 HTTP/1.1" 200 None 2026-03-13 17:33:07,390 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 17:33:07,403 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aef431ce46d8ec186ab81d HTTP/1.1" 200 None 2026-03-13 17:33:07,405 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 17:33:07,435 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b1a74ba26b422765ba3c16 HTTP/1.1" 200 None 2026-03-13 17:33:07,436 - lava_callback - ERROR - Error processing callback for node 69b1a74ba26b422765ba3c16: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:56068 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:56084 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42848 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42864 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40666 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42074 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:32816 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58856 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33990 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:34000 - "GET / HTTP/1.0" 200 OK 2026-03-13 17:34:21,231 - lava_callback - INFO - Received callback for node 69b1a795a26b422765ba3c1f INFO: 172.21.0.1:33654 - "POST /node/69b1a795a26b422765ba3c1f HTTP/1.0" 202 Accepted 2026-03-13 17:34:21,237 - lava_callback - INFO - Starting async job submit for node 69b1a795a26b422765ba3c1f 2026-03-13 17:34:21,237 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 17:34:21,251 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b1a795a26b422765ba3c1f HTTP/1.1" 200 None 2026-03-13 17:34:21,252 - lava_callback - DEBUG - Processing node 69b1a795a26b422765ba3c1f: baseline-arm64-baylibre 2026-03-13 17:34:21,252 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b1a795a26b422765ba3c1f 2026-03-13 17:34:21,252 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 17:34:21,265 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b1a795a26b422765ba3c1f HTTP/1.1" 200 None 2026-03-13 17:34:21,267 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 17:34:21,280 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a9acf29c5f93e4f05eb2cc HTTP/1.1" 200 None 2026-03-13 17:34:21,281 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 17:34:21,302 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b1a795a26b422765ba3c1f HTTP/1.1" 200 None 2026-03-13 17:34:21,304 - lava_callback - ERROR - Error processing callback for node 69b1a795a26b422765ba3c1f: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:33668 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33676 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58062 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52418 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53154 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39912 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36150 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:36152 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50144 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50146 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46392 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56214 - "GET / HTTP/1.0" 200 OK 2026-03-13 17:35:47,469 - lava_callback - INFO - Received callback for node 69b1a7efa26b422765ba3c28 INFO: 172.21.0.1:56222 - "POST /node/69b1a7efa26b422765ba3c28 HTTP/1.0" 202 Accepted 2026-03-13 17:35:47,474 - lava_callback - INFO - Starting async job submit for node 69b1a7efa26b422765ba3c28 2026-03-13 17:35:47,475 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 17:35:47,512 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b1a7efa26b422765ba3c28 HTTP/1.1" 200 None 2026-03-13 17:35:47,513 - lava_callback - DEBUG - Processing node 69b1a7efa26b422765ba3c28: baseline-arm64-clabbe 2026-03-13 17:35:47,513 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b1a7efa26b422765ba3c28 2026-03-13 17:35:47,514 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 17:35:47,553 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b1a7efa26b422765ba3c28 HTTP/1.1" 200 None 2026-03-13 17:35:47,554 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 17:35:47,576 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aef431ce46d8ec186ab81d HTTP/1.1" 200 None 2026-03-13 17:35:47,577 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 17:35:47,621 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b1a7efa26b422765ba3c28 HTTP/1.1" 200 None 2026-03-13 17:35:47,629 - lava_callback - ERROR - Error processing callback for node 69b1a7efa26b422765ba3c28: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:51034 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57526 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40690 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:40692 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56106 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56108 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51170 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38556 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52424 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41422 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54850 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:54860 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54092 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54098 - "GET / HTTP/1.0" 200 OK 2026-03-13 17:37:27,549 - lava_callback - INFO - Received callback for node 69b1a842a26b422765ba3c2d INFO: 172.21.0.1:54110 - "POST /node/69b1a842a26b422765ba3c2d HTTP/1.0" 202 Accepted 2026-03-13 17:37:27,554 - lava_callback - INFO - Starting async job submit for node 69b1a842a26b422765ba3c2d 2026-03-13 17:37:27,555 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 17:37:27,595 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b1a842a26b422765ba3c2d HTTP/1.1" 200 None 2026-03-13 17:37:27,596 - lava_callback - DEBUG - Processing node 69b1a842a26b422765ba3c2d: baseline-arm64-clabbe 2026-03-13 17:37:27,596 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b1a842a26b422765ba3c2d 2026-03-13 17:37:27,597 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 17:37:27,610 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b1a842a26b422765ba3c2d HTTP/1.1" 200 None 2026-03-13 17:37:27,612 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 17:37:27,638 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aef431ce46d8ec186ab81d HTTP/1.1" 200 None 2026-03-13 17:37:27,639 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 17:37:27,662 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b1a842a26b422765ba3c2d HTTP/1.1" 200 None 2026-03-13 17:37:27,668 - lava_callback - ERROR - Error processing callback for node 69b1a842a26b422765ba3c2d: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:55114 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60284 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42318 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38760 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49096 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:49100 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34000 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34002 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34214 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39184 - "GET / HTTP/1.0" 200 OK 2026-03-13 17:38:47,605 - lava_callback - INFO - Received callback for node 69b1a897a26b422765ba3c35 INFO: 172.21.0.1:39196 - "POST /node/69b1a897a26b422765ba3c35 HTTP/1.0" 202 Accepted 2026-03-13 17:38:47,610 - lava_callback - INFO - Starting async job submit for node 69b1a897a26b422765ba3c35 2026-03-13 17:38:47,611 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 17:38:47,625 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b1a897a26b422765ba3c35 HTTP/1.1" 200 None 2026-03-13 17:38:47,626 - lava_callback - DEBUG - Processing node 69b1a897a26b422765ba3c35: baseline-arm64-clabbe 2026-03-13 17:38:47,626 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b1a897a26b422765ba3c35 2026-03-13 17:38:47,627 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 17:38:47,667 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b1a897a26b422765ba3c35 HTTP/1.1" 200 None 2026-03-13 17:38:47,669 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 17:38:47,683 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aef431ce46d8ec186ab81d HTTP/1.1" 200 None 2026-03-13 17:38:47,684 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 17:38:47,710 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b1a897a26b422765ba3c35 HTTP/1.1" 200 None 2026-03-13 17:38:47,712 - lava_callback - ERROR - Error processing callback for node 69b1a897a26b422765ba3c35: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:41294 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45920 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41142 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:41150 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38698 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38702 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33358 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36096 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50228 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37664 - "GET / HTTP/1.0" 200 OK 2026-03-13 17:40:07,640 - lava_callback - INFO - Received callback for node 69b1a8eba26b422765ba3c3f INFO: 172.21.0.1:37668 - "POST /node/69b1a8eba26b422765ba3c3f HTTP/1.0" 202 Accepted 2026-03-13 17:40:07,649 - lava_callback - INFO - Starting async job submit for node 69b1a8eba26b422765ba3c3f 2026-03-13 17:40:07,650 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 17:40:07,688 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b1a8eba26b422765ba3c3f HTTP/1.1" 200 None 2026-03-13 17:40:07,690 - lava_callback - DEBUG - Processing node 69b1a8eba26b422765ba3c3f: baseline-arm64-clabbe 2026-03-13 17:40:07,690 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b1a8eba26b422765ba3c3f 2026-03-13 17:40:07,691 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 17:40:07,708 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b1a8eba26b422765ba3c3f HTTP/1.1" 200 None 2026-03-13 17:40:07,710 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 17:40:07,728 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aef431ce46d8ec186ab81d HTTP/1.1" 200 None 2026-03-13 17:40:07,730 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 17:40:07,753 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b1a8eba26b422765ba3c3f HTTP/1.1" 200 None 2026-03-13 17:40:07,755 - lava_callback - ERROR - Error processing callback for node 69b1a8eba26b422765ba3c3f: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:40768 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:40780 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48730 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48734 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50464 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41534 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60696 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53378 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45606 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:45616 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47044 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47046 - "GET / HTTP/1.0" 200 OK 2026-03-13 17:41:27,743 - lava_callback - INFO - Received callback for node 69b1a940a26b422765ba3c48 INFO: 172.21.0.1:47052 - "POST /node/69b1a940a26b422765ba3c48 HTTP/1.0" 202 Accepted 2026-03-13 17:41:27,749 - lava_callback - INFO - Starting async job submit for node 69b1a940a26b422765ba3c48 2026-03-13 17:41:27,750 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 17:41:27,766 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b1a940a26b422765ba3c48 HTTP/1.1" 200 None 2026-03-13 17:41:27,766 - lava_callback - DEBUG - Processing node 69b1a940a26b422765ba3c48: baseline-arm64-clabbe 2026-03-13 17:41:27,767 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b1a940a26b422765ba3c48 2026-03-13 17:41:27,767 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 17:41:27,784 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b1a940a26b422765ba3c48 HTTP/1.1" 200 None 2026-03-13 17:41:27,785 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 17:41:27,803 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aef431ce46d8ec186ab81d HTTP/1.1" 200 None 2026-03-13 17:41:27,805 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 17:41:27,825 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b1a940a26b422765ba3c48 HTTP/1.1" 200 None 2026-03-13 17:41:27,831 - lava_callback - ERROR - Error processing callback for node 69b1a940a26b422765ba3c48: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:43800 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47164 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44756 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38864 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40102 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:40110 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51010 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51014 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55396 - "GET / HTTP/1.0" 200 OK 2026-03-13 17:42:41,751 - lava_callback - INFO - Received callback for node 69b1a98ea26b422765ba3c50 INFO: 172.21.0.1:57198 - "POST /node/69b1a98ea26b422765ba3c50 HTTP/1.0" 202 Accepted 2026-03-13 17:42:41,757 - lava_callback - INFO - Starting async job submit for node 69b1a98ea26b422765ba3c50 2026-03-13 17:42:41,758 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 17:42:41,771 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b1a98ea26b422765ba3c50 HTTP/1.1" 200 None 2026-03-13 17:42:41,772 - lava_callback - DEBUG - Processing node 69b1a98ea26b422765ba3c50: baseline-arm64-baylibre 2026-03-13 17:42:41,772 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b1a98ea26b422765ba3c50 2026-03-13 17:42:41,773 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 17:42:41,785 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b1a98ea26b422765ba3c50 HTTP/1.1" 200 None 2026-03-13 17:42:41,787 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 17:42:41,799 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a9acf29c5f93e4f05eb2cc HTTP/1.1" 200 None 2026-03-13 17:42:41,801 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 17:42:41,822 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b1a98ea26b422765ba3c50 HTTP/1.1" 200 None 2026-03-13 17:42:41,823 - lava_callback - ERROR - Error processing callback for node 69b1a98ea26b422765ba3c50: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:57204 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55032 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35758 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46518 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:46524 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53332 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53346 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56800 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40932 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39078 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51060 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50956 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:50960 - "GET / HTTP/1.0" 200 OK 2026-03-13 17:44:21,843 - lava_callback - INFO - Received callback for node 69b1a9e4a26b422765ba3c5b INFO: 172.21.0.1:51850 - "POST /node/69b1a9e4a26b422765ba3c5b HTTP/1.0" 202 Accepted 2026-03-13 17:44:21,848 - lava_callback - INFO - Starting async job submit for node 69b1a9e4a26b422765ba3c5b 2026-03-13 17:44:21,849 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 17:44:21,874 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b1a9e4a26b422765ba3c5b HTTP/1.1" 200 None 2026-03-13 17:44:21,875 - lava_callback - DEBUG - Processing node 69b1a9e4a26b422765ba3c5b: baseline-arm64-baylibre 2026-03-13 17:44:21,875 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b1a9e4a26b422765ba3c5b 2026-03-13 17:44:21,876 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 17:44:21,890 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b1a9e4a26b422765ba3c5b HTTP/1.1" 200 None 2026-03-13 17:44:21,891 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 17:44:21,916 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a9acf29c5f93e4f05eb2cc HTTP/1.1" 200 None 2026-03-13 17:44:21,917 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 17:44:21,943 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b1a9e4a26b422765ba3c5b HTTP/1.1" 200 None 2026-03-13 17:44:21,954 - lava_callback - ERROR - Error processing callback for node 69b1a9e4a26b422765ba3c5b: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:51854 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51870 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60138 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48040 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58930 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33468 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46014 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:46030 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45590 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45606 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49448 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50790 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45366 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43902 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38482 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:38498 - "GET / HTTP/1.0" 200 OK 2026-03-13 17:46:21,983 - lava_callback - INFO - Received callback for node 69b1aa5ca26b422765ba3c6e INFO: 172.21.0.1:45692 - "POST /node/69b1aa5ca26b422765ba3c6e HTTP/1.0" 202 Accepted 2026-03-13 17:46:21,988 - lava_callback - INFO - Starting async job submit for node 69b1aa5ca26b422765ba3c6e 2026-03-13 17:46:21,989 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 17:46:22,007 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b1aa5ca26b422765ba3c6e HTTP/1.1" 200 None 2026-03-13 17:46:22,008 - lava_callback - DEBUG - Processing node 69b1aa5ca26b422765ba3c6e: baseline-arm64-baylibre 2026-03-13 17:46:22,008 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b1aa5ca26b422765ba3c6e 2026-03-13 17:46:22,009 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 17:46:22,053 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b1aa5ca26b422765ba3c6e HTTP/1.1" 200 None 2026-03-13 17:46:22,054 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 17:46:22,079 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a9acf29c5f93e4f05eb2cc HTTP/1.1" 200 None 2026-03-13 17:46:22,080 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 17:46:22,129 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b1aa5ca26b422765ba3c6e HTTP/1.1" 200 None 2026-03-13 17:46:22,130 - lava_callback - ERROR - Error processing callback for node 69b1aa5ca26b422765ba3c6e: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:45696 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45698 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38090 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50042 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41124 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43574 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37782 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:37792 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49470 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49482 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47282 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42492 - "GET / HTTP/1.0" 200 OK 2026-03-13 17:47:47,995 - lava_callback - INFO - Received callback for node 69b1aab7a26b422765ba3c76 INFO: 172.21.0.1:42506 - "POST /node/69b1aab7a26b422765ba3c76 HTTP/1.0" 202 Accepted 2026-03-13 17:47:48,001 - lava_callback - INFO - Starting async job submit for node 69b1aab7a26b422765ba3c76 2026-03-13 17:47:48,002 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 17:47:48,039 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b1aab7a26b422765ba3c76 HTTP/1.1" 200 None 2026-03-13 17:47:48,040 - lava_callback - DEBUG - Processing node 69b1aab7a26b422765ba3c76: baseline-arm64-clabbe 2026-03-13 17:47:48,040 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b1aab7a26b422765ba3c76 2026-03-13 17:47:48,041 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 17:47:48,072 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b1aab7a26b422765ba3c76 HTTP/1.1" 200 None 2026-03-13 17:47:48,074 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 17:47:48,087 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a9acf29c5f93e4f05eb2cc HTTP/1.1" 200 None 2026-03-13 17:47:48,088 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 17:47:48,133 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b1aab7a26b422765ba3c76 HTTP/1.1" 200 None 2026-03-13 17:47:48,138 - lava_callback - ERROR - Error processing callback for node 69b1aab7a26b422765ba3c76: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:38798 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47112 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36344 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:36354 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42430 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42434 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57720 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39476 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45198 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40056 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53684 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:53696 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43444 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43460 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36398 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51824 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45260 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39712 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37186 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:37196 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45728 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45736 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58154 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57186 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35064 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60806 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38052 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:38054 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56520 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56528 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57570 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54894 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57660 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40560 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37396 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:37400 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35370 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35380 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44534 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36850 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42532 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34924 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46130 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:46136 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54188 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54202 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33492 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60878 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49180 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48688 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53396 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:53402 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51606 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51612 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38510 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55534 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33200 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44466 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48592 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:48604 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60080 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60088 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37192 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55284 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45698 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54494 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51548 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:51560 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46394 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46402 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56782 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36536 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48318 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39758 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48972 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:48980 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38928 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38944 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41670 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56238 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36258 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59894 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54850 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:54862 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46076 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46088 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43060 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52244 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35750 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47878 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42086 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:42100 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50590 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50604 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35642 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46920 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49950 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50830 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35328 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:35332 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47400 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47416 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59656 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35052 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34798 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57028 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50856 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:50862 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33056 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33072 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49252 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47274 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59222 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36518 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57480 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:57482 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54346 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54362 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55572 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36404 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53766 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47242 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35566 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:35568 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46630 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46636 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36256 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41874 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60364 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37070 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54636 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:54652 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58460 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58464 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52786 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39056 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55908 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55840 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37336 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:37342 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59144 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59158 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36774 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56400 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37980 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40272 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33008 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:33020 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41138 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41150 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50782 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41380 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38164 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44442 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53874 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:53884 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47632 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47638 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37074 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35910 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34692 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34458 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44616 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:44628 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56406 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56412 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39830 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54300 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52052 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34622 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44776 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:44780 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50718 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50734 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54218 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46906 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59780 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43556 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48940 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:48954 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34766 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34776 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46210 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44930 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48174 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45252 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35084 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:35100 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39866 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39878 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59884 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59192 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44426 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52874 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37532 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:37544 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36066 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36074 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58054 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42894 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55192 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47592 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53814 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:53828 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37484 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37496 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44044 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60414 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45798 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42488 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59412 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:59428 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37842 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37850 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53856 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38982 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38080 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40400 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45334 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:45340 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43970 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43984 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39410 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50190 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39922 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40932 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46706 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:46716 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58546 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58552 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48416 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43410 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46466 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43784 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45734 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:45750 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36286 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36302 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45308 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46494 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46942 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41442 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45140 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:45152 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43892 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43898 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43090 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45500 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47060 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37004 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42204 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:42206 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55330 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55338 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53894 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55512 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58740 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54334 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41260 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:41268 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47604 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47616 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53256 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44198 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54254 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43260 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50056 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:50070 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34120 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34126 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56612 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43184 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49340 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60904 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51928 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:51936 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47890 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47906 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44048 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57752 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44558 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57308 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35206 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:35216 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39394 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39406 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59694 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40320 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42380 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34728 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43150 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:43156 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38578 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38584 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35894 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43702 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40686 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39822 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34594 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:34604 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50772 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50784 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33820 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33822 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34816 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57674 - "GET /favicon.ico HTTP/1.0" 404 Not Found INFO: 172.21.0.1:57688 - "GET /robots.txt HTTP/1.0" 404 Not Found INFO: 172.21.0.1:57690 - "GET /sitemap.xml HTTP/1.0" 404 Not Found INFO: 172.21.0.1:57692 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41130 - "GET /config.json HTTP/1.0" 404 Not Found INFO: 172.21.0.1:41132 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51010 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:51026 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51116 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51130 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34140 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55250 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50762 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39478 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59178 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:59190 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35884 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35896 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54394 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37354 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52218 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33110 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35372 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:35384 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49962 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49964 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43886 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33232 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54034 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52822 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44080 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:44082 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50186 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50188 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50860 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37484 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40540 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56428 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33958 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:33968 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54294 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54304 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47918 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38606 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47930 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49188 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44468 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:44472 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48248 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48264 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59314 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48440 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41070 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55570 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45544 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:45546 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52682 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52686 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58706 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58256 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44850 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38134 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41162 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:41178 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49408 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49424 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59290 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40062 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38976 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59832 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34602 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:34606 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40876 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40890 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56124 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57074 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51246 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58290 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51982 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:51994 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59552 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59568 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34228 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42694 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55018 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39516 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40252 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:40260 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35792 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35808 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60906 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43474 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53168 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41680 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46908 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:46914 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34482 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34496 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45958 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55864 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58810 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40828 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47010 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:47020 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58298 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58302 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49524 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60724 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39840 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33006 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59908 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:59914 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38418 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38434 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38248 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51540 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36544 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58468 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57930 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:57940 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58436 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58440 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51968 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37292 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53548 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52524 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43424 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:43436 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52560 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52566 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43800 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56008 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42772 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55996 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43550 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:43556 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47196 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47202 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51378 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54832 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40370 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50650 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37434 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:37438 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34916 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34926 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54558 - "GET / HTTP/1.0" 200 OK 2026-03-13 18:43:45,364 - lava_callback - INFO - Received callback for node 69b1b7dba26b422765ba3d31 INFO: 172.21.0.1:42140 - "POST /node/69b1b7dba26b422765ba3d31 HTTP/1.0" 202 Accepted 2026-03-13 18:43:45,369 - lava_callback - INFO - Starting async job submit for node 69b1b7dba26b422765ba3d31 2026-03-13 18:43:45,370 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 18:43:45,385 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b1b7dba26b422765ba3d31 HTTP/1.1" 200 None 2026-03-13 18:43:45,386 - lava_callback - DEBUG - Processing node 69b1b7dba26b422765ba3d31: baseline-arm-baylibre 2026-03-13 18:43:45,386 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b1b7dba26b422765ba3d31 2026-03-13 18:43:45,387 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 18:43:45,400 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b1b7dba26b422765ba3d31 HTTP/1.1" 200 None 2026-03-13 18:43:45,401 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 18:43:45,414 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b0b4fc9d19175818251fd6 HTTP/1.1" 200 None 2026-03-13 18:43:45,416 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 18:43:45,438 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b1b7dba26b422765ba3d31 HTTP/1.1" 200 None 2026-03-13 18:43:45,445 - lava_callback - ERROR - Error processing callback for node 69b1b7dba26b422765ba3d31: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:42150 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57612 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56666 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47894 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:47904 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37704 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37718 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42808 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40174 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52630 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38792 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60414 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:60428 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46572 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46576 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51510 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40738 - "GET / HTTP/1.0" 200 OK 2026-03-13 18:45:50,468 - lava_callback - INFO - Received callback for node 69b1b855a26b422765ba3d58 INFO: 172.21.0.1:33108 - "POST /node/69b1b855a26b422765ba3d58 HTTP/1.0" 202 Accepted 2026-03-13 18:45:50,474 - lava_callback - INFO - Starting async job submit for node 69b1b855a26b422765ba3d58 2026-03-13 18:45:50,474 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 18:45:50,492 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b1b855a26b422765ba3d58 HTTP/1.1" 200 None 2026-03-13 18:45:50,492 - lava_callback - DEBUG - Processing node 69b1b855a26b422765ba3d58: baseline-arm-clabbe 2026-03-13 18:45:50,493 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b1b855a26b422765ba3d58 2026-03-13 18:45:50,493 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 18:45:50,506 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b1b855a26b422765ba3d58 HTTP/1.1" 200 None 2026-03-13 18:45:50,508 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 18:45:50,520 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b0b4fc9d19175818251fd6 HTTP/1.1" 200 None 2026-03-13 18:45:50,522 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 18:45:50,542 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b1b855a26b422765ba3d58 HTTP/1.1" 200 None 2026-03-13 18:45:50,543 - lava_callback - ERROR - Error processing callback for node 69b1b855a26b422765ba3d58: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:33120 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38044 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41596 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:41606 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35998 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36010 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39482 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33530 - "GET / HTTP/1.0" 200 OK 2026-03-13 18:46:50,471 - lava_callback - INFO - Received callback for node 69b1b885a26b422765ba3d63 INFO: 172.21.0.1:52202 - "POST /node/69b1b885a26b422765ba3d63 HTTP/1.0" 202 Accepted 2026-03-13 18:46:50,476 - lava_callback - INFO - Starting async job submit for node 69b1b885a26b422765ba3d63 2026-03-13 18:46:50,477 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 18:46:50,498 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b1b885a26b422765ba3d63 HTTP/1.1" 200 None 2026-03-13 18:46:50,499 - lava_callback - DEBUG - Processing node 69b1b885a26b422765ba3d63: baseline-arm-clabbe 2026-03-13 18:46:50,499 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b1b885a26b422765ba3d63 2026-03-13 18:46:50,500 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 18:46:50,516 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b1b885a26b422765ba3d63 HTTP/1.1" 200 None 2026-03-13 18:46:50,517 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 18:46:50,530 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b0b4fc9d19175818251fd6 HTTP/1.1" 200 None 2026-03-13 18:46:50,532 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 18:46:50,561 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b1b885a26b422765ba3d63 HTTP/1.1" 200 None 2026-03-13 18:46:50,562 - lava_callback - ERROR - Error processing callback for node 69b1b885a26b422765ba3d63: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:52214 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52794 - "GET / HTTP/1.0" 200 OK 2026-03-13 18:47:10,458 - lava_callback - INFO - Received callback for node 69b1b8aba26b422765ba3d6e INFO: 172.21.0.1:52762 - "POST /node/69b1b8aba26b422765ba3d6e HTTP/1.0" 202 Accepted 2026-03-13 18:47:10,464 - lava_callback - INFO - Starting async job submit for node 69b1b8aba26b422765ba3d6e 2026-03-13 18:47:10,465 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 18:47:10,479 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b1b8aba26b422765ba3d6e HTTP/1.1" 200 None 2026-03-13 18:47:10,480 - lava_callback - DEBUG - Processing node 69b1b8aba26b422765ba3d6e: baseline-arm-clabbe 2026-03-13 18:47:10,480 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b1b8aba26b422765ba3d6e 2026-03-13 18:47:10,481 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 18:47:10,535 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b1b8aba26b422765ba3d6e HTTP/1.1" 200 None 2026-03-13 18:47:10,536 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 18:47:10,562 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b0b4fc9d19175818251fd6 HTTP/1.1" 200 None 2026-03-13 18:47:10,563 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 18:47:10,584 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b1b8aba26b422765ba3d6e HTTP/1.1" 200 None 2026-03-13 18:47:10,593 - lava_callback - ERROR - Error processing callback for node 69b1b8aba26b422765ba3d6e: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:52764 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:52768 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43340 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43356 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49894 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45206 - "GET / HTTP/1.0" 200 OK 2026-03-13 18:47:50,507 - lava_callback - INFO - Received callback for node 69b1b8d1a26b422765ba3d7e INFO: 172.21.0.1:34968 - "POST /node/69b1b8d1a26b422765ba3d7e HTTP/1.0" 202 Accepted 2026-03-13 18:47:50,512 - lava_callback - INFO - Starting async job submit for node 69b1b8d1a26b422765ba3d7e 2026-03-13 18:47:50,513 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 18:47:50,556 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b1b8d1a26b422765ba3d7e HTTP/1.1" 200 None 2026-03-13 18:47:50,557 - lava_callback - DEBUG - Processing node 69b1b8d1a26b422765ba3d7e: baseline-arm-clabbe 2026-03-13 18:47:50,557 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b1b8d1a26b422765ba3d7e 2026-03-13 18:47:50,558 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 18:47:50,580 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b1b8d1a26b422765ba3d7e HTTP/1.1" 200 None 2026-03-13 18:47:50,581 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 18:47:50,597 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b0b4fc9d19175818251fd6 HTTP/1.1" 200 None 2026-03-13 18:47:50,599 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 18:47:50,628 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b1b8d1a26b422765ba3d7e HTTP/1.1" 200 None 2026-03-13 18:47:50,629 - lava_callback - ERROR - Error processing callback for node 69b1b8d1a26b422765ba3d7e: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:34972 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37440 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48238 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:48244 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33910 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33912 - "GET / HTTP/1.0" 200 OK 2026-03-13 18:48:30,492 - lava_callback - INFO - Received callback for node 69b1b8f8a26b422765ba3d87 INFO: 172.21.0.1:50478 - "POST /node/69b1b8f8a26b422765ba3d87 HTTP/1.0" 202 Accepted 2026-03-13 18:48:30,498 - lava_callback - INFO - Starting async job submit for node 69b1b8f8a26b422765ba3d87 2026-03-13 18:48:30,498 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 18:48:30,519 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b1b8f8a26b422765ba3d87 HTTP/1.1" 200 None 2026-03-13 18:48:30,519 - lava_callback - DEBUG - Processing node 69b1b8f8a26b422765ba3d87: baseline-arm-clabbe 2026-03-13 18:48:30,520 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b1b8f8a26b422765ba3d87 2026-03-13 18:48:30,520 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 18:48:30,533 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b1b8f8a26b422765ba3d87 HTTP/1.1" 200 None 2026-03-13 18:48:30,534 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 18:48:30,558 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b0b4fc9d19175818251fd6 HTTP/1.1" 200 None 2026-03-13 18:48:30,559 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 18:48:30,579 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b1b8f8a26b422765ba3d87 HTTP/1.1" 200 None 2026-03-13 18:48:30,580 - lava_callback - ERROR - Error processing callback for node 69b1b8f8a26b422765ba3d87: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:50480 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59790 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50702 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53778 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36274 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:36278 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54068 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54082 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51376 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52954 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42440 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60172 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37748 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:37754 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45738 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45752 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46984 - "GET / HTTP/1.0" 200 OK 2026-03-13 18:50:45,613 - lava_callback - INFO - Received callback for node 69b1b970a26b422765ba3d99 INFO: 172.21.0.1:33444 - "POST /node/69b1b970a26b422765ba3d99 HTTP/1.0" 202 Accepted 2026-03-13 18:50:45,618 - lava_callback - INFO - Starting async job submit for node 69b1b970a26b422765ba3d99 2026-03-13 18:50:45,619 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 18:50:45,658 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b1b970a26b422765ba3d99 HTTP/1.1" 200 None 2026-03-13 18:50:45,659 - lava_callback - DEBUG - Processing node 69b1b970a26b422765ba3d99: baseline-arm-baylibre 2026-03-13 18:50:45,659 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b1b970a26b422765ba3d99 2026-03-13 18:50:45,660 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 18:50:45,676 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b1b970a26b422765ba3d99 HTTP/1.1" 200 None 2026-03-13 18:50:45,678 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 18:50:45,705 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aeba33feb96b28aa34a775 HTTP/1.1" 200 None 2026-03-13 18:50:45,706 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 18:50:45,727 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b1b970a26b422765ba3d99 HTTP/1.1" 200 None 2026-03-13 18:50:45,736 - lava_callback - ERROR - Error processing callback for node 69b1b970a26b422765ba3d99: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:33460 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50144 - "GET / HTTP/1.0" 200 OK 2026-03-13 18:51:05,505 - lava_callback - INFO - Received callback for node 69b1b997a26b422765ba3da4 INFO: 172.21.0.1:48408 - "POST /node/69b1b997a26b422765ba3da4 HTTP/1.0" 202 Accepted 2026-03-13 18:51:05,510 - lava_callback - INFO - Starting async job submit for node 69b1b997a26b422765ba3da4 2026-03-13 18:51:05,511 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 18:51:05,526 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b1b997a26b422765ba3da4 HTTP/1.1" 200 None 2026-03-13 18:51:05,527 - lava_callback - DEBUG - Processing node 69b1b997a26b422765ba3da4: baseline-arm-baylibre 2026-03-13 18:51:05,527 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b1b997a26b422765ba3da4 2026-03-13 18:51:05,528 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 18:51:05,540 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b1b997a26b422765ba3da4 HTTP/1.1" 200 None 2026-03-13 18:51:05,542 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 18:51:05,554 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aeba33feb96b28aa34a775 HTTP/1.1" 200 None 2026-03-13 18:51:05,556 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 18:51:05,577 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b1b997a26b422765ba3da4 HTTP/1.1" 200 None 2026-03-13 18:51:05,578 - lava_callback - ERROR - Error processing callback for node 69b1b997a26b422765ba3da4: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:48418 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55932 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:55934 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36282 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36290 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59338 - "GET / HTTP/1.0" 200 OK 2026-03-13 18:51:45,585 - lava_callback - INFO - Received callback for node 69b1b9bca26b422765ba3db5 INFO: 172.21.0.1:37506 - "POST /node/69b1b9bca26b422765ba3db5 HTTP/1.0" 202 Accepted 2026-03-13 18:51:45,591 - lava_callback - INFO - Starting async job submit for node 69b1b9bca26b422765ba3db5 2026-03-13 18:51:45,591 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 18:51:45,605 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b1b9bca26b422765ba3db5 HTTP/1.1" 200 None 2026-03-13 18:51:45,606 - lava_callback - DEBUG - Processing node 69b1b9bca26b422765ba3db5: baseline-arm-baylibre 2026-03-13 18:51:45,606 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b1b9bca26b422765ba3db5 2026-03-13 18:51:45,607 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 18:51:45,620 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b1b9bca26b422765ba3db5 HTTP/1.1" 200 None 2026-03-13 18:51:45,621 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 18:51:45,635 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aeba33feb96b28aa34a775 HTTP/1.1" 200 None 2026-03-13 18:51:45,636 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 18:51:45,659 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b1b9bca26b422765ba3db5 HTTP/1.1" 200 None 2026-03-13 18:51:45,660 - lava_callback - ERROR - Error processing callback for node 69b1b9bca26b422765ba3db5: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:37508 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33712 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49616 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42568 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:42572 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49374 - "GET / HTTP/1.0" 200 OK 2026-03-13 18:52:25,640 - lava_callback - INFO - Received callback for node 69b1b9e2a26b422765ba3dbd INFO: 172.21.0.1:49390 - "POST /node/69b1b9e2a26b422765ba3dbd HTTP/1.0" 202 Accepted 2026-03-13 18:52:25,645 - lava_callback - INFO - Starting async job submit for node 69b1b9e2a26b422765ba3dbd 2026-03-13 18:52:25,646 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 18:52:25,668 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b1b9e2a26b422765ba3dbd HTTP/1.1" 200 None 2026-03-13 18:52:25,669 - lava_callback - DEBUG - Processing node 69b1b9e2a26b422765ba3dbd: baseline-arm-baylibre 2026-03-13 18:52:25,670 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b1b9e2a26b422765ba3dbd 2026-03-13 18:52:25,670 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 18:52:25,689 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b1b9e2a26b422765ba3dbd HTTP/1.1" 200 None 2026-03-13 18:52:25,691 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 18:52:25,711 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aeba33feb96b28aa34a775 HTTP/1.1" 200 None 2026-03-13 18:52:25,713 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 18:52:25,748 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b1b9e2a26b422765ba3dbd HTTP/1.1" 200 None 2026-03-13 18:52:25,749 - lava_callback - ERROR - Error processing callback for node 69b1b9e2a26b422765ba3dbd: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:49398 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41864 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:32828 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39802 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44934 - "GET / HTTP/1.0" 200 OK 2026-03-13 18:53:10,721 - lava_callback - INFO - Received callback for node 69b1ba09a26b422765ba3dcb INFO: 172.21.0.1:45906 - "POST /node/69b1ba09a26b422765ba3dcb HTTP/1.0" 202 Accepted 2026-03-13 18:53:10,726 - lava_callback - INFO - Starting async job submit for node 69b1ba09a26b422765ba3dcb 2026-03-13 18:53:10,727 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 18:53:10,741 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b1ba09a26b422765ba3dcb HTTP/1.1" 200 None 2026-03-13 18:53:10,742 - lava_callback - DEBUG - Processing node 69b1ba09a26b422765ba3dcb: baseline-arm-clabbe 2026-03-13 18:53:10,742 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b1ba09a26b422765ba3dcb 2026-03-13 18:53:10,743 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 18:53:10,756 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b1ba09a26b422765ba3dcb HTTP/1.1" 200 None 2026-03-13 18:53:10,757 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 18:53:10,771 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aeba33feb96b28aa34a775 HTTP/1.1" 200 None 2026-03-13 18:53:10,772 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 18:53:10,792 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b1ba09a26b422765ba3dcb HTTP/1.1" 200 None 2026-03-13 18:53:10,800 - lava_callback - ERROR - Error processing callback for node 69b1ba09a26b422765ba3dcb: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:45910 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:45924 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59098 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59112 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42772 - "GET / HTTP/1.0" 200 OK 2026-03-13 18:53:45,705 - lava_callback - INFO - Received callback for node 69b1ba2da26b422765ba3dd9 INFO: 172.21.0.1:38182 - "POST /node/69b1ba2da26b422765ba3dd9 HTTP/1.0" 202 Accepted 2026-03-13 18:53:45,710 - lava_callback - INFO - Starting async job submit for node 69b1ba2da26b422765ba3dd9 2026-03-13 18:53:45,711 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 18:53:45,725 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b1ba2da26b422765ba3dd9 HTTP/1.1" 200 None 2026-03-13 18:53:45,726 - lava_callback - DEBUG - Processing node 69b1ba2da26b422765ba3dd9: baseline-arm-baylibre 2026-03-13 18:53:45,726 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b1ba2da26b422765ba3dd9 2026-03-13 18:53:45,727 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 18:53:45,740 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b1ba2da26b422765ba3dd9 HTTP/1.1" 200 None 2026-03-13 18:53:45,741 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 18:53:45,778 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aeba33feb96b28aa34a775 HTTP/1.1" 200 None 2026-03-13 18:53:45,780 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 18:53:45,809 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b1ba2da26b422765ba3dd9 HTTP/1.1" 200 None 2026-03-13 18:53:45,810 - lava_callback - ERROR - Error processing callback for node 69b1ba2da26b422765ba3dd9: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:38198 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41900 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50006 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44420 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:44422 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57230 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57244 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52668 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38240 - "GET / HTTP/1.0" 200 OK 2026-03-13 18:54:50,776 - lava_callback - INFO - Received callback for node 69b1ba65a26b422765ba3deb INFO: 172.21.0.1:60256 - "POST /node/69b1ba65a26b422765ba3deb HTTP/1.0" 202 Accepted 2026-03-13 18:54:50,781 - lava_callback - INFO - Starting async job submit for node 69b1ba65a26b422765ba3deb 2026-03-13 18:54:50,782 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 18:54:50,797 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b1ba65a26b422765ba3deb HTTP/1.1" 200 None 2026-03-13 18:54:50,798 - lava_callback - DEBUG - Processing node 69b1ba65a26b422765ba3deb: baseline-arm-clabbe 2026-03-13 18:54:50,798 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b1ba65a26b422765ba3deb 2026-03-13 18:54:50,799 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 18:54:50,812 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b1ba65a26b422765ba3deb HTTP/1.1" 200 None 2026-03-13 18:54:50,814 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 18:54:50,828 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aeba33feb96b28aa34a775 HTTP/1.1" 200 None 2026-03-13 18:54:50,829 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 18:54:50,857 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b1ba65a26b422765ba3deb HTTP/1.1" 200 None 2026-03-13 18:54:50,859 - lava_callback - ERROR - Error processing callback for node 69b1ba65a26b422765ba3deb: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:60258 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38858 - "GET / HTTP/1.0" 200 OK 2026-03-13 18:55:10,752 - lava_callback - INFO - Received callback for node 69b1ba8ca26b422765ba3df8 INFO: 172.21.0.1:50354 - "POST /node/69b1ba8ca26b422765ba3df8 HTTP/1.0" 202 Accepted 2026-03-13 18:55:10,758 - lava_callback - INFO - Starting async job submit for node 69b1ba8ca26b422765ba3df8 2026-03-13 18:55:10,759 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 18:55:10,793 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b1ba8ca26b422765ba3df8 HTTP/1.1" 200 None 2026-03-13 18:55:10,794 - lava_callback - DEBUG - Processing node 69b1ba8ca26b422765ba3df8: baseline-arm-clabbe 2026-03-13 18:55:10,794 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b1ba8ca26b422765ba3df8 2026-03-13 18:55:10,795 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 18:55:10,809 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b1ba8ca26b422765ba3df8 HTTP/1.1" 200 None 2026-03-13 18:55:10,810 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 18:55:10,823 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aeba33feb96b28aa34a775 HTTP/1.1" 200 None 2026-03-13 18:55:10,825 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 18:55:10,860 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b1ba8ca26b422765ba3df8 HTTP/1.1" 200 None 2026-03-13 18:55:10,866 - lava_callback - ERROR - Error processing callback for node 69b1ba8ca26b422765ba3df8: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:50358 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:50368 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43554 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43564 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38818 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53120 - "GET / HTTP/1.0" 200 OK 2026-03-13 18:55:50,980 - lava_callback - INFO - Received callback for node 69b1bab2a26b422765ba3e06 INFO: 172.21.0.1:44972 - "POST /node/69b1bab2a26b422765ba3e06 HTTP/1.0" 202 Accepted 2026-03-13 18:55:50,986 - lava_callback - INFO - Starting async job submit for node 69b1bab2a26b422765ba3e06 2026-03-13 18:55:50,987 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 18:55:51,000 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b1bab2a26b422765ba3e06 HTTP/1.1" 200 None 2026-03-13 18:55:51,001 - lava_callback - DEBUG - Processing node 69b1bab2a26b422765ba3e06: baseline-arm-clabbe 2026-03-13 18:55:51,001 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b1bab2a26b422765ba3e06 2026-03-13 18:55:51,002 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 18:55:51,015 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b1bab2a26b422765ba3e06 HTTP/1.1" 200 None 2026-03-13 18:55:51,016 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 18:55:51,030 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aeba33feb96b28aa34a775 HTTP/1.1" 200 None 2026-03-13 18:55:51,031 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 18:55:51,057 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b1bab2a26b422765ba3e06 HTTP/1.1" 200 None 2026-03-13 18:55:51,058 - lava_callback - ERROR - Error processing callback for node 69b1bab2a26b422765ba3e06: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:44984 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37816 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58328 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:58334 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50490 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50504 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47030 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43918 - "GET / HTTP/1.0" 200 OK 2026-03-13 18:56:50,895 - lava_callback - INFO - Received callback for node 69b1badea26b422765ba3e14 INFO: 172.21.0.1:60966 - "POST /node/69b1badea26b422765ba3e14 HTTP/1.0" 202 Accepted 2026-03-13 18:56:50,901 - lava_callback - INFO - Starting async job submit for node 69b1badea26b422765ba3e14 2026-03-13 18:56:50,902 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 18:56:50,915 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b1badea26b422765ba3e14 HTTP/1.1" 200 None 2026-03-13 18:56:50,916 - lava_callback - DEBUG - Processing node 69b1badea26b422765ba3e14: baseline-arm-clabbe 2026-03-13 18:56:50,917 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b1badea26b422765ba3e14 2026-03-13 18:56:50,917 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 18:56:50,930 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b1badea26b422765ba3e14 HTTP/1.1" 200 None 2026-03-13 18:56:50,931 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 18:56:50,958 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aeba33feb96b28aa34a775 HTTP/1.1" 200 None 2026-03-13 18:56:50,959 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 18:56:50,980 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b1badea26b422765ba3e14 HTTP/1.1" 200 None 2026-03-13 18:56:50,986 - lava_callback - ERROR - Error processing callback for node 69b1badea26b422765ba3e14: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:60982 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40996 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46532 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:46548 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59240 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59254 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53574 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53212 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40870 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46580 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39610 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:39612 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48704 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48716 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42904 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60700 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56330 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34370 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60476 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:60484 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39316 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39318 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44260 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34348 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56016 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45664 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33074 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:33076 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50648 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50660 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59522 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36238 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38018 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37530 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33772 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:33776 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47966 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47978 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34046 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35014 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57150 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35104 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60958 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:60964 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48340 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48344 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36886 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37968 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40826 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60372 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50880 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:50890 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39284 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39286 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36000 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58524 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39260 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47430 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56898 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:56902 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53400 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53404 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58518 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50540 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57338 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44358 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40410 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:40426 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42082 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42088 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51474 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49414 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41174 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50100 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38336 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:38346 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44562 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44568 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33414 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33194 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33034 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36624 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40398 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:40412 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34224 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34228 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53036 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44438 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39788 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41026 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35046 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:35062 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44220 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44230 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44666 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50476 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44344 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35846 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55002 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:55014 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47138 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47140 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51910 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59890 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48812 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57010 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37074 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:37078 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45198 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45202 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36452 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53710 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59900 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58262 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55632 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:55644 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43908 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43914 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48912 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34594 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42136 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54382 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37478 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:37486 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48740 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48748 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36498 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46660 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37828 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48222 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34450 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:34452 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41870 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41884 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37282 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56702 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53634 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40104 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60596 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:60598 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36180 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36196 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35832 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42002 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39396 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49864 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47746 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:47762 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44234 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44244 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54386 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60072 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42726 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58958 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48796 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:48802 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37582 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37598 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56864 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41778 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55796 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35688 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57984 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:57986 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50438 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50452 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48340 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37450 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49704 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57742 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37168 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:37174 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34346 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34356 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50306 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54604 - "GET / HTTP/1.0" 200 OK 2026-03-13 19:18:47,201 - lava_callback - INFO - Received callback for node 69b1c00da26b422765ba3f6b INFO: 172.21.0.1:54616 - "POST /node/69b1c00da26b422765ba3f6b HTTP/1.0" 202 Accepted 2026-03-13 19:18:47,208 - lava_callback - INFO - Starting async job submit for node 69b1c00da26b422765ba3f6b 2026-03-13 19:18:47,209 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 19:18:47,223 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b1c00da26b422765ba3f6b HTTP/1.1" 200 None 2026-03-13 19:18:47,224 - lava_callback - DEBUG - Processing node 69b1c00da26b422765ba3f6b: baseline-arm64-baylibre 2026-03-13 19:18:47,225 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b1c00da26b422765ba3f6b 2026-03-13 19:18:47,225 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 19:18:47,246 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b1c00da26b422765ba3f6b HTTP/1.1" 200 None 2026-03-13 19:18:47,247 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 19:18:47,261 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b1960ba26b422765ba3717 HTTP/1.1" 200 None 2026-03-13 19:18:47,262 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 19:18:47,282 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b1c00da26b422765ba3f6b HTTP/1.1" 200 None 2026-03-13 19:18:47,284 - lava_callback - ERROR - Error processing callback for node 69b1c00da26b422765ba3f6b: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' 2026-03-13 19:18:47,850 - lava_callback - INFO - Received callback for node 69b1c00fa26b422765ba3f88 INFO: 172.21.0.1:54620 - "POST /node/69b1c00fa26b422765ba3f88 HTTP/1.0" 202 Accepted 2026-03-13 19:18:47,855 - lava_callback - INFO - Starting async job submit for node 69b1c00fa26b422765ba3f88 2026-03-13 19:18:47,856 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 19:18:47,870 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b1c00fa26b422765ba3f88 HTTP/1.1" 200 None 2026-03-13 19:18:47,870 - lava_callback - DEBUG - Processing node 69b1c00fa26b422765ba3f88: baseline-arm64-baylibre 2026-03-13 19:18:47,871 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b1c00fa26b422765ba3f88 2026-03-13 19:18:47,871 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 19:18:47,884 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b1c00fa26b422765ba3f88 HTTP/1.1" 200 None 2026-03-13 19:18:47,886 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 19:18:47,899 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b1960ba26b422765ba3717 HTTP/1.1" 200 None 2026-03-13 19:18:47,900 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 19:18:47,928 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b1c00fa26b422765ba3f88 HTTP/1.1" 200 None 2026-03-13 19:18:47,929 - lava_callback - ERROR - Error processing callback for node 69b1c00fa26b422765ba3f88: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' 2026-03-13 19:18:48,522 - lava_callback - INFO - Received callback for node 69b1c010a26b422765ba3f8b INFO: 172.21.0.1:54634 - "POST /node/69b1c010a26b422765ba3f8b HTTP/1.0" 202 Accepted 2026-03-13 19:18:48,530 - lava_callback - INFO - Starting async job submit for node 69b1c010a26b422765ba3f8b 2026-03-13 19:18:48,531 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 19:18:48,559 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b1c010a26b422765ba3f8b HTTP/1.1" 200 None 2026-03-13 19:18:48,560 - lava_callback - DEBUG - Processing node 69b1c010a26b422765ba3f8b: baseline-arm64-baylibre 2026-03-13 19:18:48,560 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b1c010a26b422765ba3f8b 2026-03-13 19:18:48,561 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 19:18:48,574 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b1c010a26b422765ba3f8b HTTP/1.1" 200 None 2026-03-13 19:18:48,575 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 19:18:48,588 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b1960ba26b422765ba3717 HTTP/1.1" 200 None 2026-03-13 19:18:48,590 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 19:18:48,610 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b1c010a26b422765ba3f8b HTTP/1.1" 200 None 2026-03-13 19:18:48,615 - lava_callback - ERROR - Error processing callback for node 69b1c010a26b422765ba3f8b: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' 2026-03-13 19:18:49,169 - lava_callback - INFO - Received callback for node 69b1c014a26b422765ba3f95 INFO: 172.21.0.1:54644 - "POST /node/69b1c014a26b422765ba3f95 HTTP/1.0" 202 Accepted 2026-03-13 19:18:49,175 - lava_callback - INFO - Starting async job submit for node 69b1c014a26b422765ba3f95 2026-03-13 19:18:49,175 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 19:18:49,192 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b1c014a26b422765ba3f95 HTTP/1.1" 200 None 2026-03-13 19:18:49,194 - lava_callback - DEBUG - Processing node 69b1c014a26b422765ba3f95: baseline-arm64-baylibre 2026-03-13 19:18:49,194 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b1c014a26b422765ba3f95 2026-03-13 19:18:49,195 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 19:18:49,212 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b1c014a26b422765ba3f95 HTTP/1.1" 200 None 2026-03-13 19:18:49,213 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 19:18:49,233 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b1960ba26b422765ba3717 HTTP/1.1" 200 None 2026-03-13 19:18:49,235 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 19:18:49,259 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b1c014a26b422765ba3f95 HTTP/1.1" 200 None 2026-03-13 19:18:49,264 - lava_callback - ERROR - Error processing callback for node 69b1c014a26b422765ba3f95: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' 2026-03-13 19:18:49,858 - lava_callback - INFO - Received callback for node 69b1c013a26b422765ba3f92 INFO: 172.21.0.1:52074 - "POST /node/69b1c013a26b422765ba3f92 HTTP/1.0" 202 Accepted 2026-03-13 19:18:49,864 - lava_callback - INFO - Starting async job submit for node 69b1c013a26b422765ba3f92 2026-03-13 19:18:49,865 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 19:18:49,884 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b1c013a26b422765ba3f92 HTTP/1.1" 200 None 2026-03-13 19:18:49,885 - lava_callback - DEBUG - Processing node 69b1c013a26b422765ba3f92: baseline-arm64-baylibre 2026-03-13 19:18:49,886 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b1c013a26b422765ba3f92 2026-03-13 19:18:49,886 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 19:18:49,900 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b1c013a26b422765ba3f92 HTTP/1.1" 200 None 2026-03-13 19:18:49,901 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 19:18:49,917 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b1960ba26b422765ba3717 HTTP/1.1" 200 None 2026-03-13 19:18:49,919 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 19:18:49,949 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b1c013a26b422765ba3f92 HTTP/1.1" 200 None 2026-03-13 19:18:49,955 - lava_callback - ERROR - Error processing callback for node 69b1c013a26b422765ba3f92: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:52080 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40582 - "GET / HTTP/1.0" 200 OK 2026-03-13 19:19:07,040 - lava_callback - INFO - Received callback for node 69b1c015a26b422765ba3f98 INFO: 172.21.0.1:40588 - "POST /node/69b1c015a26b422765ba3f98 HTTP/1.0" 202 Accepted 2026-03-13 19:19:07,046 - lava_callback - INFO - Starting async job submit for node 69b1c015a26b422765ba3f98 2026-03-13 19:19:07,047 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 19:19:07,074 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b1c015a26b422765ba3f98 HTTP/1.1" 200 None 2026-03-13 19:19:07,074 - lava_callback - DEBUG - Processing node 69b1c015a26b422765ba3f98: baseline-arm64-baylibre 2026-03-13 19:19:07,075 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b1c015a26b422765ba3f98 2026-03-13 19:19:07,075 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 19:19:07,089 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b1c015a26b422765ba3f98 HTTP/1.1" 200 None 2026-03-13 19:19:07,090 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 19:19:07,103 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b1960ba26b422765ba3717 HTTP/1.1" 200 None 2026-03-13 19:19:07,105 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 19:19:07,126 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b1c015a26b422765ba3f98 HTTP/1.1" 200 None 2026-03-13 19:19:07,131 - lava_callback - ERROR - Error processing callback for node 69b1c015a26b422765ba3f98: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' 2026-03-13 19:19:07,686 - lava_callback - INFO - Received callback for node 69b1c026a26b422765ba3fbe INFO: 172.21.0.1:40592 - "POST /node/69b1c026a26b422765ba3fbe HTTP/1.0" 202 Accepted 2026-03-13 19:19:07,691 - lava_callback - INFO - Starting async job submit for node 69b1c026a26b422765ba3fbe 2026-03-13 19:19:07,692 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 19:19:07,708 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b1c026a26b422765ba3fbe HTTP/1.1" 200 None 2026-03-13 19:19:07,709 - lava_callback - DEBUG - Processing node 69b1c026a26b422765ba3fbe: baseline-arm64-baylibre 2026-03-13 19:19:07,709 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b1c026a26b422765ba3fbe 2026-03-13 19:19:07,710 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 19:19:07,724 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b1c026a26b422765ba3fbe HTTP/1.1" 200 None 2026-03-13 19:19:07,725 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 19:19:07,746 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b0b5149d19175818251feb HTTP/1.1" 200 None 2026-03-13 19:19:07,747 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 19:19:07,768 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b1c026a26b422765ba3fbe HTTP/1.1" 200 None 2026-03-13 19:19:07,778 - lava_callback - ERROR - Error processing callback for node 69b1c026a26b422765ba3fbe: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' 2026-03-13 19:19:11,924 - lava_callback - INFO - Received callback for node 69b1c026a26b422765ba3fc1 INFO: 172.21.0.1:45780 - "POST /node/69b1c026a26b422765ba3fc1 HTTP/1.0" 202 Accepted 2026-03-13 19:19:11,929 - lava_callback - INFO - Starting async job submit for node 69b1c026a26b422765ba3fc1 2026-03-13 19:19:11,930 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 19:19:11,944 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b1c026a26b422765ba3fc1 HTTP/1.1" 200 None 2026-03-13 19:19:11,945 - lava_callback - DEBUG - Processing node 69b1c026a26b422765ba3fc1: baseline-arm64-clabbe 2026-03-13 19:19:11,945 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b1c026a26b422765ba3fc1 2026-03-13 19:19:11,946 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 19:19:11,959 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b1c026a26b422765ba3fc1 HTTP/1.1" 200 None 2026-03-13 19:19:11,960 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 19:19:11,976 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b1960ba26b422765ba3717 HTTP/1.1" 200 None 2026-03-13 19:19:11,977 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 19:19:12,006 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b1c026a26b422765ba3fc1 HTTP/1.1" 200 None 2026-03-13 19:19:12,008 - lava_callback - ERROR - Error processing callback for node 69b1c026a26b422765ba3fc1: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' 2026-03-13 19:19:12,582 - lava_callback - INFO - Received callback for node 69b1c028a26b422765ba3fc5 INFO: 172.21.0.1:45790 - "POST /node/69b1c028a26b422765ba3fc5 HTTP/1.0" 202 Accepted 2026-03-13 19:19:12,587 - lava_callback - INFO - Starting async job submit for node 69b1c028a26b422765ba3fc5 2026-03-13 19:19:12,588 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 19:19:12,602 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b1c028a26b422765ba3fc5 HTTP/1.1" 200 None 2026-03-13 19:19:12,603 - lava_callback - DEBUG - Processing node 69b1c028a26b422765ba3fc5: baseline-arm64-clabbe 2026-03-13 19:19:12,603 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b1c028a26b422765ba3fc5 2026-03-13 19:19:12,604 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 19:19:12,617 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b1c028a26b422765ba3fc5 HTTP/1.1" 200 None 2026-03-13 19:19:12,619 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 19:19:12,636 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b1960ba26b422765ba3717 HTTP/1.1" 200 None 2026-03-13 19:19:12,637 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 19:19:12,671 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b1c028a26b422765ba3fc5 HTTP/1.1" 200 None 2026-03-13 19:19:12,672 - lava_callback - ERROR - Error processing callback for node 69b1c028a26b422765ba3fc5: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' 2026-03-13 19:19:13,238 - lava_callback - INFO - Received callback for node 69b1c029a26b422765ba3fc8 INFO: 172.21.0.1:45806 - "POST /node/69b1c029a26b422765ba3fc8 HTTP/1.0" 202 Accepted 2026-03-13 19:19:13,244 - lava_callback - INFO - Starting async job submit for node 69b1c029a26b422765ba3fc8 2026-03-13 19:19:13,245 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 19:19:13,259 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b1c029a26b422765ba3fc8 HTTP/1.1" 200 None 2026-03-13 19:19:13,260 - lava_callback - DEBUG - Processing node 69b1c029a26b422765ba3fc8: baseline-arm64-clabbe 2026-03-13 19:19:13,260 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b1c029a26b422765ba3fc8 2026-03-13 19:19:13,261 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 19:19:13,274 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b1c029a26b422765ba3fc8 HTTP/1.1" 200 None 2026-03-13 19:19:13,275 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 19:19:13,288 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b1960ba26b422765ba3717 HTTP/1.1" 200 None 2026-03-13 19:19:13,290 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 19:19:13,311 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b1c029a26b422765ba3fc8 HTTP/1.1" 200 None 2026-03-13 19:19:13,317 - lava_callback - ERROR - Error processing callback for node 69b1c029a26b422765ba3fc8: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' 2026-03-13 19:19:13,895 - lava_callback - INFO - Received callback for node 69b1c02aa26b422765ba3fcb INFO: 172.21.0.1:45818 - "POST /node/69b1c02aa26b422765ba3fcb HTTP/1.0" 202 Accepted 2026-03-13 19:19:13,900 - lava_callback - INFO - Starting async job submit for node 69b1c02aa26b422765ba3fcb 2026-03-13 19:19:13,901 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 19:19:13,914 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b1c02aa26b422765ba3fcb HTTP/1.1" 200 None 2026-03-13 19:19:13,915 - lava_callback - DEBUG - Processing node 69b1c02aa26b422765ba3fcb: baseline-arm64-clabbe 2026-03-13 19:19:13,915 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b1c02aa26b422765ba3fcb 2026-03-13 19:19:13,916 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 19:19:13,930 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b1c02aa26b422765ba3fcb HTTP/1.1" 200 None 2026-03-13 19:19:13,931 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 19:19:13,944 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b1960ba26b422765ba3717 HTTP/1.1" 200 None 2026-03-13 19:19:13,946 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 19:19:13,965 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b1c02aa26b422765ba3fcb HTTP/1.1" 200 None 2026-03-13 19:19:13,971 - lava_callback - ERROR - Error processing callback for node 69b1c02aa26b422765ba3fcb: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' 2026-03-13 19:19:14,660 - lava_callback - INFO - Received callback for node 69b1c02ca26b422765ba3fd8 INFO: 172.21.0.1:45824 - "POST /node/69b1c02ca26b422765ba3fd8 HTTP/1.0" 202 Accepted 2026-03-13 19:19:14,665 - lava_callback - INFO - Starting async job submit for node 69b1c02ca26b422765ba3fd8 2026-03-13 19:19:14,666 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 19:19:14,687 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b1c02ca26b422765ba3fd8 HTTP/1.1" 200 None 2026-03-13 19:19:14,687 - lava_callback - DEBUG - Processing node 69b1c02ca26b422765ba3fd8: baseline-arm64-clabbe 2026-03-13 19:19:14,688 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b1c02ca26b422765ba3fd8 2026-03-13 19:19:14,688 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 19:19:14,709 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b1c02ca26b422765ba3fd8 HTTP/1.1" 200 None 2026-03-13 19:19:14,711 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 19:19:14,725 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b1960ba26b422765ba3717 HTTP/1.1" 200 None 2026-03-13 19:19:14,726 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 19:19:14,756 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b1c02ca26b422765ba3fd8 HTTP/1.1" 200 None 2026-03-13 19:19:14,757 - lava_callback - ERROR - Error processing callback for node 69b1c02ca26b422765ba3fd8: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:45840 - "GET /api/metrics HTTP/1.0" 200 OK 2026-03-13 19:19:15,321 - lava_callback - INFO - Received callback for node 69b1c02ba26b422765ba3fd5 INFO: 172.21.0.1:45856 - "POST /node/69b1c02ba26b422765ba3fd5 HTTP/1.0" 202 Accepted 2026-03-13 19:19:15,327 - lava_callback - INFO - Starting async job submit for node 69b1c02ba26b422765ba3fd5 2026-03-13 19:19:15,328 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 19:19:15,342 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b1c02ba26b422765ba3fd5 HTTP/1.1" 200 None 2026-03-13 19:19:15,342 - lava_callback - DEBUG - Processing node 69b1c02ba26b422765ba3fd5: baseline-arm64-clabbe 2026-03-13 19:19:15,343 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b1c02ba26b422765ba3fd5 2026-03-13 19:19:15,343 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 19:19:15,357 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b1c02ba26b422765ba3fd5 HTTP/1.1" 200 None 2026-03-13 19:19:15,358 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 19:19:15,371 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b1960ba26b422765ba3717 HTTP/1.1" 200 None 2026-03-13 19:19:15,372 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 19:19:15,393 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b1c02ba26b422765ba3fd5 HTTP/1.1" 200 None 2026-03-13 19:19:15,394 - lava_callback - ERROR - Error processing callback for node 69b1c02ba26b422765ba3fd5: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:45868 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34876 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34886 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57612 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53282 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50304 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52266 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54196 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:54200 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34480 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34488 - "GET / HTTP/1.0" 200 OK 2026-03-13 19:20:31,925 - lava_callback - INFO - Received callback for node 69b1c078a26b422765ba407f INFO: 172.21.0.1:52914 - "POST /node/69b1c078a26b422765ba407f HTTP/1.0" 202 Accepted 2026-03-13 19:20:31,931 - lava_callback - INFO - Starting async job submit for node 69b1c078a26b422765ba407f 2026-03-13 19:20:31,932 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 19:20:31,948 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b1c078a26b422765ba407f HTTP/1.1" 200 None 2026-03-13 19:20:31,948 - lava_callback - DEBUG - Processing node 69b1c078a26b422765ba407f: baseline-arm64-clabbe 2026-03-13 19:20:31,949 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b1c078a26b422765ba407f 2026-03-13 19:20:31,949 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 19:20:31,962 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b1c078a26b422765ba407f HTTP/1.1" 200 None 2026-03-13 19:20:31,964 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 19:20:31,979 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b0b5149d19175818251feb HTTP/1.1" 200 None 2026-03-13 19:20:31,981 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 19:20:32,003 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b1c078a26b422765ba407f HTTP/1.1" 200 None 2026-03-13 19:20:32,004 - lava_callback - ERROR - Error processing callback for node 69b1c078a26b422765ba407f: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:52928 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50484 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42368 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45244 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44144 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:44160 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60790 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60806 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51898 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48138 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42044 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48128 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42388 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:42394 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46890 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46904 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60862 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54202 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41096 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58546 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47822 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:47828 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51336 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51346 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47836 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35814 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47472 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58248 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59080 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:59092 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37254 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37262 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33974 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53136 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35990 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56516 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59612 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:59618 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44038 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44048 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36904 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53734 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47176 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49054 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35484 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:35496 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36512 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36526 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57534 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34806 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57722 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34848 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35650 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:35660 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52708 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52722 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41124 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60674 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44950 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35558 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60206 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:60208 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39388 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39404 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37158 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57670 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41030 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46308 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48166 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:48172 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35034 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35038 - "GET / HTTP/1.0" 200 OK 2026-03-13 19:29:32,336 - lava_callback - INFO - Received callback for node 69b1c28fa26b422765ba4160 INFO: 172.21.0.1:46022 - "POST /node/69b1c28fa26b422765ba4160 HTTP/1.0" 202 Accepted 2026-03-13 19:29:32,342 - lava_callback - INFO - Starting async job submit for node 69b1c28fa26b422765ba4160 2026-03-13 19:29:32,343 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 19:29:32,360 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b1c28fa26b422765ba4160 HTTP/1.1" 200 None 2026-03-13 19:29:32,361 - lava_callback - DEBUG - Processing node 69b1c28fa26b422765ba4160: baseline-arm64-clabbe 2026-03-13 19:29:32,361 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b1c28fa26b422765ba4160 2026-03-13 19:29:32,362 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 19:29:32,375 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b1c28fa26b422765ba4160 HTTP/1.1" 200 None 2026-03-13 19:29:32,377 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 19:29:32,390 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b0b5149d19175818251feb HTTP/1.1" 200 None 2026-03-13 19:29:32,391 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 19:29:32,413 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b1c28fa26b422765ba4160 HTTP/1.1" 200 None 2026-03-13 19:29:32,414 - lava_callback - ERROR - Error processing callback for node 69b1c28fa26b422765ba4160: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:46034 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40980 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37474 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47678 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38278 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:38290 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53088 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53096 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52666 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40320 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44266 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48026 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34722 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:34724 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48996 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49006 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54978 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39558 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33312 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46836 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49184 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:49186 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37624 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37638 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56412 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37612 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33836 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45100 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35094 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:35102 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37726 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37732 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46482 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40742 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41702 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36816 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44514 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:44530 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41022 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41034 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34196 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45496 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56072 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42378 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40316 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:40326 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56342 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56356 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35654 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42118 - "GET / HTTP/1.0" 200 OK 2026-03-13 19:35:48,082 - lava_callback - INFO - Received callback for node 69b1c410a26b422765ba41b0 INFO: 172.21.0.1:42120 - "POST /node/69b1c410a26b422765ba41b0 HTTP/1.0" 202 Accepted 2026-03-13 19:35:48,087 - lava_callback - INFO - Starting async job submit for node 69b1c410a26b422765ba41b0 2026-03-13 19:35:48,088 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 19:35:48,102 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b1c410a26b422765ba41b0 HTTP/1.1" 200 None 2026-03-13 19:35:48,103 - lava_callback - DEBUG - Processing node 69b1c410a26b422765ba41b0: baseline-arm64-baylibre 2026-03-13 19:35:48,103 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b1c410a26b422765ba41b0 2026-03-13 19:35:48,104 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 19:35:48,122 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b1c410a26b422765ba41b0 HTTP/1.1" 200 None 2026-03-13 19:35:48,123 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 19:35:48,146 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aeba41feb96b28aa34a78b HTTP/1.1" 200 None 2026-03-13 19:35:48,148 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 19:35:48,168 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b1c410a26b422765ba41b0 HTTP/1.1" 200 None 2026-03-13 19:35:48,169 - lava_callback - ERROR - Error processing callback for node 69b1c410a26b422765ba41b0: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:57384 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45558 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56568 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:56584 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49870 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49876 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51060 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48826 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55766 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51004 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47642 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:47652 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34182 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34198 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39826 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41790 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36692 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37734 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46638 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:46652 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38272 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38286 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34428 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40380 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40736 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49790 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36320 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:36328 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33342 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33354 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50610 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40144 - "GET / HTTP/1.0" 200 OK 2026-03-13 19:39:48,234 - lava_callback - INFO - Received callback for node 69b1c4fda26b422765ba41dd INFO: 172.21.0.1:40158 - "POST /node/69b1c4fda26b422765ba41dd HTTP/1.0" 202 Accepted 2026-03-13 19:39:48,240 - lava_callback - INFO - Starting async job submit for node 69b1c4fda26b422765ba41dd 2026-03-13 19:39:48,241 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 19:39:48,265 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b1c4fda26b422765ba41dd HTTP/1.1" 200 None 2026-03-13 19:39:48,266 - lava_callback - DEBUG - Processing node 69b1c4fda26b422765ba41dd: baseline-arm64-baylibre 2026-03-13 19:39:48,266 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b1c4fda26b422765ba41dd 2026-03-13 19:39:48,266 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 19:39:48,281 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b1c4fda26b422765ba41dd HTTP/1.1" 200 None 2026-03-13 19:39:48,283 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 19:39:48,295 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aeba41feb96b28aa34a78b HTTP/1.1" 200 None 2026-03-13 19:39:48,297 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 19:39:48,321 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b1c4fda26b422765ba41dd HTTP/1.1" 200 None 2026-03-13 19:39:48,326 - lava_callback - ERROR - Error processing callback for node 69b1c4fda26b422765ba41dd: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:60692 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60956 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45218 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:45232 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40224 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40230 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52854 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35036 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60916 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60180 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35394 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:35406 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46490 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46498 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38316 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41926 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53214 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55836 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37580 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:37594 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55128 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55132 - "GET / HTTP/1.0" 200 OK 2026-03-13 19:42:28,330 - lava_callback - INFO - Received callback for node 69b1c59ba26b422765ba41fb INFO: 172.21.0.1:55140 - "POST /node/69b1c59ba26b422765ba41fb HTTP/1.0" 202 Accepted 2026-03-13 19:42:28,337 - lava_callback - INFO - Starting async job submit for node 69b1c59ba26b422765ba41fb 2026-03-13 19:42:28,337 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 19:42:28,351 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b1c59ba26b422765ba41fb HTTP/1.1" 200 None 2026-03-13 19:42:28,352 - lava_callback - DEBUG - Processing node 69b1c59ba26b422765ba41fb: baseline-arm64-baylibre 2026-03-13 19:42:28,352 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b1c59ba26b422765ba41fb 2026-03-13 19:42:28,353 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 19:42:28,374 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b1c59ba26b422765ba41fb HTTP/1.1" 200 None 2026-03-13 19:42:28,375 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 19:42:28,388 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aeba41feb96b28aa34a78b HTTP/1.1" 200 None 2026-03-13 19:42:28,389 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 19:42:28,410 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b1c59ba26b422765ba41fb HTTP/1.1" 200 None 2026-03-13 19:42:28,419 - lava_callback - ERROR - Error processing callback for node 69b1c59ba26b422765ba41fb: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:44944 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47264 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44018 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37468 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57246 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:57258 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37504 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37510 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54100 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59442 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60234 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50670 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36338 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:36342 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50076 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50078 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42074 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34364 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54008 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59052 - "GET / HTTP/1.0" 200 OK 2026-03-13 19:45:08,532 - lava_callback - INFO - Received callback for node 69b1c63aa26b422765ba421e INFO: 172.21.0.1:59056 - "POST /node/69b1c63aa26b422765ba421e HTTP/1.0" 202 Accepted 2026-03-13 19:45:08,537 - lava_callback - INFO - Starting async job submit for node 69b1c63aa26b422765ba421e 2026-03-13 19:45:08,538 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 19:45:08,552 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b1c63aa26b422765ba421e HTTP/1.1" 200 None 2026-03-13 19:45:08,552 - lava_callback - DEBUG - Processing node 69b1c63aa26b422765ba421e: baseline-arm64-baylibre 2026-03-13 19:45:08,553 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b1c63aa26b422765ba421e 2026-03-13 19:45:08,553 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 19:45:08,567 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b1c63aa26b422765ba421e HTTP/1.1" 200 None 2026-03-13 19:45:08,569 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 19:45:08,585 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aeba41feb96b28aa34a78b HTTP/1.1" 200 None 2026-03-13 19:45:08,586 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 19:45:08,607 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b1c63aa26b422765ba421e HTTP/1.1" 200 None 2026-03-13 19:45:08,613 - lava_callback - ERROR - Error processing callback for node 69b1c63aa26b422765ba421e: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:48636 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:48648 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60702 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60714 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57974 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41366 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43958 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47920 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52012 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:52024 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43468 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43482 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43484 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53800 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59608 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53856 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47450 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36896 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:36904 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55572 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55574 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51732 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44318 - "GET / HTTP/1.0" 200 OK 2026-03-13 19:47:53,056 - lava_callback - INFO - Received callback for node 69b1c6dfa26b422765ba4408 INFO: 172.21.0.1:39858 - "POST /node/69b1c6dfa26b422765ba4408 HTTP/1.0" 202 Accepted 2026-03-13 19:47:53,061 - lava_callback - INFO - Starting async job submit for node 69b1c6dfa26b422765ba4408 2026-03-13 19:47:53,062 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 19:47:53,081 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b1c6dfa26b422765ba4408 HTTP/1.1" 200 None 2026-03-13 19:47:53,081 - lava_callback - DEBUG - Processing node 69b1c6dfa26b422765ba4408: baseline-arm64-clabbe 2026-03-13 19:47:53,082 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b1c6dfa26b422765ba4408 2026-03-13 19:47:53,082 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 19:47:53,096 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b1c6dfa26b422765ba4408 HTTP/1.1" 200 None 2026-03-13 19:47:53,097 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 19:47:53,111 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aeba41feb96b28aa34a78b HTTP/1.1" 200 None 2026-03-13 19:47:53,112 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 19:47:53,135 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b1c6dfa26b422765ba4408 HTTP/1.1" 200 None 2026-03-13 19:47:53,136 - lava_callback - ERROR - Error processing callback for node 69b1c6dfa26b422765ba4408: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:39874 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45386 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55070 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:55078 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44450 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44462 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48320 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43686 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57026 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51102 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60402 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:60404 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39276 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39288 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58064 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39528 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44612 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57366 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44372 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:44378 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38570 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38582 - "GET / HTTP/1.0" 200 OK 2026-03-13 19:50:33,183 - lava_callback - INFO - Received callback for node 69b1c780a26b422765ba4421 INFO: 172.21.0.1:44660 - "POST /node/69b1c780a26b422765ba4421 HTTP/1.0" 202 Accepted 2026-03-13 19:50:33,188 - lava_callback - INFO - Starting async job submit for node 69b1c780a26b422765ba4421 2026-03-13 19:50:33,189 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 19:50:33,211 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b1c780a26b422765ba4421 HTTP/1.1" 200 None 2026-03-13 19:50:33,211 - lava_callback - DEBUG - Processing node 69b1c780a26b422765ba4421: baseline-arm64-clabbe 2026-03-13 19:50:33,212 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b1c780a26b422765ba4421 2026-03-13 19:50:33,212 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 19:50:33,233 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b1c780a26b422765ba4421 HTTP/1.1" 200 None 2026-03-13 19:50:33,234 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 19:50:33,248 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aeba41feb96b28aa34a78b HTTP/1.1" 200 None 2026-03-13 19:50:33,250 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 19:50:33,283 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b1c780a26b422765ba4421 HTTP/1.1" 200 None 2026-03-13 19:50:33,284 - lava_callback - ERROR - Error processing callback for node 69b1c780a26b422765ba4421: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:44664 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46072 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34638 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60384 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58790 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:58802 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56396 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56398 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53534 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46010 - "GET / HTTP/1.0" 200 OK 2026-03-13 19:51:53,192 - lava_callback - INFO - Received callback for node 69b1c7d0a26b422765ba4438 INFO: 172.21.0.1:43452 - "POST /node/69b1c7d0a26b422765ba4438 HTTP/1.0" 202 Accepted 2026-03-13 19:51:53,198 - lava_callback - INFO - Starting async job submit for node 69b1c7d0a26b422765ba4438 2026-03-13 19:51:53,199 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 19:51:53,214 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b1c7d0a26b422765ba4438 HTTP/1.1" 200 None 2026-03-13 19:51:53,215 - lava_callback - DEBUG - Processing node 69b1c7d0a26b422765ba4438: baseline-arm64-clabbe 2026-03-13 19:51:53,215 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b1c7d0a26b422765ba4438 2026-03-13 19:51:53,216 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 19:51:53,229 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b1c7d0a26b422765ba4438 HTTP/1.1" 200 None 2026-03-13 19:51:53,231 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 19:51:53,247 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aeba41feb96b28aa34a78b HTTP/1.1" 200 None 2026-03-13 19:51:53,248 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 19:51:53,270 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b1c7d0a26b422765ba4438 HTTP/1.1" 200 None 2026-03-13 19:51:53,272 - lava_callback - ERROR - Error processing callback for node 69b1c7d0a26b422765ba4438: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:43462 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48126 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57758 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:57774 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60014 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60018 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42798 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33334 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42354 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41046 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43826 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:43840 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53200 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53212 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56616 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52904 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48316 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46710 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:32844 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:32860 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33340 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33350 - "GET / HTTP/1.0" 200 OK 2026-03-13 19:54:33,279 - lava_callback - INFO - Received callback for node 69b1c872a26b422765ba444f INFO: 172.21.0.1:46688 - "POST /node/69b1c872a26b422765ba444f HTTP/1.0" 202 Accepted 2026-03-13 19:54:33,284 - lava_callback - INFO - Starting async job submit for node 69b1c872a26b422765ba444f 2026-03-13 19:54:33,285 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 19:54:33,300 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b1c872a26b422765ba444f HTTP/1.1" 200 None 2026-03-13 19:54:33,301 - lava_callback - DEBUG - Processing node 69b1c872a26b422765ba444f: baseline-arm64-clabbe 2026-03-13 19:54:33,301 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b1c872a26b422765ba444f 2026-03-13 19:54:33,302 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 19:54:33,316 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b1c872a26b422765ba444f HTTP/1.1" 200 None 2026-03-13 19:54:33,318 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 19:54:33,331 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aeba41feb96b28aa34a78b HTTP/1.1" 200 None 2026-03-13 19:54:33,332 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 19:54:33,363 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b1c872a26b422765ba444f HTTP/1.1" 200 None 2026-03-13 19:54:33,365 - lava_callback - ERROR - Error processing callback for node 69b1c872a26b422765ba444f: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:46692 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37316 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48802 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36634 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42078 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:42088 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52388 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52398 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44716 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51194 - "GET / HTTP/1.0" 200 OK 2026-03-13 19:55:53,540 - lava_callback - INFO - Received callback for node 69b1c8c4a26b422765ba445d INFO: 172.21.0.1:39946 - "POST /node/69b1c8c4a26b422765ba445d HTTP/1.0" 202 Accepted 2026-03-13 19:55:53,545 - lava_callback - INFO - Starting async job submit for node 69b1c8c4a26b422765ba445d 2026-03-13 19:55:53,546 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 19:55:53,563 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b1c8c4a26b422765ba445d HTTP/1.1" 200 None 2026-03-13 19:55:53,564 - lava_callback - DEBUG - Processing node 69b1c8c4a26b422765ba445d: baseline-arm64-clabbe 2026-03-13 19:55:53,564 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b1c8c4a26b422765ba445d 2026-03-13 19:55:53,565 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 19:55:53,584 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b1c8c4a26b422765ba445d HTTP/1.1" 200 None 2026-03-13 19:55:53,585 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 19:55:53,598 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aeba41feb96b28aa34a78b HTTP/1.1" 200 None 2026-03-13 19:55:53,599 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 19:55:53,620 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b1c8c4a26b422765ba445d HTTP/1.1" 200 None 2026-03-13 19:55:53,627 - lava_callback - ERROR - Error processing callback for node 69b1c8c4a26b422765ba445d: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:39950 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34472 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52070 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:52078 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34846 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34858 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46094 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43886 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46046 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46548 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39438 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:39450 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57306 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57318 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55136 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46176 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35332 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55632 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55978 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:55988 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54430 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54440 - "GET / HTTP/1.0" 200 OK 2026-03-13 19:58:33,521 - lava_callback - INFO - Received callback for node 69b1c965a26b422765ba4472 INFO: 172.21.0.1:40820 - "POST /node/69b1c965a26b422765ba4472 HTTP/1.0" 202 Accepted 2026-03-13 19:58:33,527 - lava_callback - INFO - Starting async job submit for node 69b1c965a26b422765ba4472 2026-03-13 19:58:33,527 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 19:58:33,547 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b1c965a26b422765ba4472 HTTP/1.1" 200 None 2026-03-13 19:58:33,548 - lava_callback - DEBUG - Processing node 69b1c965a26b422765ba4472: baseline-arm64-clabbe 2026-03-13 19:58:33,548 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b1c965a26b422765ba4472 2026-03-13 19:58:33,549 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 19:58:33,562 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b1c965a26b422765ba4472 HTTP/1.1" 200 None 2026-03-13 19:58:33,563 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 19:58:33,576 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aeba41feb96b28aa34a78b HTTP/1.1" 200 None 2026-03-13 19:58:33,578 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 19:58:33,600 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b1c965a26b422765ba4472 HTTP/1.1" 200 None 2026-03-13 19:58:33,601 - lava_callback - ERROR - Error processing callback for node 69b1c965a26b422765ba4472: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:40836 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38894 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33734 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53212 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54004 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:54012 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45212 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45226 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54894 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33228 - "GET / HTTP/1.0" 200 OK 2026-03-13 19:59:53,557 - lava_callback - INFO - Received callback for node 69b1c9b5a26b422765ba4489 INFO: 172.21.0.1:37712 - "POST /node/69b1c9b5a26b422765ba4489 HTTP/1.0" 202 Accepted 2026-03-13 19:59:53,562 - lava_callback - INFO - Starting async job submit for node 69b1c9b5a26b422765ba4489 2026-03-13 19:59:53,563 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 19:59:53,601 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b1c9b5a26b422765ba4489 HTTP/1.1" 200 None 2026-03-13 19:59:53,602 - lava_callback - DEBUG - Processing node 69b1c9b5a26b422765ba4489: baseline-arm64-clabbe 2026-03-13 19:59:53,603 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b1c9b5a26b422765ba4489 2026-03-13 19:59:53,603 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 19:59:53,617 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b1c9b5a26b422765ba4489 HTTP/1.1" 200 None 2026-03-13 19:59:53,619 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 19:59:53,634 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b0b5149d19175818251feb HTTP/1.1" 200 None 2026-03-13 19:59:53,636 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 19:59:53,658 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b1c9b5a26b422765ba4489 HTTP/1.1" 200 None 2026-03-13 19:59:53,663 - lava_callback - ERROR - Error processing callback for node 69b1c9b5a26b422765ba4489: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:37726 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60902 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53260 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:53274 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50034 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50046 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44286 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55588 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38286 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48346 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58026 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:58030 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50728 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50732 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54280 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48576 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44528 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58376 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54450 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:54456 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52134 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52138 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56346 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56558 - "GET / HTTP/1.0" 200 OK 2026-03-13 20:02:53,644 - lava_callback - INFO - Received callback for node 69b1ca57a26b422765ba44ab INFO: 172.21.0.1:49892 - "POST /node/69b1ca57a26b422765ba44ab HTTP/1.0" 202 Accepted 2026-03-13 20:02:53,650 - lava_callback - INFO - Starting async job submit for node 69b1ca57a26b422765ba44ab 2026-03-13 20:02:53,651 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 20:02:53,665 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b1ca57a26b422765ba44ab HTTP/1.1" 200 None 2026-03-13 20:02:53,666 - lava_callback - DEBUG - Processing node 69b1ca57a26b422765ba44ab: baseline-arm64-clabbe 2026-03-13 20:02:53,666 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b1ca57a26b422765ba44ab 2026-03-13 20:02:53,667 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 20:02:53,680 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b1ca57a26b422765ba44ab HTTP/1.1" 200 None 2026-03-13 20:02:53,682 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 20:02:53,706 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b0b5149d19175818251feb HTTP/1.1" 200 None 2026-03-13 20:02:53,707 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 20:02:53,736 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b1ca57a26b422765ba44ab HTTP/1.1" 200 None 2026-03-13 20:02:53,745 - lava_callback - ERROR - Error processing callback for node 69b1ca57a26b422765ba44ab: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:49898 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39764 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49660 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:49666 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46038 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46044 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57764 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52550 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35056 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34138 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45338 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:45350 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45666 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45670 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40908 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55746 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44864 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52150 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58284 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:58288 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54538 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54548 - "GET / HTTP/1.0" 200 OK 2026-03-13 20:05:33,823 - lava_callback - INFO - Received callback for node 69b1caf8a26b422765ba44c7 INFO: 172.21.0.1:41526 - "POST /node/69b1caf8a26b422765ba44c7 HTTP/1.0" 202 Accepted 2026-03-13 20:05:33,828 - lava_callback - INFO - Starting async job submit for node 69b1caf8a26b422765ba44c7 2026-03-13 20:05:33,829 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 20:05:33,855 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b1caf8a26b422765ba44c7 HTTP/1.1" 200 None 2026-03-13 20:05:33,856 - lava_callback - DEBUG - Processing node 69b1caf8a26b422765ba44c7: baseline-arm64-clabbe 2026-03-13 20:05:33,856 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b1caf8a26b422765ba44c7 2026-03-13 20:05:33,857 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 20:05:33,870 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b1caf8a26b422765ba44c7 HTTP/1.1" 200 None 2026-03-13 20:05:33,871 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 20:05:33,887 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b0b5149d19175818251feb HTTP/1.1" 200 None 2026-03-13 20:05:33,888 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 20:05:33,909 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b1caf8a26b422765ba44c7 HTTP/1.1" 200 None 2026-03-13 20:05:33,910 - lava_callback - ERROR - Error processing callback for node 69b1caf8a26b422765ba44c7: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:41532 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33786 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52372 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52174 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55786 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:55788 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53106 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53112 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57722 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58968 - "GET / HTTP/1.0" 200 OK 2026-03-13 20:06:53,865 - lava_callback - INFO - Received callback for node 69b1cb4ba26b422765ba44ce INFO: 172.21.0.1:50308 - "POST /node/69b1cb4ba26b422765ba44ce HTTP/1.0" 202 Accepted 2026-03-13 20:06:53,870 - lava_callback - INFO - Starting async job submit for node 69b1cb4ba26b422765ba44ce 2026-03-13 20:06:53,871 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 20:06:53,889 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b1cb4ba26b422765ba44ce HTTP/1.1" 200 None 2026-03-13 20:06:53,890 - lava_callback - DEBUG - Processing node 69b1cb4ba26b422765ba44ce: baseline-arm64-clabbe 2026-03-13 20:06:53,890 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b1cb4ba26b422765ba44ce 2026-03-13 20:06:53,891 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 20:06:53,905 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b1cb4ba26b422765ba44ce HTTP/1.1" 200 None 2026-03-13 20:06:53,906 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 20:06:53,921 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b0b5149d19175818251feb HTTP/1.1" 200 None 2026-03-13 20:06:53,922 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 20:06:53,947 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b1cb4ba26b422765ba44ce HTTP/1.1" 200 None 2026-03-13 20:06:53,954 - lava_callback - ERROR - Error processing callback for node 69b1cb4ba26b422765ba44ce: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:50310 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48300 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34424 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:34440 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33656 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33666 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43630 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54150 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46230 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33802 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60186 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:60202 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54794 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54798 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44286 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49618 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35476 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58856 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35068 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:35074 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48700 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48712 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:32998 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35374 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57424 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42784 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40120 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:40134 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51912 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51916 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47120 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60238 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52610 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60362 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50958 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:50960 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57214 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57230 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47218 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46784 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47542 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46930 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35220 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:35222 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55574 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55584 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45176 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44374 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33746 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48184 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57890 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:57894 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42558 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42574 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36252 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51878 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56082 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54498 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36292 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:36300 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59288 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59296 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42948 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51296 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37164 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55072 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56128 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:56130 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46784 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46788 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59620 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55026 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41698 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39422 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50630 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:50644 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53254 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53264 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40256 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55894 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52234 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53816 - "GET / HTTP/1.0" 200 OK 2026-03-13 20:17:10,310 - lava_callback - INFO - Received callback for node 69b1cdb8a26b422765ba4530 INFO: 172.21.0.1:47566 - "POST /node/69b1cdb8a26b422765ba4530 HTTP/1.0" 202 Accepted 2026-03-13 20:17:10,315 - lava_callback - INFO - Starting async job submit for node 69b1cdb8a26b422765ba4530 2026-03-13 20:17:10,317 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 20:17:10,332 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b1cdb8a26b422765ba4530 HTTP/1.1" 200 None 2026-03-13 20:17:10,333 - lava_callback - DEBUG - Processing node 69b1cdb8a26b422765ba4530: baseline-arm-baylibre 2026-03-13 20:17:10,333 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b1cdb8a26b422765ba4530 2026-03-13 20:17:10,334 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 20:17:10,349 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b1cdb8a26b422765ba4530 HTTP/1.1" 200 None 2026-03-13 20:17:10,350 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 20:17:10,373 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aeba33feb96b28aa34a775 HTTP/1.1" 200 None 2026-03-13 20:17:10,374 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 20:17:10,394 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b1cdb8a26b422765ba4530 HTTP/1.1" 200 None 2026-03-13 20:17:10,404 - lava_callback - ERROR - Error processing callback for node 69b1cdb8a26b422765ba4530: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:47574 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:47588 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38198 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38200 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54936 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43302 - "GET / HTTP/1.0" 200 OK 2026-03-13 20:17:50,221 - lava_callback - INFO - Received callback for node 69b1cde2a26b422765ba453b INFO: 172.21.0.1:40028 - "POST /node/69b1cde2a26b422765ba453b HTTP/1.0" 202 Accepted 2026-03-13 20:17:50,227 - lava_callback - INFO - Starting async job submit for node 69b1cde2a26b422765ba453b 2026-03-13 20:17:50,227 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 20:17:50,247 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b1cde2a26b422765ba453b HTTP/1.1" 200 None 2026-03-13 20:17:50,248 - lava_callback - DEBUG - Processing node 69b1cde2a26b422765ba453b: baseline-arm-baylibre 2026-03-13 20:17:50,248 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b1cde2a26b422765ba453b 2026-03-13 20:17:50,249 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 20:17:50,265 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b1cde2a26b422765ba453b HTTP/1.1" 200 None 2026-03-13 20:17:50,267 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 20:17:50,280 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aeba33feb96b28aa34a775 HTTP/1.1" 200 None 2026-03-13 20:17:50,282 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 20:17:50,304 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b1cde2a26b422765ba453b HTTP/1.1" 200 None 2026-03-13 20:17:50,309 - lava_callback - ERROR - Error processing callback for node 69b1cde2a26b422765ba453b: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:40030 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34148 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58884 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:58900 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41060 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41068 - "GET / HTTP/1.0" 200 OK 2026-03-13 20:18:30,279 - lava_callback - INFO - Received callback for node 69b1ce0ca26b422765ba4544 INFO: 172.21.0.1:46296 - "POST /node/69b1ce0ca26b422765ba4544 HTTP/1.0" 202 Accepted 2026-03-13 20:18:30,285 - lava_callback - INFO - Starting async job submit for node 69b1ce0ca26b422765ba4544 2026-03-13 20:18:30,286 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 20:18:30,303 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b1ce0ca26b422765ba4544 HTTP/1.1" 200 None 2026-03-13 20:18:30,304 - lava_callback - DEBUG - Processing node 69b1ce0ca26b422765ba4544: baseline-arm-baylibre 2026-03-13 20:18:30,304 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b1ce0ca26b422765ba4544 2026-03-13 20:18:30,304 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 20:18:30,318 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b1ce0ca26b422765ba4544 HTTP/1.1" 200 None 2026-03-13 20:18:30,319 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 20:18:30,335 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aeba33feb96b28aa34a775 HTTP/1.1" 200 None 2026-03-13 20:18:30,337 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 20:18:30,357 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b1ce0ca26b422765ba4544 HTTP/1.1" 200 None 2026-03-13 20:18:30,363 - lava_callback - ERROR - Error processing callback for node 69b1ce0ca26b422765ba4544: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:46304 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58430 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50104 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41336 - "GET / HTTP/1.0" 200 OK 2026-03-13 20:19:10,245 - lava_callback - INFO - Received callback for node 69b1ce37a26b422765ba454d INFO: 172.21.0.1:37026 - "POST /node/69b1ce37a26b422765ba454d HTTP/1.0" 202 Accepted 2026-03-13 20:19:10,251 - lava_callback - INFO - Starting async job submit for node 69b1ce37a26b422765ba454d 2026-03-13 20:19:10,252 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 20:19:10,266 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b1ce37a26b422765ba454d HTTP/1.1" 200 None 2026-03-13 20:19:10,267 - lava_callback - DEBUG - Processing node 69b1ce37a26b422765ba454d: baseline-arm-baylibre 2026-03-13 20:19:10,267 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b1ce37a26b422765ba454d 2026-03-13 20:19:10,268 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 20:19:10,282 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b1ce37a26b422765ba454d HTTP/1.1" 200 None 2026-03-13 20:19:10,284 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 20:19:10,308 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aeba33feb96b28aa34a775 HTTP/1.1" 200 None 2026-03-13 20:19:10,309 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 20:19:10,330 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b1ce37a26b422765ba454d HTTP/1.1" 200 None 2026-03-13 20:19:10,331 - lava_callback - ERROR - Error processing callback for node 69b1ce37a26b422765ba454d: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:37040 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:37048 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50770 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50780 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38144 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39686 - "GET / HTTP/1.0" 200 OK 2026-03-13 20:19:50,338 - lava_callback - INFO - Received callback for node 69b1ce60a26b422765ba4558 INFO: 172.21.0.1:57456 - "POST /node/69b1ce60a26b422765ba4558 HTTP/1.0" 202 Accepted 2026-03-13 20:19:50,344 - lava_callback - INFO - Starting async job submit for node 69b1ce60a26b422765ba4558 2026-03-13 20:19:50,345 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 20:19:50,360 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b1ce60a26b422765ba4558 HTTP/1.1" 200 None 2026-03-13 20:19:50,361 - lava_callback - DEBUG - Processing node 69b1ce60a26b422765ba4558: baseline-arm-baylibre 2026-03-13 20:19:50,361 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b1ce60a26b422765ba4558 2026-03-13 20:19:50,362 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 20:19:50,375 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b1ce60a26b422765ba4558 HTTP/1.1" 200 None 2026-03-13 20:19:50,376 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 20:19:50,389 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aeba33feb96b28aa34a775 HTTP/1.1" 200 None 2026-03-13 20:19:50,391 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 20:19:50,421 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b1ce60a26b422765ba4558 HTTP/1.1" 200 None 2026-03-13 20:19:50,427 - lava_callback - ERROR - Error processing callback for node 69b1ce60a26b422765ba4558: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:57466 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60872 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60444 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:60450 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54228 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54236 - "GET / HTTP/1.0" 200 OK 2026-03-13 20:20:34,435 - lava_callback - INFO - Received callback for node 69b1ce8da26b422765ba455f INFO: 172.21.0.1:34702 - "POST /node/69b1ce8da26b422765ba455f HTTP/1.0" 202 Accepted 2026-03-13 20:20:34,440 - lava_callback - INFO - Starting async job submit for node 69b1ce8da26b422765ba455f 2026-03-13 20:20:34,441 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 20:20:34,454 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b1ce8da26b422765ba455f HTTP/1.1" 200 None 2026-03-13 20:20:34,455 - lava_callback - DEBUG - Processing node 69b1ce8da26b422765ba455f: baseline-arm-clabbe 2026-03-13 20:20:34,455 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b1ce8da26b422765ba455f 2026-03-13 20:20:34,456 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 20:20:34,471 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b1ce8da26b422765ba455f HTTP/1.1" 200 None 2026-03-13 20:20:34,473 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 20:20:34,486 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aeba33feb96b28aa34a775 HTTP/1.1" 200 None 2026-03-13 20:20:34,488 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 20:20:34,508 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b1ce8da26b422765ba455f HTTP/1.1" 200 None 2026-03-13 20:20:34,515 - lava_callback - ERROR - Error processing callback for node 69b1ce8da26b422765ba455f: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:34718 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53284 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58814 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56602 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50860 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:50874 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52420 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52428 - "GET / HTTP/1.0" 200 OK 2026-03-13 20:21:34,432 - lava_callback - INFO - Received callback for node 69b1cebaa26b422765ba456c INFO: 172.21.0.1:43828 - "POST /node/69b1cebaa26b422765ba456c HTTP/1.0" 202 Accepted 2026-03-13 20:21:34,437 - lava_callback - INFO - Starting async job submit for node 69b1cebaa26b422765ba456c 2026-03-13 20:21:34,438 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 20:21:34,453 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b1cebaa26b422765ba456c HTTP/1.1" 200 None 2026-03-13 20:21:34,453 - lava_callback - DEBUG - Processing node 69b1cebaa26b422765ba456c: baseline-arm-clabbe 2026-03-13 20:21:34,454 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b1cebaa26b422765ba456c 2026-03-13 20:21:34,454 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 20:21:34,468 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b1cebaa26b422765ba456c HTTP/1.1" 200 None 2026-03-13 20:21:34,469 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 20:21:34,482 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aeba33feb96b28aa34a775 HTTP/1.1" 200 None 2026-03-13 20:21:34,484 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 20:21:34,509 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b1cebaa26b422765ba456c HTTP/1.1" 200 None 2026-03-13 20:21:34,519 - lava_callback - ERROR - Error processing callback for node 69b1cebaa26b422765ba456c: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:43836 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56822 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56648 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36662 - "GET / HTTP/1.0" 200 OK 2026-03-13 20:22:14,434 - lava_callback - INFO - Received callback for node 69b1cee6a26b422765ba4576 INFO: 172.21.0.1:50920 - "POST /node/69b1cee6a26b422765ba4576 HTTP/1.0" 202 Accepted 2026-03-13 20:22:14,439 - lava_callback - INFO - Starting async job submit for node 69b1cee6a26b422765ba4576 2026-03-13 20:22:14,440 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 20:22:14,455 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b1cee6a26b422765ba4576 HTTP/1.1" 200 None 2026-03-13 20:22:14,456 - lava_callback - DEBUG - Processing node 69b1cee6a26b422765ba4576: baseline-arm-clabbe 2026-03-13 20:22:14,456 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b1cee6a26b422765ba4576 2026-03-13 20:22:14,457 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 20:22:14,470 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b1cee6a26b422765ba4576 HTTP/1.1" 200 None 2026-03-13 20:22:14,472 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 20:22:14,485 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aeba33feb96b28aa34a775 HTTP/1.1" 200 None 2026-03-13 20:22:14,486 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 20:22:14,516 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b1cee6a26b422765ba4576 HTTP/1.1" 200 None 2026-03-13 20:22:14,518 - lava_callback - ERROR - Error processing callback for node 69b1cee6a26b422765ba4576: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:50926 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:50938 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50042 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50044 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60790 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35356 - "GET / HTTP/1.0" 200 OK 2026-03-13 20:22:54,509 - lava_callback - INFO - Received callback for node 69b1cf10a26b422765ba4585 INFO: 172.21.0.1:56966 - "POST /node/69b1cf10a26b422765ba4585 HTTP/1.0" 202 Accepted 2026-03-13 20:22:54,515 - lava_callback - INFO - Starting async job submit for node 69b1cf10a26b422765ba4585 2026-03-13 20:22:54,515 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 20:22:54,535 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b1cf10a26b422765ba4585 HTTP/1.1" 200 None 2026-03-13 20:22:54,536 - lava_callback - DEBUG - Processing node 69b1cf10a26b422765ba4585: baseline-arm-clabbe 2026-03-13 20:22:54,536 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b1cf10a26b422765ba4585 2026-03-13 20:22:54,536 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 20:22:54,559 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b1cf10a26b422765ba4585 HTTP/1.1" 200 None 2026-03-13 20:22:54,561 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 20:22:54,573 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aeba33feb96b28aa34a775 HTTP/1.1" 200 None 2026-03-13 20:22:54,575 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 20:22:54,595 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b1cf10a26b422765ba4585 HTTP/1.1" 200 None 2026-03-13 20:22:54,596 - lava_callback - ERROR - Error processing callback for node 69b1cf10a26b422765ba4585: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:56970 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56600 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46842 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:46846 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48394 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48406 - "GET / HTTP/1.0" 200 OK 2026-03-13 20:23:34,501 - lava_callback - INFO - Received callback for node 69b1cf3ba26b422765ba458e INFO: 172.21.0.1:39842 - "POST /node/69b1cf3ba26b422765ba458e HTTP/1.0" 202 Accepted 2026-03-13 20:23:34,506 - lava_callback - INFO - Starting async job submit for node 69b1cf3ba26b422765ba458e 2026-03-13 20:23:34,507 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 20:23:34,520 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b1cf3ba26b422765ba458e HTTP/1.1" 200 None 2026-03-13 20:23:34,521 - lava_callback - DEBUG - Processing node 69b1cf3ba26b422765ba458e: baseline-arm-clabbe 2026-03-13 20:23:34,521 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b1cf3ba26b422765ba458e 2026-03-13 20:23:34,522 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 20:23:34,534 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b1cf3ba26b422765ba458e HTTP/1.1" 200 None 2026-03-13 20:23:34,536 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 20:23:34,549 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aeba33feb96b28aa34a775 HTTP/1.1" 200 None 2026-03-13 20:23:34,550 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 20:23:34,576 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b1cf3ba26b422765ba458e HTTP/1.1" 200 None 2026-03-13 20:23:34,577 - lava_callback - ERROR - Error processing callback for node 69b1cf3ba26b422765ba458e: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:39858 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49944 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37972 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46202 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47078 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:47092 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43558 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43564 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39676 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44296 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47252 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43062 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58004 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:58006 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35792 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35800 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50256 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39596 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46868 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49658 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37158 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:37174 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59754 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59768 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56520 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35664 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41284 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52004 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45434 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:45444 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50418 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50426 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49688 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37670 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46522 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40648 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37430 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:37446 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37510 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37520 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49944 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37924 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33244 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57866 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56936 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:56942 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58688 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58692 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45622 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44638 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47524 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47170 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33054 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:33066 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34870 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34882 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44614 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57358 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45000 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39030 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45384 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:45398 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33640 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33644 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59170 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46124 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43614 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47134 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39478 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:39482 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42570 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42578 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44490 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60118 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51054 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43260 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59778 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:59786 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35412 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35422 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33694 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59794 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36178 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35672 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60116 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:60120 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55088 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55098 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34470 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42962 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53984 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54522 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60246 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:60258 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44364 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44378 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36524 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42204 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40988 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57528 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51704 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:51710 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39648 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39664 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41278 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42876 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53426 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40952 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37608 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:37620 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44440 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44456 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37416 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41930 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40544 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35754 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60316 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:60330 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52624 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52634 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44322 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48748 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51192 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41936 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36088 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:36100 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47612 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47616 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50798 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33454 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33934 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51676 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50948 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:50950 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46914 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46920 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45014 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47788 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58034 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42682 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39632 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:39642 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56870 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56872 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34874 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42534 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36424 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54006 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34560 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:34566 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57166 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57170 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33652 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47092 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44836 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40316 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54624 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:54626 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52664 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52670 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44150 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46860 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47458 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50366 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41022 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:41036 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45868 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45878 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42196 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45098 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51504 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53874 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58426 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:58442 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55106 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55114 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60770 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48442 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43796 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40004 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47270 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:47278 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54628 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54636 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59556 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36676 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53044 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35864 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48832 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:48836 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40146 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40156 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56036 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43050 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52558 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56032 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36024 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:36040 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60002 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60004 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54368 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38020 - "GET / HTTP/1.0" 200 OK 2026-03-13 20:48:55,648 - lava_callback - INFO - Received callback for node 69b1d528a26b422765ba460b INFO: 172.21.0.1:59846 - "POST /node/69b1d528a26b422765ba460b HTTP/1.0" 202 Accepted 2026-03-13 20:48:55,654 - lava_callback - INFO - Starting async job submit for node 69b1d528a26b422765ba460b 2026-03-13 20:48:55,655 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 20:48:55,686 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b1d528a26b422765ba460b HTTP/1.1" 200 None 2026-03-13 20:48:55,687 - lava_callback - DEBUG - Processing node 69b1d528a26b422765ba460b: baseline-arm-clabbe 2026-03-13 20:48:55,687 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b1d528a26b422765ba460b 2026-03-13 20:48:55,688 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 20:48:55,709 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b1d528a26b422765ba460b HTTP/1.1" 200 None 2026-03-13 20:48:55,710 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 20:48:55,725 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b12591a870a1dc3343ba82 HTTP/1.1" 200 None 2026-03-13 20:48:55,727 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 20:48:55,748 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b1d528a26b422765ba460b HTTP/1.1" 200 None 2026-03-13 20:48:55,750 - lava_callback - ERROR - Error processing callback for node 69b1d528a26b422765ba460b: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:59858 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39270 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55724 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:55730 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40178 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40186 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40198 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40212 - "GET /favicon.ico HTTP/1.0" 404 Not Found 2026-03-13 20:49:32,051 - lava_callback - INFO - Received callback for node 69b1d558a26b422765ba4616 INFO: 172.21.0.1:53214 - "POST /node/69b1d558a26b422765ba4616 HTTP/1.0" 202 Accepted 2026-03-13 20:49:32,056 - lava_callback - INFO - Starting async job submit for node 69b1d558a26b422765ba4616 2026-03-13 20:49:32,057 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 20:49:32,071 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b1d558a26b422765ba4616 HTTP/1.1" 200 None 2026-03-13 20:49:32,072 - lava_callback - DEBUG - Processing node 69b1d558a26b422765ba4616: baseline-arm64-baylibre 2026-03-13 20:49:32,072 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b1d558a26b422765ba4616 2026-03-13 20:49:32,073 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 20:49:32,086 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b1d558a26b422765ba4616 HTTP/1.1" 200 None 2026-03-13 20:49:32,087 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 20:49:32,100 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aeba41feb96b28aa34a78b HTTP/1.1" 200 None 2026-03-13 20:49:32,102 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 20:49:32,121 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b1d558a26b422765ba4616 HTTP/1.1" 200 None 2026-03-13 20:49:32,129 - lava_callback - ERROR - Error processing callback for node 69b1d558a26b422765ba4616: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:53230 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53232 - "GET /sitemap.xml HTTP/1.0" 404 Not Found INFO: 172.21.0.1:44484 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41162 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38278 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35112 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:35122 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57656 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57672 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42292 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41196 - "GET / HTTP/1.0" 200 OK 2026-03-13 20:50:55,805 - lava_callback - INFO - Received callback for node 69b1d5a1a26b422765ba462c INFO: 172.21.0.1:53416 - "POST /node/69b1d5a1a26b422765ba462c HTTP/1.0" 202 Accepted 2026-03-13 20:50:55,811 - lava_callback - INFO - Starting async job submit for node 69b1d5a1a26b422765ba462c 2026-03-13 20:50:55,811 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 20:50:55,837 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b1d5a1a26b422765ba462c HTTP/1.1" 200 None 2026-03-13 20:50:55,838 - lava_callback - DEBUG - Processing node 69b1d5a1a26b422765ba462c: baseline-arm-clabbe 2026-03-13 20:50:55,838 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b1d5a1a26b422765ba462c 2026-03-13 20:50:55,838 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 20:50:55,851 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b1d5a1a26b422765ba462c HTTP/1.1" 200 None 2026-03-13 20:50:55,853 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 20:50:55,866 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b12591a870a1dc3343ba82 HTTP/1.1" 200 None 2026-03-13 20:50:55,867 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 20:50:55,887 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b1d5a1a26b422765ba462c HTTP/1.1" 200 None 2026-03-13 20:50:55,889 - lava_callback - ERROR - Error processing callback for node 69b1d5a1a26b422765ba462c: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:53418 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34462 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60428 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:60430 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40968 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40976 - "GET / HTTP/1.0" 200 OK 2026-03-13 20:51:35,741 - lava_callback - INFO - Received callback for node 69b1d5caa26b422765ba4636 INFO: 172.21.0.1:33432 - "POST /node/69b1d5caa26b422765ba4636 HTTP/1.0" 202 Accepted 2026-03-13 20:51:35,747 - lava_callback - INFO - Starting async job submit for node 69b1d5caa26b422765ba4636 2026-03-13 20:51:35,748 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 20:51:35,762 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b1d5caa26b422765ba4636 HTTP/1.1" 200 None 2026-03-13 20:51:35,763 - lava_callback - DEBUG - Processing node 69b1d5caa26b422765ba4636: baseline-arm-clabbe 2026-03-13 20:51:35,763 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b1d5caa26b422765ba4636 2026-03-13 20:51:35,764 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 20:51:35,777 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b1d5caa26b422765ba4636 HTTP/1.1" 200 None 2026-03-13 20:51:35,779 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 20:51:35,792 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b12591a870a1dc3343ba82 HTTP/1.1" 200 None 2026-03-13 20:51:35,794 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 20:51:35,814 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b1d5caa26b422765ba4636 HTTP/1.1" 200 None 2026-03-13 20:51:35,823 - lava_callback - ERROR - Error processing callback for node 69b1d5caa26b422765ba4636: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:33434 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51380 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56578 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54066 - "GET / HTTP/1.0" 200 OK 2026-03-13 20:52:12,183 - lava_callback - INFO - Received callback for node 69b1d5f7a26b422765ba464c INFO: 172.21.0.1:49680 - "POST /node/69b1d5f7a26b422765ba464c HTTP/1.0" 202 Accepted 2026-03-13 20:52:12,189 - lava_callback - INFO - Starting async job submit for node 69b1d5f7a26b422765ba464c 2026-03-13 20:52:12,189 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 20:52:12,205 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b1d5f7a26b422765ba464c HTTP/1.1" 200 None 2026-03-13 20:52:12,206 - lava_callback - DEBUG - Processing node 69b1d5f7a26b422765ba464c: baseline-arm64-baylibre 2026-03-13 20:52:12,206 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b1d5f7a26b422765ba464c 2026-03-13 20:52:12,207 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 20:52:12,229 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b1d5f7a26b422765ba464c HTTP/1.1" 200 None 2026-03-13 20:52:12,230 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 20:52:12,243 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aeba41feb96b28aa34a78b HTTP/1.1" 200 None 2026-03-13 20:52:12,245 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 20:52:12,265 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b1d5f7a26b422765ba464c HTTP/1.1" 200 None 2026-03-13 20:52:12,270 - lava_callback - ERROR - Error processing callback for node 69b1d5f7a26b422765ba464c: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:49690 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:49702 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34808 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34814 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51972 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57718 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35202 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51456 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55240 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:55252 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36252 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36266 - "GET / HTTP/1.0" 200 OK 2026-03-13 20:53:35,881 - lava_callback - INFO - Received callback for node 69b1d641a26b422765ba465b INFO: 172.21.0.1:56318 - "POST /node/69b1d641a26b422765ba465b HTTP/1.0" 202 Accepted 2026-03-13 20:53:35,886 - lava_callback - INFO - Starting async job submit for node 69b1d641a26b422765ba465b 2026-03-13 20:53:35,887 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 20:53:35,901 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b1d641a26b422765ba465b HTTP/1.1" 200 None 2026-03-13 20:53:35,902 - lava_callback - DEBUG - Processing node 69b1d641a26b422765ba465b: baseline-arm-clabbe 2026-03-13 20:53:35,903 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b1d641a26b422765ba465b 2026-03-13 20:53:35,903 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 20:53:35,922 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b1d641a26b422765ba465b HTTP/1.1" 200 None 2026-03-13 20:53:35,924 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 20:53:35,937 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b12591a870a1dc3343ba82 HTTP/1.1" 200 None 2026-03-13 20:53:35,938 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 20:53:35,963 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b1d641a26b422765ba465b HTTP/1.1" 200 None 2026-03-13 20:53:35,964 - lava_callback - ERROR - Error processing callback for node 69b1d641a26b422765ba465b: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:56330 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:32840 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:32876 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60218 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56940 - "GET /api/metrics HTTP/1.0" 200 OK 2026-03-13 20:54:15,975 - lava_callback - INFO - Received callback for node 69b1d66ba26b422765ba4666 INFO: 172.21.0.1:56946 - "POST /node/69b1d66ba26b422765ba4666 HTTP/1.0" 202 Accepted 2026-03-13 20:54:15,981 - lava_callback - INFO - Starting async job submit for node 69b1d66ba26b422765ba4666 2026-03-13 20:54:15,982 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 20:54:15,996 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b1d66ba26b422765ba4666 HTTP/1.1" 200 None 2026-03-13 20:54:15,997 - lava_callback - DEBUG - Processing node 69b1d66ba26b422765ba4666: baseline-arm-clabbe 2026-03-13 20:54:15,997 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b1d66ba26b422765ba4666 2026-03-13 20:54:15,997 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 20:54:16,012 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b1d66ba26b422765ba4666 HTTP/1.1" 200 None 2026-03-13 20:54:16,013 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 20:54:16,027 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b12591a870a1dc3343ba82 HTTP/1.1" 200 None 2026-03-13 20:54:16,029 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 20:54:16,049 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b1d66ba26b422765ba4666 HTTP/1.1" 200 None 2026-03-13 20:54:16,057 - lava_callback - ERROR - Error processing callback for node 69b1d66ba26b422765ba4666: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:56956 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57418 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57430 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47884 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46646 - "GET / HTTP/1.0" 200 OK 2026-03-13 20:54:52,302 - lava_callback - INFO - Received callback for node 69b1d69aa26b422765ba4673 INFO: 172.21.0.1:47904 - "POST /node/69b1d69aa26b422765ba4673 HTTP/1.0" 202 Accepted 2026-03-13 20:54:52,308 - lava_callback - INFO - Starting async job submit for node 69b1d69aa26b422765ba4673 2026-03-13 20:54:52,308 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 20:54:52,325 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b1d69aa26b422765ba4673 HTTP/1.1" 200 None 2026-03-13 20:54:52,326 - lava_callback - DEBUG - Processing node 69b1d69aa26b422765ba4673: baseline-arm64-baylibre 2026-03-13 20:54:52,326 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b1d69aa26b422765ba4673 2026-03-13 20:54:52,327 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 20:54:52,341 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b1d69aa26b422765ba4673 HTTP/1.1" 200 None 2026-03-13 20:54:52,343 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 20:54:52,356 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aeba41feb96b28aa34a78b HTTP/1.1" 200 None 2026-03-13 20:54:52,357 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 20:54:52,388 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b1d69aa26b422765ba4673 HTTP/1.1" 200 None 2026-03-13 20:54:52,390 - lava_callback - ERROR - Error processing callback for node 69b1d69aa26b422765ba4673: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:47918 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47592 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42608 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:42616 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60860 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60870 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58520 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49276 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39570 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:32884 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34032 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:34048 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44934 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44944 - "GET / HTTP/1.0" 200 OK 2026-03-13 20:56:32,251 - lava_callback - INFO - Received callback for node 69b1d6f0a26b422765ba4688 INFO: 172.21.0.1:46992 - "POST /node/69b1d6f0a26b422765ba4688 HTTP/1.0" 202 Accepted 2026-03-13 20:56:32,256 - lava_callback - INFO - Starting async job submit for node 69b1d6f0a26b422765ba4688 2026-03-13 20:56:32,257 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 20:56:32,277 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b1d6f0a26b422765ba4688 HTTP/1.1" 200 None 2026-03-13 20:56:32,277 - lava_callback - DEBUG - Processing node 69b1d6f0a26b422765ba4688: baseline-arm64-baylibre 2026-03-13 20:56:32,278 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b1d6f0a26b422765ba4688 2026-03-13 20:56:32,278 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 20:56:32,293 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b1d6f0a26b422765ba4688 HTTP/1.1" 200 None 2026-03-13 20:56:32,294 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 20:56:32,308 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aeba41feb96b28aa34a78b HTTP/1.1" 200 None 2026-03-13 20:56:32,309 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 20:56:32,331 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b1d6f0a26b422765ba4688 HTTP/1.1" 200 None 2026-03-13 20:56:32,332 - lava_callback - ERROR - Error processing callback for node 69b1d6f0a26b422765ba4688: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:46996 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51254 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49574 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33922 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38708 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:38716 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56176 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56182 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59134 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35126 - "GET / HTTP/1.0" 200 OK 2026-03-13 20:57:52,371 - lava_callback - INFO - Received callback for node 69b1d744a26b422765ba468e INFO: 172.21.0.1:37944 - "POST /node/69b1d744a26b422765ba468e HTTP/1.0" 202 Accepted 2026-03-13 20:57:52,376 - lava_callback - INFO - Starting async job submit for node 69b1d744a26b422765ba468e 2026-03-13 20:57:52,377 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 20:57:52,400 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b1d744a26b422765ba468e HTTP/1.1" 200 None 2026-03-13 20:57:52,401 - lava_callback - DEBUG - Processing node 69b1d744a26b422765ba468e: baseline-arm64-baylibre 2026-03-13 20:57:52,401 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b1d744a26b422765ba468e 2026-03-13 20:57:52,402 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 20:57:52,424 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b1d744a26b422765ba468e HTTP/1.1" 200 None 2026-03-13 20:57:52,426 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 20:57:52,439 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aeba41feb96b28aa34a78b HTTP/1.1" 200 None 2026-03-13 20:57:52,441 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 20:57:52,490 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b1d744a26b422765ba468e HTTP/1.1" 200 None 2026-03-13 20:57:52,492 - lava_callback - ERROR - Error processing callback for node 69b1d744a26b422765ba468e: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:37960 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55452 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58098 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:58102 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39530 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39536 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60928 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46558 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34976 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51816 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42168 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:42174 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58664 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58674 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60684 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52396 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40396 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46430 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46126 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:46142 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52518 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52524 - "GET / HTTP/1.0" 200 OK 2026-03-13 21:00:32,620 - lava_callback - INFO - Received callback for node 69b1d7eea26b422765ba46a3 INFO: 172.21.0.1:60966 - "POST /node/69b1d7eea26b422765ba46a3 HTTP/1.0" 202 Accepted 2026-03-13 21:00:32,625 - lava_callback - INFO - Starting async job submit for node 69b1d7eea26b422765ba46a3 2026-03-13 21:00:32,626 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 21:00:32,645 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b1d7eea26b422765ba46a3 HTTP/1.1" 200 None 2026-03-13 21:00:32,646 - lava_callback - DEBUG - Processing node 69b1d7eea26b422765ba46a3: baseline-arm64-baylibre 2026-03-13 21:00:32,646 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b1d7eea26b422765ba46a3 2026-03-13 21:00:32,647 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 21:00:32,660 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b1d7eea26b422765ba46a3 HTTP/1.1" 200 None 2026-03-13 21:00:32,662 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 21:00:32,675 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aeba41feb96b28aa34a78b HTTP/1.1" 200 None 2026-03-13 21:00:32,676 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 21:00:32,697 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b1d7eea26b422765ba46a3 HTTP/1.1" 200 None 2026-03-13 21:00:32,698 - lava_callback - ERROR - Error processing callback for node 69b1d7eea26b422765ba46a3: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:60982 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54952 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36020 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34028 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39220 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:39230 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54476 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54478 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47090 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53354 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52432 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60492 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37192 - "GET /api/metrics HTTP/1.0" 200 OK 2026-03-13 21:02:16,254 - lava_callback - INFO - Received callback for node 69b1d845a26b422765ba46b5 INFO: 172.21.0.1:37208 - "POST /node/69b1d845a26b422765ba46b5 HTTP/1.0" 202 Accepted 2026-03-13 21:02:16,260 - lava_callback - INFO - Starting async job submit for node 69b1d845a26b422765ba46b5 2026-03-13 21:02:16,260 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 21:02:16,290 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b1d845a26b422765ba46b5 HTTP/1.1" 200 None 2026-03-13 21:02:16,290 - lava_callback - DEBUG - Processing node 69b1d845a26b422765ba46b5: baseline-arm64-clabbe 2026-03-13 21:02:16,291 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b1d845a26b422765ba46b5 2026-03-13 21:02:16,291 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 21:02:16,304 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b1d845a26b422765ba46b5 HTTP/1.1" 200 None 2026-03-13 21:02:16,306 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 21:02:16,319 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aeba41feb96b28aa34a78b HTTP/1.1" 200 None 2026-03-13 21:02:16,321 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 21:02:16,342 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b1d845a26b422765ba46b5 HTTP/1.1" 200 None 2026-03-13 21:02:16,351 - lava_callback - ERROR - Error processing callback for node 69b1d845a26b422765ba46b5: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:37216 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47726 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47738 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44774 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42154 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47526 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56138 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45840 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:45842 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45846 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43186 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43188 - "GET / HTTP/1.0" 200 OK 2026-03-13 21:03:36,283 - lava_callback - INFO - Received callback for node 69b1d898a26b422765ba46c0 INFO: 172.21.0.1:48214 - "POST /node/69b1d898a26b422765ba46c0 HTTP/1.0" 202 Accepted 2026-03-13 21:03:36,288 - lava_callback - INFO - Starting async job submit for node 69b1d898a26b422765ba46c0 2026-03-13 21:03:36,289 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 21:03:36,304 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b1d898a26b422765ba46c0 HTTP/1.1" 200 None 2026-03-13 21:03:36,305 - lava_callback - DEBUG - Processing node 69b1d898a26b422765ba46c0: baseline-arm64-clabbe 2026-03-13 21:03:36,305 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b1d898a26b422765ba46c0 2026-03-13 21:03:36,305 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 21:03:36,318 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b1d898a26b422765ba46c0 HTTP/1.1" 200 None 2026-03-13 21:03:36,320 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 21:03:36,333 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aeba41feb96b28aa34a78b HTTP/1.1" 200 None 2026-03-13 21:03:36,334 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 21:03:36,355 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b1d898a26b422765ba46c0 HTTP/1.1" 200 None 2026-03-13 21:03:36,356 - lava_callback - ERROR - Error processing callback for node 69b1d898a26b422765ba46c0: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:48226 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57192 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36454 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58562 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50516 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:50522 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55764 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55780 - "GET / HTTP/1.0" 200 OK 2026-03-13 21:04:32,783 - lava_callback - INFO - Received callback for node 69b1d8dba26b422765ba46c9 INFO: 172.21.0.1:43464 - "POST /node/69b1d8dba26b422765ba46c9 HTTP/1.0" 202 Accepted 2026-03-13 21:04:32,788 - lava_callback - INFO - Starting async job submit for node 69b1d8dba26b422765ba46c9 2026-03-13 21:04:32,789 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 21:04:32,802 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b1d8dba26b422765ba46c9 HTTP/1.1" 200 None 2026-03-13 21:04:32,803 - lava_callback - DEBUG - Processing node 69b1d8dba26b422765ba46c9: baseline-arm-baylibre 2026-03-13 21:04:32,804 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b1d8dba26b422765ba46c9 2026-03-13 21:04:32,804 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 21:04:32,817 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b1d8dba26b422765ba46c9 HTTP/1.1" 200 None 2026-03-13 21:04:32,818 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 21:04:32,845 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ae8223c660ead8a389aafd HTTP/1.1" 200 None 2026-03-13 21:04:32,847 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 21:04:32,871 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b1d8dba26b422765ba46c9 HTTP/1.1" 200 None 2026-03-13 21:04:32,878 - lava_callback - ERROR - Error processing callback for node 69b1d8dba26b422765ba46c9: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:43480 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40190 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43764 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50260 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52878 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:52888 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41098 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41102 - "GET / HTTP/1.0" 200 OK 2026-03-13 21:05:36,380 - lava_callback - INFO - Received callback for node 69b1d91ca26b422765ba46d9 INFO: 172.21.0.1:42078 - "POST /node/69b1d91ca26b422765ba46d9 HTTP/1.0" 202 Accepted 2026-03-13 21:05:36,386 - lava_callback - INFO - Starting async job submit for node 69b1d91ca26b422765ba46d9 2026-03-13 21:05:36,387 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 21:05:36,411 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b1d91ca26b422765ba46d9 HTTP/1.1" 200 None 2026-03-13 21:05:36,412 - lava_callback - DEBUG - Processing node 69b1d91ca26b422765ba46d9: baseline-arm64-clabbe 2026-03-13 21:05:36,413 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b1d91ca26b422765ba46d9 2026-03-13 21:05:36,413 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 21:05:36,426 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b1d91ca26b422765ba46d9 HTTP/1.1" 200 None 2026-03-13 21:05:36,427 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 21:05:36,440 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aeba41feb96b28aa34a78b HTTP/1.1" 200 None 2026-03-13 21:05:36,442 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 21:05:36,478 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b1d91ca26b422765ba46d9 HTTP/1.1" 200 None 2026-03-13 21:05:36,480 - lava_callback - ERROR - Error processing callback for node 69b1d91ca26b422765ba46d9: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:42092 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34374 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55402 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51564 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35332 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:35344 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42484 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42496 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52934 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50820 - "GET / HTTP/1.0" 200 OK 2026-03-13 21:06:52,917 - lava_callback - INFO - Received callback for node 69b1d95aa26b422765ba46e2 INFO: 172.21.0.1:52170 - "POST /node/69b1d95aa26b422765ba46e2 HTTP/1.0" 202 Accepted 2026-03-13 21:06:52,922 - lava_callback - INFO - Starting async job submit for node 69b1d95aa26b422765ba46e2 2026-03-13 21:06:52,923 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 21:06:52,940 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b1d95aa26b422765ba46e2 HTTP/1.1" 200 None 2026-03-13 21:06:52,940 - lava_callback - DEBUG - Processing node 69b1d95aa26b422765ba46e2: baseline-arm-baylibre 2026-03-13 21:06:52,941 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b1d95aa26b422765ba46e2 2026-03-13 21:06:52,941 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 21:06:52,955 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b1d95aa26b422765ba46e2 HTTP/1.1" 200 None 2026-03-13 21:06:52,956 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 21:06:52,978 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ae8223c660ead8a389aafd HTTP/1.1" 200 None 2026-03-13 21:06:52,979 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 21:06:53,000 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b1d95aa26b422765ba46e2 HTTP/1.1" 200 None 2026-03-13 21:06:53,001 - lava_callback - ERROR - Error processing callback for node 69b1d95aa26b422765ba46e2: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:52176 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58816 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43504 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:43506 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48948 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48962 - "GET / HTTP/1.0" 200 OK 2026-03-13 21:07:36,490 - lava_callback - INFO - Received callback for node 69b1d994a26b422765ba46ed INFO: 172.21.0.1:37858 - "POST /node/69b1d994a26b422765ba46ed HTTP/1.0" 202 Accepted 2026-03-13 21:07:36,496 - lava_callback - INFO - Starting async job submit for node 69b1d994a26b422765ba46ed 2026-03-13 21:07:36,496 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 21:07:36,511 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b1d994a26b422765ba46ed HTTP/1.1" 200 None 2026-03-13 21:07:36,512 - lava_callback - DEBUG - Processing node 69b1d994a26b422765ba46ed: baseline-arm64-clabbe 2026-03-13 21:07:36,513 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b1d994a26b422765ba46ed INFO: 172.21.0.1:37872 - "GET / HTTP/1.0" 200 OK 2026-03-13 21:07:36,514 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 21:07:36,527 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b1d994a26b422765ba46ed HTTP/1.1" 200 None 2026-03-13 21:07:36,528 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 21:07:36,541 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aeba41feb96b28aa34a78b HTTP/1.1" 200 None 2026-03-13 21:07:36,542 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 21:07:36,562 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b1d994a26b422765ba46ed HTTP/1.1" 200 None 2026-03-13 21:07:36,571 - lava_callback - ERROR - Error processing callback for node 69b1d994a26b422765ba46ed: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:48670 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60220 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53172 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33804 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:33806 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49338 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49346 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35858 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52848 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43912 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47808 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34844 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:34852 - "GET / HTTP/1.0" 200 OK 2026-03-13 21:09:16,568 - lava_callback - INFO - Received callback for node 69b1d9e7a26b422765ba46fa INFO: 172.21.0.1:34858 - "POST /node/69b1d9e7a26b422765ba46fa HTTP/1.0" 202 Accepted 2026-03-13 21:09:16,573 - lava_callback - INFO - Starting async job submit for node 69b1d9e7a26b422765ba46fa 2026-03-13 21:09:16,574 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 21:09:16,587 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b1d9e7a26b422765ba46fa HTTP/1.1" 200 None 2026-03-13 21:09:16,588 - lava_callback - DEBUG - Processing node 69b1d9e7a26b422765ba46fa: baseline-arm64-clabbe 2026-03-13 21:09:16,588 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b1d9e7a26b422765ba46fa 2026-03-13 21:09:16,589 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 21:09:16,602 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b1d9e7a26b422765ba46fa HTTP/1.1" 200 None 2026-03-13 21:09:16,603 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 21:09:16,616 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aeba41feb96b28aa34a78b HTTP/1.1" 200 None 2026-03-13 21:09:16,617 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 21:09:16,638 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b1d9e7a26b422765ba46fa HTTP/1.1" 200 None 2026-03-13 21:09:16,644 - lava_callback - ERROR - Error processing callback for node 69b1d9e7a26b422765ba46fa: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:60704 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60718 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35436 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59546 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56006 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59700 - "GET / HTTP/1.0" 200 OK 2026-03-13 21:10:13,092 - lava_callback - INFO - Received callback for node 69b1da26a26b422765ba4701 INFO: 172.21.0.1:57198 - "POST /node/69b1da26a26b422765ba4701 HTTP/1.0" 202 Accepted 2026-03-13 21:10:13,098 - lava_callback - INFO - Starting async job submit for node 69b1da26a26b422765ba4701 2026-03-13 21:10:13,099 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 21:10:13,131 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b1da26a26b422765ba4701 HTTP/1.1" 200 None 2026-03-13 21:10:13,132 - lava_callback - DEBUG - Processing node 69b1da26a26b422765ba4701: baseline-arm-baylibre 2026-03-13 21:10:13,132 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b1da26a26b422765ba4701 2026-03-13 21:10:13,133 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 21:10:13,146 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b1da26a26b422765ba4701 HTTP/1.1" 200 None 2026-03-13 21:10:13,148 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 21:10:13,161 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ae8223c660ead8a389aafd HTTP/1.1" 200 None 2026-03-13 21:10:13,162 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 21:10:13,187 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b1da26a26b422765ba4701 HTTP/1.1" 200 None 2026-03-13 21:10:13,189 - lava_callback - ERROR - Error processing callback for node 69b1da26a26b422765ba4701: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:57202 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:57218 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39928 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39942 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36146 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39214 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58818 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38816 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55336 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:55348 - "GET / HTTP/1.0" 200 OK 2026-03-13 21:11:16,664 - lava_callback - INFO - Received callback for node 69b1da5ea26b422765ba4712 INFO: 172.21.0.1:55358 - "POST /node/69b1da5ea26b422765ba4712 HTTP/1.0" 202 Accepted 2026-03-13 21:11:16,669 - lava_callback - INFO - Starting async job submit for node 69b1da5ea26b422765ba4712 2026-03-13 21:11:16,670 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 21:11:16,684 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b1da5ea26b422765ba4712 HTTP/1.1" 200 None 2026-03-13 21:11:16,685 - lava_callback - DEBUG - Processing node 69b1da5ea26b422765ba4712: baseline-arm64-clabbe 2026-03-13 21:11:16,686 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b1da5ea26b422765ba4712 2026-03-13 21:11:16,686 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 21:11:16,699 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b1da5ea26b422765ba4712 HTTP/1.1" 200 None 2026-03-13 21:11:16,700 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 21:11:16,720 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aeba41feb96b28aa34a78b HTTP/1.1" 200 None 2026-03-13 21:11:16,722 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 21:11:16,743 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b1da5ea26b422765ba4712 HTTP/1.1" 200 None 2026-03-13 21:11:16,749 - lava_callback - ERROR - Error processing callback for node 69b1da5ea26b422765ba4712: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:58868 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58882 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48998 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43366 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37878 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34862 - "GET / HTTP/1.0" 200 OK 2026-03-13 21:12:13,617 - lava_callback - INFO - Received callback for node 69b1da98a26b422765ba4717 INFO: 172.21.0.1:43050 - "POST /node/69b1da98a26b422765ba4717 HTTP/1.0" 202 Accepted 2026-03-13 21:12:13,623 - lava_callback - INFO - Starting async job submit for node 69b1da98a26b422765ba4717 2026-03-13 21:12:13,624 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 21:12:13,647 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b1da98a26b422765ba4717 HTTP/1.1" 200 None 2026-03-13 21:12:13,648 - lava_callback - DEBUG - Processing node 69b1da98a26b422765ba4717: baseline-arm-baylibre 2026-03-13 21:12:13,648 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b1da98a26b422765ba4717 2026-03-13 21:12:13,648 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 21:12:13,661 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b1da98a26b422765ba4717 HTTP/1.1" 200 None 2026-03-13 21:12:13,663 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 21:12:13,676 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ae8223c660ead8a389aafd HTTP/1.1" 200 None 2026-03-13 21:12:13,677 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 21:12:13,703 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b1da98a26b422765ba4717 HTTP/1.1" 200 None 2026-03-13 21:12:13,704 - lava_callback - ERROR - Error processing callback for node 69b1da98a26b422765ba4717: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:43052 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:43054 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48380 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48390 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46324 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34418 - "GET / HTTP/1.0" 200 OK 2026-03-13 21:12:53,152 - lava_callback - INFO - Received callback for node 69b1dac0a26b422765ba4722 INFO: 172.21.0.1:45260 - "POST /node/69b1dac0a26b422765ba4722 HTTP/1.0" 202 Accepted 2026-03-13 21:12:53,158 - lava_callback - INFO - Starting async job submit for node 69b1dac0a26b422765ba4722 2026-03-13 21:12:53,158 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 21:12:53,173 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b1dac0a26b422765ba4722 HTTP/1.1" 200 None 2026-03-13 21:12:53,174 - lava_callback - DEBUG - Processing node 69b1dac0a26b422765ba4722: baseline-arm-baylibre 2026-03-13 21:12:53,175 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b1dac0a26b422765ba4722 2026-03-13 21:12:53,175 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 21:12:53,188 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b1dac0a26b422765ba4722 HTTP/1.1" 200 None 2026-03-13 21:12:53,190 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 21:12:53,204 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ae8223c660ead8a389aafd HTTP/1.1" 200 None 2026-03-13 21:12:53,206 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 21:12:53,229 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b1dac0a26b422765ba4722 HTTP/1.1" 200 None 2026-03-13 21:12:53,237 - lava_callback - ERROR - Error processing callback for node 69b1dac0a26b422765ba4722: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:45268 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53428 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45690 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:45704 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39872 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39888 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60754 - "GET / HTTP/1.0" 200 OK 2026-03-13 21:13:36,722 - lava_callback - INFO - Received callback for node 69b1daeba26b422765ba4733 INFO: 172.21.0.1:60770 - "POST /node/69b1daeba26b422765ba4733 HTTP/1.0" 202 Accepted 2026-03-13 21:13:36,727 - lava_callback - INFO - Starting async job submit for node 69b1daeba26b422765ba4733 2026-03-13 21:13:36,728 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 21:13:36,771 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b1daeba26b422765ba4733 HTTP/1.1" 200 None 2026-03-13 21:13:36,772 - lava_callback - DEBUG - Processing node 69b1daeba26b422765ba4733: baseline-arm-clabbe 2026-03-13 21:13:36,772 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b1daeba26b422765ba4733 2026-03-13 21:13:36,773 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 21:13:36,793 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b1daeba26b422765ba4733 HTTP/1.1" 200 None 2026-03-13 21:13:36,795 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 21:13:36,808 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ae8223c660ead8a389aafd HTTP/1.1" 200 None 2026-03-13 21:13:36,809 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 21:13:36,835 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b1daeba26b422765ba4733 HTTP/1.1" 200 None 2026-03-13 21:13:36,837 - lava_callback - ERROR - Error processing callback for node 69b1daeba26b422765ba4733: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:40704 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56616 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54910 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35798 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:35812 - "GET / HTTP/1.0" 200 OK 2026-03-13 21:14:16,709 - lava_callback - INFO - Received callback for node 69b1db13a26b422765ba473e INFO: 172.21.0.1:35814 - "POST /node/69b1db13a26b422765ba473e HTTP/1.0" 202 Accepted 2026-03-13 21:14:16,715 - lava_callback - INFO - Starting async job submit for node 69b1db13a26b422765ba473e 2026-03-13 21:14:16,715 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 21:14:16,739 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b1db13a26b422765ba473e HTTP/1.1" 200 None 2026-03-13 21:14:16,739 - lava_callback - DEBUG - Processing node 69b1db13a26b422765ba473e: baseline-arm-clabbe 2026-03-13 21:14:16,740 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b1db13a26b422765ba473e 2026-03-13 21:14:16,740 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 21:14:16,753 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b1db13a26b422765ba473e HTTP/1.1" 200 None 2026-03-13 21:14:16,754 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 21:14:16,767 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ae8223c660ead8a389aafd HTTP/1.1" 200 None 2026-03-13 21:14:16,769 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 21:14:16,789 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b1db13a26b422765ba473e HTTP/1.1" 200 None 2026-03-13 21:14:16,797 - lava_callback - ERROR - Error processing callback for node 69b1db13a26b422765ba473e: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:50836 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50838 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38454 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43816 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38080 - "GET / HTTP/1.0" 200 OK 2026-03-13 21:14:56,800 - lava_callback - INFO - Received callback for node 69b1db42a26b422765ba4756 INFO: 172.21.0.1:38096 - "POST /node/69b1db42a26b422765ba4756 HTTP/1.0" 202 Accepted 2026-03-13 21:14:56,805 - lava_callback - INFO - Starting async job submit for node 69b1db42a26b422765ba4756 2026-03-13 21:14:56,806 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 21:14:56,820 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b1db42a26b422765ba4756 HTTP/1.1" 200 None 2026-03-13 21:14:56,821 - lava_callback - DEBUG - Processing node 69b1db42a26b422765ba4756: baseline-arm-clabbe 2026-03-13 21:14:56,821 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b1db42a26b422765ba4756 2026-03-13 21:14:56,822 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 21:14:56,835 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b1db42a26b422765ba4756 HTTP/1.1" 200 None 2026-03-13 21:14:56,836 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 21:14:56,849 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ae8223c660ead8a389aafd HTTP/1.1" 200 None 2026-03-13 21:14:56,851 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 21:14:56,871 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b1db42a26b422765ba4756 HTTP/1.1" 200 None 2026-03-13 21:14:56,878 - lava_callback - ERROR - Error processing callback for node 69b1db42a26b422765ba4756: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:51004 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55706 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:55714 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37026 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37030 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44286 - "GET / HTTP/1.0" 200 OK 2026-03-13 21:15:36,780 - lava_callback - INFO - Received callback for node 69b1db6ba26b422765ba475d INFO: 172.21.0.1:44302 - "POST /node/69b1db6ba26b422765ba475d HTTP/1.0" 202 Accepted 2026-03-13 21:15:36,786 - lava_callback - INFO - Starting async job submit for node 69b1db6ba26b422765ba475d 2026-03-13 21:15:36,787 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 21:15:36,801 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b1db6ba26b422765ba475d HTTP/1.1" 200 None 2026-03-13 21:15:36,802 - lava_callback - DEBUG - Processing node 69b1db6ba26b422765ba475d: baseline-arm-clabbe 2026-03-13 21:15:36,802 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b1db6ba26b422765ba475d 2026-03-13 21:15:36,802 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 21:15:36,816 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b1db6ba26b422765ba475d HTTP/1.1" 200 None 2026-03-13 21:15:36,817 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 21:15:36,830 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ae8223c660ead8a389aafd HTTP/1.1" 200 None 2026-03-13 21:15:36,832 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 21:15:36,851 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b1db6ba26b422765ba475d HTTP/1.1" 200 None 2026-03-13 21:15:36,858 - lava_callback - ERROR - Error processing callback for node 69b1db6ba26b422765ba475d: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:33132 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57134 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57532 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38144 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:38154 - "GET / HTTP/1.0" 200 OK 2026-03-13 21:16:16,836 - lava_callback - INFO - Received callback for node 69b1db93a26b422765ba476d INFO: 172.21.0.1:38162 - "POST /node/69b1db93a26b422765ba476d HTTP/1.0" 202 Accepted 2026-03-13 21:16:16,841 - lava_callback - INFO - Starting async job submit for node 69b1db93a26b422765ba476d 2026-03-13 21:16:16,842 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 21:16:16,856 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b1db93a26b422765ba476d HTTP/1.1" 200 None 2026-03-13 21:16:16,857 - lava_callback - DEBUG - Processing node 69b1db93a26b422765ba476d: baseline-arm-clabbe 2026-03-13 21:16:16,857 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b1db93a26b422765ba476d 2026-03-13 21:16:16,858 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 21:16:16,871 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b1db93a26b422765ba476d HTTP/1.1" 200 None 2026-03-13 21:16:16,872 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 21:16:16,885 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ae8223c660ead8a389aafd HTTP/1.1" 200 None 2026-03-13 21:16:16,887 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 21:16:16,907 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b1db93a26b422765ba476d HTTP/1.1" 200 None 2026-03-13 21:16:16,908 - lava_callback - ERROR - Error processing callback for node 69b1db93a26b422765ba476d: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:44556 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44572 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37738 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56538 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50182 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53152 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35716 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:35732 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43538 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43554 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56960 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57380 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34782 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:32864 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47538 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:47554 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47276 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47286 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41934 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51750 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60604 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48400 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49584 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:49598 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33686 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33694 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54728 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51826 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49532 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54174 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42432 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:42438 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51812 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51826 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56414 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38114 - "GET / HTTP/1.0" 200 OK 2026-03-13 21:20:53,681 - lava_callback - INFO - Received callback for node 69b1dcb0a26b422765ba479e INFO: 172.21.0.1:42576 - "POST /node/69b1dcb0a26b422765ba479e HTTP/1.0" 202 Accepted 2026-03-13 21:20:53,687 - lava_callback - INFO - Starting async job submit for node 69b1dcb0a26b422765ba479e 2026-03-13 21:20:53,688 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 21:20:53,702 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b1dcb0a26b422765ba479e HTTP/1.1" 200 None 2026-03-13 21:20:53,703 - lava_callback - DEBUG - Processing node 69b1dcb0a26b422765ba479e: baseline-arm64-baylibre 2026-03-13 21:20:53,703 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b1dcb0a26b422765ba479e 2026-03-13 21:20:53,703 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 21:20:53,717 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b1dcb0a26b422765ba479e HTTP/1.1" 200 None 2026-03-13 21:20:53,718 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 21:20:53,754 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ae822fc660ead8a389ab0e HTTP/1.1" 200 None 2026-03-13 21:20:53,756 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 21:20:53,784 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b1dcb0a26b422765ba479e HTTP/1.1" 200 None 2026-03-13 21:20:53,785 - lava_callback - ERROR - Error processing callback for node 69b1dcb0a26b422765ba479e: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:42588 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45126 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52382 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:52390 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48680 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48682 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43104 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47548 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56828 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45836 - "GET / HTTP/1.0" 200 OK 2026-03-13 21:22:13,741 - lava_callback - INFO - Received callback for node 69b1dd02a26b422765ba47a7 INFO: 172.21.0.1:49524 - "POST /node/69b1dd02a26b422765ba47a7 HTTP/1.0" 202 Accepted 2026-03-13 21:22:13,747 - lava_callback - INFO - Starting async job submit for node 69b1dd02a26b422765ba47a7 2026-03-13 21:22:13,747 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 21:22:13,772 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b1dd02a26b422765ba47a7 HTTP/1.1" 200 None 2026-03-13 21:22:13,773 - lava_callback - DEBUG - Processing node 69b1dd02a26b422765ba47a7: baseline-arm64-baylibre 2026-03-13 21:22:13,773 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b1dd02a26b422765ba47a7 2026-03-13 21:22:13,774 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 21:22:13,786 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b1dd02a26b422765ba47a7 HTTP/1.1" 200 None 2026-03-13 21:22:13,788 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 21:22:13,801 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ae822fc660ead8a389ab0e HTTP/1.1" 200 None 2026-03-13 21:22:13,802 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 21:22:13,822 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b1dd02a26b422765ba47a7 HTTP/1.1" 200 None 2026-03-13 21:22:13,823 - lava_callback - ERROR - Error processing callback for node 69b1dd02a26b422765ba47a7: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:49526 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:49540 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56550 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56560 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57254 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47118 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59702 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45198 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57048 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:57060 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44258 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44268 - "GET / HTTP/1.0" 200 OK 2026-03-13 21:23:33,795 - lava_callback - INFO - Received callback for node 69b1dd52a26b422765ba47b4 INFO: 172.21.0.1:55022 - "POST /node/69b1dd52a26b422765ba47b4 HTTP/1.0" 202 Accepted 2026-03-13 21:23:33,801 - lava_callback - INFO - Starting async job submit for node 69b1dd52a26b422765ba47b4 2026-03-13 21:23:33,802 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 21:23:33,817 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b1dd52a26b422765ba47b4 HTTP/1.1" 200 None 2026-03-13 21:23:33,818 - lava_callback - DEBUG - Processing node 69b1dd52a26b422765ba47b4: baseline-arm64-baylibre 2026-03-13 21:23:33,818 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b1dd52a26b422765ba47b4 2026-03-13 21:23:33,819 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 21:23:33,831 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b1dd52a26b422765ba47b4 HTTP/1.1" 200 None 2026-03-13 21:23:33,833 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 21:23:33,850 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ae822fc660ead8a389ab0e HTTP/1.1" 200 None 2026-03-13 21:23:33,851 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 21:23:33,872 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b1dd52a26b422765ba47b4 HTTP/1.1" 200 None 2026-03-13 21:23:33,873 - lava_callback - ERROR - Error processing callback for node 69b1dd52a26b422765ba47b4: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:55028 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41778 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:32814 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33628 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50044 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:50050 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52776 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52790 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45594 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58762 - "GET / HTTP/1.0" 200 OK 2026-03-13 21:24:53,877 - lava_callback - INFO - Received callback for node 69b1dda3a26b422765ba47c2 INFO: 172.21.0.1:48326 - "POST /node/69b1dda3a26b422765ba47c2 HTTP/1.0" 202 Accepted 2026-03-13 21:24:53,883 - lava_callback - INFO - Starting async job submit for node 69b1dda3a26b422765ba47c2 2026-03-13 21:24:53,884 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 21:24:53,901 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b1dda3a26b422765ba47c2 HTTP/1.1" 200 None 2026-03-13 21:24:53,901 - lava_callback - DEBUG - Processing node 69b1dda3a26b422765ba47c2: baseline-arm64-baylibre 2026-03-13 21:24:53,902 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b1dda3a26b422765ba47c2 2026-03-13 21:24:53,902 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 21:24:53,915 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b1dda3a26b422765ba47c2 HTTP/1.1" 200 None 2026-03-13 21:24:53,916 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 21:24:53,930 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ae822fc660ead8a389ab0e HTTP/1.1" 200 None 2026-03-13 21:24:53,931 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 21:24:53,951 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b1dda3a26b422765ba47c2 HTTP/1.1" 200 None 2026-03-13 21:24:53,957 - lava_callback - ERROR - Error processing callback for node 69b1dda3a26b422765ba47c2: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:48328 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52942 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57016 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:57022 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45910 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45920 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55150 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55442 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36780 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51036 - "GET / HTTP/1.0" 200 OK 2026-03-13 21:26:14,436 - lava_callback - INFO - Received callback for node 69b1ddf4a26b422765ba47cb INFO: 172.21.0.1:45800 - "POST /node/69b1ddf4a26b422765ba47cb HTTP/1.0" 202 Accepted 2026-03-13 21:26:14,446 - lava_callback - INFO - Starting async job submit for node 69b1ddf4a26b422765ba47cb 2026-03-13 21:26:14,447 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 21:26:14,462 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b1ddf4a26b422765ba47cb HTTP/1.1" 200 None 2026-03-13 21:26:14,463 - lava_callback - DEBUG - Processing node 69b1ddf4a26b422765ba47cb: baseline-arm64-baylibre 2026-03-13 21:26:14,463 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b1ddf4a26b422765ba47cb 2026-03-13 21:26:14,464 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 21:26:14,510 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b1ddf4a26b422765ba47cb HTTP/1.1" 200 None 2026-03-13 21:26:14,511 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 21:26:14,524 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ae822fc660ead8a389ab0e HTTP/1.1" 200 None 2026-03-13 21:26:14,526 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 21:26:14,545 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b1ddf4a26b422765ba47cb HTTP/1.1" 200 None 2026-03-13 21:26:14,552 - lava_callback - ERROR - Error processing callback for node 69b1ddf4a26b422765ba47cb: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:45804 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:45812 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47510 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47526 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57162 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34102 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44422 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53676 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56330 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:56346 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42532 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42540 - "GET / HTTP/1.0" 200 OK 2026-03-13 21:27:33,957 - lava_callback - INFO - Received callback for node 69b1de43a26b422765ba47d8 INFO: 172.21.0.1:50690 - "POST /node/69b1de43a26b422765ba47d8 HTTP/1.0" 202 Accepted 2026-03-13 21:27:33,962 - lava_callback - INFO - Starting async job submit for node 69b1de43a26b422765ba47d8 2026-03-13 21:27:33,963 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 21:27:33,977 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b1de43a26b422765ba47d8 HTTP/1.1" 200 None 2026-03-13 21:27:33,978 - lava_callback - DEBUG - Processing node 69b1de43a26b422765ba47d8: baseline-arm64-baylibre 2026-03-13 21:27:33,978 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b1de43a26b422765ba47d8 2026-03-13 21:27:33,979 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 21:27:33,991 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b1de43a26b422765ba47d8 HTTP/1.1" 200 None 2026-03-13 21:27:33,993 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 21:27:34,008 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ae822fc660ead8a389ab0e HTTP/1.1" 200 None 2026-03-13 21:27:34,010 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 21:27:34,041 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b1de43a26b422765ba47d8 HTTP/1.1" 200 None 2026-03-13 21:27:34,042 - lava_callback - ERROR - Error processing callback for node 69b1de43a26b422765ba47d8: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:50694 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49880 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49572 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51698 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50630 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:50642 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45916 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45918 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45868 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48416 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38582 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47404 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42406 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:42410 - "GET / HTTP/1.0" 200 OK 2026-03-13 21:29:17,436 - lava_callback - INFO - Received callback for node 69b1de99a26b422765ba47e8 INFO: 172.21.0.1:42416 - "POST /node/69b1de99a26b422765ba47e8 HTTP/1.0" 202 Accepted 2026-03-13 21:29:17,442 - lava_callback - INFO - Starting async job submit for node 69b1de99a26b422765ba47e8 2026-03-13 21:29:17,442 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 21:29:17,457 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b1de99a26b422765ba47e8 HTTP/1.1" 200 None 2026-03-13 21:29:17,458 - lava_callback - DEBUG - Processing node 69b1de99a26b422765ba47e8: baseline-arm64-clabbe 2026-03-13 21:29:17,458 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b1de99a26b422765ba47e8 2026-03-13 21:29:17,459 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 21:29:17,472 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b1de99a26b422765ba47e8 HTTP/1.1" 200 None 2026-03-13 21:29:17,473 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 21:29:17,486 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ae822fc660ead8a389ab0e HTTP/1.1" 200 None 2026-03-13 21:29:17,488 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 21:29:17,508 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b1de99a26b422765ba47e8 HTTP/1.1" 200 None 2026-03-13 21:29:17,517 - lava_callback - ERROR - Error processing callback for node 69b1de99a26b422765ba47e8: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:41118 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41120 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55774 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56948 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50592 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48336 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44164 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:44168 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49482 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49488 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36892 - "GET / HTTP/1.0" 200 OK 2026-03-13 21:30:37,524 - lava_callback - INFO - Received callback for node 69b1deeaa26b422765ba47f5 INFO: 172.21.0.1:36902 - "POST /node/69b1deeaa26b422765ba47f5 HTTP/1.0" 202 Accepted 2026-03-13 21:30:37,530 - lava_callback - INFO - Starting async job submit for node 69b1deeaa26b422765ba47f5 2026-03-13 21:30:37,530 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 21:30:37,545 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b1deeaa26b422765ba47f5 HTTP/1.1" 200 None 2026-03-13 21:30:37,545 - lava_callback - DEBUG - Processing node 69b1deeaa26b422765ba47f5: baseline-arm64-clabbe 2026-03-13 21:30:37,546 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b1deeaa26b422765ba47f5 2026-03-13 21:30:37,546 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 21:30:37,560 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b1deeaa26b422765ba47f5 HTTP/1.1" 200 None 2026-03-13 21:30:37,561 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 21:30:37,574 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ae822fc660ead8a389ab0e HTTP/1.1" 200 None 2026-03-13 21:30:37,576 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 21:30:37,607 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b1deeaa26b422765ba47f5 HTTP/1.1" 200 None 2026-03-13 21:30:37,617 - lava_callback - ERROR - Error processing callback for node 69b1deeaa26b422765ba47f5: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:50572 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57058 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39766 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:32776 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:32784 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56472 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56482 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35480 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39244 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59924 - "GET / HTTP/1.0" 200 OK 2026-03-13 21:31:57,518 - lava_callback - INFO - Received callback for node 69b1df3ba26b422765ba4801 INFO: 172.21.0.1:59926 - "POST /node/69b1df3ba26b422765ba4801 HTTP/1.0" 202 Accepted 2026-03-13 21:31:57,523 - lava_callback - INFO - Starting async job submit for node 69b1df3ba26b422765ba4801 2026-03-13 21:31:57,524 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 21:31:57,538 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b1df3ba26b422765ba4801 HTTP/1.1" 200 None 2026-03-13 21:31:57,539 - lava_callback - DEBUG - Processing node 69b1df3ba26b422765ba4801: baseline-arm64-clabbe 2026-03-13 21:31:57,540 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b1df3ba26b422765ba4801 2026-03-13 21:31:57,540 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 21:31:57,560 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b1df3ba26b422765ba4801 HTTP/1.1" 200 None 2026-03-13 21:31:57,561 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 21:31:57,575 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ae822fc660ead8a389ab0e HTTP/1.1" 200 None 2026-03-13 21:31:57,577 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 21:31:57,596 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b1df3ba26b422765ba4801 HTTP/1.1" 200 None 2026-03-13 21:31:57,603 - lava_callback - ERROR - Error processing callback for node 69b1df3ba26b422765ba4801: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:44064 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57522 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:57530 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49542 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49544 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40392 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37702 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38818 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53614 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35022 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:35032 - "GET / HTTP/1.0" 200 OK 2026-03-13 21:33:17,561 - lava_callback - INFO - Received callback for node 69b1df8ba26b422765ba480e INFO: 172.21.0.1:35036 - "POST /node/69b1df8ba26b422765ba480e HTTP/1.0" 202 Accepted 2026-03-13 21:33:17,566 - lava_callback - INFO - Starting async job submit for node 69b1df8ba26b422765ba480e 2026-03-13 21:33:17,567 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 21:33:17,581 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b1df8ba26b422765ba480e HTTP/1.1" 200 None 2026-03-13 21:33:17,582 - lava_callback - DEBUG - Processing node 69b1df8ba26b422765ba480e: baseline-arm64-clabbe 2026-03-13 21:33:17,582 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b1df8ba26b422765ba480e 2026-03-13 21:33:17,582 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 21:33:17,596 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b1df8ba26b422765ba480e HTTP/1.1" 200 None 2026-03-13 21:33:17,597 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 21:33:17,611 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ae822fc660ead8a389ab0e HTTP/1.1" 200 None 2026-03-13 21:33:17,612 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 21:33:17,637 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b1df8ba26b422765ba480e HTTP/1.1" 200 None 2026-03-13 21:33:17,638 - lava_callback - ERROR - Error processing callback for node 69b1df8ba26b422765ba480e: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:44142 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44156 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58716 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59326 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59186 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37868 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45554 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:45558 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58568 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58576 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60522 - "GET / HTTP/1.0" 200 OK 2026-03-13 21:34:37,632 - lava_callback - INFO - Received callback for node 69b1dfdba26b422765ba481c INFO: 172.21.0.1:60528 - "POST /node/69b1dfdba26b422765ba481c HTTP/1.0" 202 Accepted 2026-03-13 21:34:37,641 - lava_callback - INFO - Starting async job submit for node 69b1dfdba26b422765ba481c 2026-03-13 21:34:37,642 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 21:34:37,665 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b1dfdba26b422765ba481c HTTP/1.1" 200 None 2026-03-13 21:34:37,666 - lava_callback - DEBUG - Processing node 69b1dfdba26b422765ba481c: baseline-arm64-clabbe 2026-03-13 21:34:37,666 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b1dfdba26b422765ba481c 2026-03-13 21:34:37,667 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 21:34:37,680 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b1dfdba26b422765ba481c HTTP/1.1" 200 None 2026-03-13 21:34:37,682 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 21:34:37,695 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ae822fc660ead8a389ab0e HTTP/1.1" 200 None 2026-03-13 21:34:37,696 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 21:34:37,725 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b1dfdba26b422765ba481c HTTP/1.1" 200 None 2026-03-13 21:34:37,727 - lava_callback - ERROR - Error processing callback for node 69b1dfdba26b422765ba481c: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:49830 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54360 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36438 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40190 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:40192 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58272 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58288 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35850 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60320 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43832 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38158 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57260 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:57274 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40124 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40132 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55704 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52890 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52546 - "GET / HTTP/1.0" 200 OK 2026-03-13 21:36:57,731 - lava_callback - INFO - Received callback for node 69b1e069a26b422765ba482c INFO: 172.21.0.1:52560 - "POST /node/69b1e069a26b422765ba482c HTTP/1.0" 202 Accepted 2026-03-13 21:36:57,736 - lava_callback - INFO - Starting async job submit for node 69b1e069a26b422765ba482c 2026-03-13 21:36:57,737 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 21:36:57,756 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b1e069a26b422765ba482c HTTP/1.1" 200 None 2026-03-13 21:36:57,757 - lava_callback - DEBUG - Processing node 69b1e069a26b422765ba482c: baseline-arm64-clabbe 2026-03-13 21:36:57,757 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b1e069a26b422765ba482c 2026-03-13 21:36:57,758 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 21:36:57,777 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b1e069a26b422765ba482c HTTP/1.1" 200 None 2026-03-13 21:36:57,779 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 21:36:57,792 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ae822fc660ead8a389ab0e HTTP/1.1" 200 None 2026-03-13 21:36:57,793 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 21:36:57,818 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b1e069a26b422765ba482c HTTP/1.1" 200 None 2026-03-13 21:36:57,820 - lava_callback - ERROR - Error processing callback for node 69b1e069a26b422765ba482c: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:32992 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44232 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:44238 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37978 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37988 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47252 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48780 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51822 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51662 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53112 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:53116 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39054 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39058 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59728 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58026 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48286 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54934 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55154 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:55162 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40068 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40082 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49620 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55824 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51384 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37068 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44728 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:44740 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36382 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36388 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52454 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34482 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51208 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52354 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53740 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:53752 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46864 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46880 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43276 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43748 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51890 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54640 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39338 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:39352 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46750 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46758 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55514 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39018 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53388 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58264 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40540 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:40542 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60100 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60104 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35044 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48524 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53712 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44350 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49020 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:49022 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49708 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49710 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:32826 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47096 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54888 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50552 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53768 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:53772 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34984 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34998 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37372 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50776 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58960 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39476 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44302 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:44316 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51100 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51116 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33316 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44778 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57312 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41302 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44900 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:44912 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34500 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34502 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43780 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33110 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33032 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40782 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42658 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:42670 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40936 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40948 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52660 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39816 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60676 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55988 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60480 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:60496 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37482 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37494 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56060 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36154 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43902 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39386 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34196 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:34198 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59188 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59192 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48154 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37504 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45872 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50766 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43776 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:43788 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50304 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50310 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39286 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55872 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53488 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52598 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45640 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:45644 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53338 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53350 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35114 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37182 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38930 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37962 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58196 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:58202 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58118 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58122 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51676 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54530 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55056 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42122 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45188 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:45192 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47884 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47888 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54360 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38784 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39280 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34808 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41958 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:41972 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42498 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42506 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37956 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51638 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37516 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36802 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59626 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:59638 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43146 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43150 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60216 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34098 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34242 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50176 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36312 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:36328 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42418 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42422 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47466 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38488 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49688 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48982 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44238 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:44244 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41254 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41260 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41414 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50798 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34304 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43906 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52688 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:52702 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55858 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55866 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54312 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34852 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52240 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40346 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47080 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:47088 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55538 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55546 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53616 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57138 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44172 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35658 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53742 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:53746 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33820 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33836 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42720 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36852 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39614 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36186 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56342 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:56358 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36638 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36652 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54382 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40040 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34934 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50412 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51842 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:51852 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58878 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58888 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59178 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44382 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35218 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48770 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46688 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:46694 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52084 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52086 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54130 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52198 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49764 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44642 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49718 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:49734 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40698 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40714 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54012 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43120 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33360 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33506 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41492 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:41496 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46212 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46214 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56252 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37872 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53540 - "GET / HTTP/1.0" 200 OK 2026-03-13 22:06:56,670 - lava_callback - INFO - Received callback for node 69b1e77ea26b422765ba48a5 INFO: 172.21.0.1:53544 - "POST /node/69b1e77ea26b422765ba48a5 HTTP/1.0" 202 Accepted 2026-03-13 22:06:56,675 - lava_callback - INFO - Starting async job submit for node 69b1e77ea26b422765ba48a5 2026-03-13 22:06:56,676 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 22:06:56,693 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b1e77ea26b422765ba48a5 HTTP/1.1" 200 None 2026-03-13 22:06:56,694 - lava_callback - DEBUG - Processing node 69b1e77ea26b422765ba48a5: baseline-arm64-baylibre 2026-03-13 22:06:56,695 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b1e77ea26b422765ba48a5 2026-03-13 22:06:56,696 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 22:06:56,714 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b1e77ea26b422765ba48a5 HTTP/1.1" 200 None 2026-03-13 22:06:56,716 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 22:06:56,729 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b125a3a870a1dc3343ba94 HTTP/1.1" 200 None 2026-03-13 22:06:56,731 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 22:06:56,751 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b1e77ea26b422765ba48a5 HTTP/1.1" 200 None 2026-03-13 22:06:56,757 - lava_callback - ERROR - Error processing callback for node 69b1e77ea26b422765ba48a5: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:52036 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48334 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:48338 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60686 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60690 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56532 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55968 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56298 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51060 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52766 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:52770 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59334 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59336 - "GET / HTTP/1.0" 200 OK 2026-03-13 22:08:36,203 - lava_callback - INFO - Received callback for node 69b1e7cfa26b422765ba48b4 INFO: 172.21.0.1:39786 - "POST /node/69b1e7cfa26b422765ba48b4 HTTP/1.0" 202 Accepted 2026-03-13 22:08:36,209 - lava_callback - INFO - Starting async job submit for node 69b1e7cfa26b422765ba48b4 2026-03-13 22:08:36,209 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 22:08:36,265 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b1e7cfa26b422765ba48b4 HTTP/1.1" 200 None 2026-03-13 22:08:36,266 - lava_callback - DEBUG - Processing node 69b1e7cfa26b422765ba48b4: baseline-arm64-baylibre 2026-03-13 22:08:36,270 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b1e7cfa26b422765ba48b4 2026-03-13 22:08:36,270 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 22:08:36,287 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b1e7cfa26b422765ba48b4 HTTP/1.1" 200 None 2026-03-13 22:08:36,289 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 22:08:36,304 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b125a3a870a1dc3343ba94 HTTP/1.1" 200 None 2026-03-13 22:08:36,305 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 22:08:36,327 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b1e7cfa26b422765ba48b4 HTTP/1.1" 200 None 2026-03-13 22:08:36,328 - lava_callback - ERROR - Error processing callback for node 69b1e7cfa26b422765ba48b4: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:39796 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55062 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58804 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53758 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41880 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:41884 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33756 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33766 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57238 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41416 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33262 - "GET / HTTP/1.0" 200 OK 2026-03-13 22:09:59,099 - lava_callback - INFO - Received callback for node 69b1e827a26b422765ba48c1 INFO: 172.21.0.1:33272 - "POST /node/69b1e827a26b422765ba48c1 HTTP/1.0" 202 Accepted 2026-03-13 22:09:59,105 - lava_callback - INFO - Starting async job submit for node 69b1e827a26b422765ba48c1 2026-03-13 22:09:59,106 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 22:09:59,120 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b1e827a26b422765ba48c1 HTTP/1.1" 200 None 2026-03-13 22:09:59,120 - lava_callback - DEBUG - Processing node 69b1e827a26b422765ba48c1: baseline-arm64-clabbe 2026-03-13 22:09:59,121 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b1e827a26b422765ba48c1 2026-03-13 22:09:59,121 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 22:09:59,134 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b1e827a26b422765ba48c1 HTTP/1.1" 200 None 2026-03-13 22:09:59,136 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 22:09:59,149 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b125a3a870a1dc3343ba94 HTTP/1.1" 200 None 2026-03-13 22:09:59,151 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 22:09:59,171 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b1e827a26b422765ba48c1 HTTP/1.1" 200 None 2026-03-13 22:09:59,172 - lava_callback - ERROR - Error processing callback for node 69b1e827a26b422765ba48c1: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:38426 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36088 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:36104 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38432 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38442 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54270 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34276 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41774 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41262 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40262 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:40264 - "GET / HTTP/1.0" 200 OK 2026-03-13 22:11:19,131 - lava_callback - INFO - Received callback for node 69b1e87aa26b422765ba48cb INFO: 172.21.0.1:40280 - "POST /node/69b1e87aa26b422765ba48cb HTTP/1.0" 202 Accepted 2026-03-13 22:11:19,136 - lava_callback - INFO - Starting async job submit for node 69b1e87aa26b422765ba48cb 2026-03-13 22:11:19,137 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 22:11:19,152 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b1e87aa26b422765ba48cb HTTP/1.1" 200 None 2026-03-13 22:11:19,152 - lava_callback - DEBUG - Processing node 69b1e87aa26b422765ba48cb: baseline-arm64-clabbe 2026-03-13 22:11:19,152 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b1e87aa26b422765ba48cb 2026-03-13 22:11:19,153 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 22:11:19,176 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b1e87aa26b422765ba48cb HTTP/1.1" 200 None 2026-03-13 22:11:19,178 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 22:11:19,196 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b125a3a870a1dc3343ba94 HTTP/1.1" 200 None 2026-03-13 22:11:19,198 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 22:11:19,218 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b1e87aa26b422765ba48cb HTTP/1.1" 200 None 2026-03-13 22:11:19,220 - lava_callback - ERROR - Error processing callback for node 69b1e87aa26b422765ba48cb: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:47670 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47680 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42640 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54072 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41796 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40996 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37042 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:37048 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56728 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56740 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59664 - "GET / HTTP/1.0" 200 OK 2026-03-13 22:12:39,183 - lava_callback - INFO - Received callback for node 69b1e8cca26b422765ba48d9 INFO: 172.21.0.1:59670 - "POST /node/69b1e8cca26b422765ba48d9 HTTP/1.0" 202 Accepted 2026-03-13 22:12:39,190 - lava_callback - INFO - Starting async job submit for node 69b1e8cca26b422765ba48d9 2026-03-13 22:12:39,191 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 22:12:39,206 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b1e8cca26b422765ba48d9 HTTP/1.1" 200 None 2026-03-13 22:12:39,206 - lava_callback - DEBUG - Processing node 69b1e8cca26b422765ba48d9: baseline-arm64-clabbe 2026-03-13 22:12:39,207 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b1e8cca26b422765ba48d9 2026-03-13 22:12:39,207 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 22:12:39,224 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b1e8cca26b422765ba48d9 HTTP/1.1" 200 None 2026-03-13 22:12:39,225 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 22:12:39,241 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b125a3a870a1dc3343ba94 HTTP/1.1" 200 None 2026-03-13 22:12:39,242 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 22:12:39,263 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b1e8cca26b422765ba48d9 HTTP/1.1" 200 None 2026-03-13 22:12:39,268 - lava_callback - ERROR - Error processing callback for node 69b1e8cca26b422765ba48d9: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:43446 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44398 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48824 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44672 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:44678 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33010 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33026 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36150 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35888 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33888 - "GET / HTTP/1.0" 200 OK 2026-03-13 22:13:59,248 - lava_callback - INFO - Received callback for node 69b1e91fa26b422765ba48e7 INFO: 172.21.0.1:33896 - "POST /node/69b1e91fa26b422765ba48e7 HTTP/1.0" 202 Accepted 2026-03-13 22:13:59,253 - lava_callback - INFO - Starting async job submit for node 69b1e91fa26b422765ba48e7 2026-03-13 22:13:59,254 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 22:13:59,269 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b1e91fa26b422765ba48e7 HTTP/1.1" 200 None 2026-03-13 22:13:59,269 - lava_callback - DEBUG - Processing node 69b1e91fa26b422765ba48e7: baseline-arm64-clabbe 2026-03-13 22:13:59,270 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b1e91fa26b422765ba48e7 2026-03-13 22:13:59,270 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 22:13:59,284 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b1e91fa26b422765ba48e7 HTTP/1.1" 200 None 2026-03-13 22:13:59,285 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 22:13:59,298 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b125a3a870a1dc3343ba94 HTTP/1.1" 200 None 2026-03-13 22:13:59,299 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 22:13:59,319 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b1e91fa26b422765ba48e7 HTTP/1.1" 200 None 2026-03-13 22:13:59,324 - lava_callback - ERROR - Error processing callback for node 69b1e91fa26b422765ba48e7: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:38354 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59354 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:59360 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60794 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60808 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36294 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46312 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53338 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40780 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39038 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:39040 - "GET / HTTP/1.0" 200 OK 2026-03-13 22:15:19,347 - lava_callback - INFO - Received callback for node 69b1e972a26b422765ba48f0 INFO: 172.21.0.1:39046 - "POST /node/69b1e972a26b422765ba48f0 HTTP/1.0" 202 Accepted 2026-03-13 22:15:19,352 - lava_callback - INFO - Starting async job submit for node 69b1e972a26b422765ba48f0 2026-03-13 22:15:19,353 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 22:15:19,368 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b1e972a26b422765ba48f0 HTTP/1.1" 200 None 2026-03-13 22:15:19,368 - lava_callback - DEBUG - Processing node 69b1e972a26b422765ba48f0: baseline-arm64-clabbe 2026-03-13 22:15:19,369 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b1e972a26b422765ba48f0 2026-03-13 22:15:19,369 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 22:15:19,383 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b1e972a26b422765ba48f0 HTTP/1.1" 200 None 2026-03-13 22:15:19,384 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 22:15:19,419 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b125a3a870a1dc3343ba94 HTTP/1.1" 200 None 2026-03-13 22:15:19,421 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 22:15:19,441 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b1e972a26b422765ba48f0 HTTP/1.1" 200 None 2026-03-13 22:15:19,452 - lava_callback - ERROR - Error processing callback for node 69b1e972a26b422765ba48f0: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:34992 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35008 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42758 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57622 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35378 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39478 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37542 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:37550 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48360 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48362 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60046 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55974 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48196 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58182 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52404 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:52414 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60914 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60930 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46786 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57322 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55854 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52750 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35694 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:35704 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42120 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42132 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36782 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45044 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39572 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45386 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52258 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:52260 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:32856 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:32872 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34124 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51792 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58758 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49862 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34258 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:34262 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52294 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52306 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57690 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37222 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55172 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42542 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35398 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:35408 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57034 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57048 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57856 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44472 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52578 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37492 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37860 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:37874 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59564 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59566 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57564 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50088 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34690 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48372 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44470 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:44476 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48304 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48312 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48756 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56710 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51014 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51896 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53630 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:53646 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37270 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37278 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58566 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36138 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41982 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56094 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51516 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:51520 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58808 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58818 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39718 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39258 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49350 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45076 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50898 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:50910 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57154 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57168 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56854 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37014 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58428 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49092 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46710 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:46726 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44376 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44390 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35826 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58068 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55118 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55572 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51608 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:51624 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60118 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60130 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57456 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57780 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37722 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60680 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58710 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:58722 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45998 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46010 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36598 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36112 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42118 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53772 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46640 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:46654 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36386 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36402 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38282 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59212 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50176 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58514 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51018 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:51034 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56670 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56682 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45478 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34924 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41922 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40866 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42108 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:42122 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35010 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35012 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46362 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34248 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42044 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54532 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58478 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:58480 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60662 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60672 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45082 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35984 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55444 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46428 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55274 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:55288 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45008 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45018 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48856 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59002 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47596 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58050 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44198 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:44208 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37418 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37420 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60464 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55486 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60270 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56236 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42232 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:42248 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44298 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44314 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55950 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59406 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57292 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38730 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52164 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:52178 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40210 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40212 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46940 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35176 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52330 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54564 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58166 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:58170 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57580 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57596 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39398 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43340 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38030 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36304 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54324 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:54334 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52584 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52590 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34408 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43664 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57706 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50750 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57296 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:57310 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41556 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41572 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38622 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55610 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44460 - "GET / HTTP/1.0" 200 OK 2026-03-13 22:40:58,343 - lava_callback - INFO - Received callback for node 69b1ef78a26b422765ba4940 INFO: 172.21.0.1:44474 - "POST /node/69b1ef78a26b422765ba4940 HTTP/1.0" 202 Accepted 2026-03-13 22:40:58,348 - lava_callback - INFO - Starting async job submit for node 69b1ef78a26b422765ba4940 2026-03-13 22:40:58,349 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 22:40:58,363 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b1ef78a26b422765ba4940 HTTP/1.1" 200 None 2026-03-13 22:40:58,364 - lava_callback - DEBUG - Processing node 69b1ef78a26b422765ba4940: baseline-arm-baylibre 2026-03-13 22:40:58,365 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b1ef78a26b422765ba4940 2026-03-13 22:40:58,365 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 22:40:58,378 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b1ef78a26b422765ba4940 HTTP/1.1" 200 None 2026-03-13 22:40:58,380 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 22:40:58,392 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b195f7a26b422765ba3705 HTTP/1.1" 200 None 2026-03-13 22:40:58,394 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 22:40:58,414 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b1ef78a26b422765ba4940 HTTP/1.1" 200 None 2026-03-13 22:40:58,418 - lava_callback - ERROR - Error processing callback for node 69b1ef78a26b422765ba4940: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:50834 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48840 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:48856 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45588 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45598 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60632 - "GET / HTTP/1.0" 200 OK 2026-03-13 22:41:38,013 - lava_callback - INFO - Received callback for node 69b1ef9ca26b422765ba4950 INFO: 172.21.0.1:60640 - "POST /node/69b1ef9ca26b422765ba4950 HTTP/1.0" 202 Accepted 2026-03-13 22:41:38,019 - lava_callback - INFO - Starting async job submit for node 69b1ef9ca26b422765ba4950 2026-03-13 22:41:38,020 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 22:41:38,037 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b1ef9ca26b422765ba4950 HTTP/1.1" 200 None 2026-03-13 22:41:38,038 - lava_callback - DEBUG - Processing node 69b1ef9ca26b422765ba4950: baseline-arm-baylibre 2026-03-13 22:41:38,038 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b1ef9ca26b422765ba4950 2026-03-13 22:41:38,039 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 22:41:38,052 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b1ef9ca26b422765ba4950 HTTP/1.1" 200 None 2026-03-13 22:41:38,054 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 22:41:38,074 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b195f7a26b422765ba3705 HTTP/1.1" 200 None 2026-03-13 22:41:38,076 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 22:41:38,096 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b1ef9ca26b422765ba4950 HTTP/1.1" 200 None 2026-03-13 22:41:38,097 - lava_callback - ERROR - Error processing callback for node 69b1ef9ca26b422765ba4950: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:59840 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37120 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43384 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54814 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:54820 - "GET / HTTP/1.0" 200 OK 2026-03-13 22:42:18,066 - lava_callback - INFO - Received callback for node 69b1efc0a26b422765ba4959 INFO: 172.21.0.1:54826 - "POST /node/69b1efc0a26b422765ba4959 HTTP/1.0" 202 Accepted 2026-03-13 22:42:18,072 - lava_callback - INFO - Starting async job submit for node 69b1efc0a26b422765ba4959 2026-03-13 22:42:18,073 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 22:42:18,096 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b1efc0a26b422765ba4959 HTTP/1.1" 200 None 2026-03-13 22:42:18,098 - lava_callback - DEBUG - Processing node 69b1efc0a26b422765ba4959: baseline-arm-baylibre 2026-03-13 22:42:18,098 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b1efc0a26b422765ba4959 2026-03-13 22:42:18,099 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 22:42:18,117 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b1efc0a26b422765ba4959 HTTP/1.1" 200 None 2026-03-13 22:42:18,118 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 22:42:18,137 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b195f7a26b422765ba3705 HTTP/1.1" 200 None 2026-03-13 22:42:18,138 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 22:42:18,158 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b1efc0a26b422765ba4959 HTTP/1.1" 200 None 2026-03-13 22:42:18,164 - lava_callback - ERROR - Error processing callback for node 69b1efc0a26b422765ba4959: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:35790 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35806 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57886 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33202 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35718 - "GET / HTTP/1.0" 200 OK 2026-03-13 22:42:58,091 - lava_callback - INFO - Received callback for node 69b1efe3a26b422765ba4964 INFO: 172.21.0.1:35732 - "POST /node/69b1efe3a26b422765ba4964 HTTP/1.0" 202 Accepted 2026-03-13 22:42:58,097 - lava_callback - INFO - Starting async job submit for node 69b1efe3a26b422765ba4964 2026-03-13 22:42:58,097 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 22:42:58,112 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b1efe3a26b422765ba4964 HTTP/1.1" 200 None 2026-03-13 22:42:58,113 - lava_callback - DEBUG - Processing node 69b1efe3a26b422765ba4964: baseline-arm-baylibre 2026-03-13 22:42:58,114 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b1efe3a26b422765ba4964 2026-03-13 22:42:58,114 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 22:42:58,133 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b1efe3a26b422765ba4964 HTTP/1.1" 200 None 2026-03-13 22:42:58,134 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 22:42:58,148 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b195f7a26b422765ba3705 HTTP/1.1" 200 None 2026-03-13 22:42:58,150 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 22:42:58,174 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b1efe3a26b422765ba4964 HTTP/1.1" 200 None 2026-03-13 22:42:58,175 - lava_callback - ERROR - Error processing callback for node 69b1efe3a26b422765ba4964: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:48854 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42322 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:42328 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55364 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55374 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50662 - "GET / HTTP/1.0" 200 OK 2026-03-13 22:43:38,126 - lava_callback - INFO - Received callback for node 69b1f008a26b422765ba496f INFO: 172.21.0.1:50676 - "POST /node/69b1f008a26b422765ba496f HTTP/1.0" 202 Accepted 2026-03-13 22:43:38,132 - lava_callback - INFO - Starting async job submit for node 69b1f008a26b422765ba496f 2026-03-13 22:43:38,132 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 22:43:38,146 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b1f008a26b422765ba496f HTTP/1.1" 200 None 2026-03-13 22:43:38,147 - lava_callback - DEBUG - Processing node 69b1f008a26b422765ba496f: baseline-arm-baylibre 2026-03-13 22:43:38,147 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b1f008a26b422765ba496f 2026-03-13 22:43:38,147 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 22:43:38,166 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b1f008a26b422765ba496f HTTP/1.1" 200 None 2026-03-13 22:43:38,167 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 22:43:38,181 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b195f7a26b422765ba3705 HTTP/1.1" 200 None 2026-03-13 22:43:38,182 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 22:43:38,202 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b1f008a26b422765ba496f HTTP/1.1" 200 None 2026-03-13 22:43:38,204 - lava_callback - ERROR - Error processing callback for node 69b1f008a26b422765ba496f: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:53574 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38602 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52456 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:32914 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:32922 - "GET / HTTP/1.0" 200 OK 2026-03-13 22:44:18,072 - lava_callback - INFO - Received callback for node 69b1f02ca26b422765ba4978 INFO: 172.21.0.1:32938 - "POST /node/69b1f02ca26b422765ba4978 HTTP/1.0" 202 Accepted 2026-03-13 22:44:18,077 - lava_callback - INFO - Starting async job submit for node 69b1f02ca26b422765ba4978 2026-03-13 22:44:18,078 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 22:44:18,092 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b1f02ca26b422765ba4978 HTTP/1.1" 200 None 2026-03-13 22:44:18,093 - lava_callback - DEBUG - Processing node 69b1f02ca26b422765ba4978: baseline-arm-baylibre 2026-03-13 22:44:18,093 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b1f02ca26b422765ba4978 2026-03-13 22:44:18,094 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 22:44:18,111 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b1f02ca26b422765ba4978 HTTP/1.1" 200 None 2026-03-13 22:44:18,113 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 22:44:18,126 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b195f7a26b422765ba3705 HTTP/1.1" 200 None 2026-03-13 22:44:18,127 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 22:44:18,147 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b1f02ca26b422765ba4978 HTTP/1.1" 200 None 2026-03-13 22:44:18,155 - lava_callback - ERROR - Error processing callback for node 69b1f02ca26b422765ba4978: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:46796 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46808 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33902 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45004 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48012 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34920 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59378 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:59394 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50158 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50162 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55450 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45880 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34938 - "GET / HTTP/1.0" 200 OK 2026-03-13 22:46:00,622 - lava_callback - INFO - Received callback for node 69b1f098a26b422765ba4999 INFO: 172.21.0.1:52268 - "POST /node/69b1f098a26b422765ba4999 HTTP/1.0" 202 Accepted 2026-03-13 22:46:00,627 - lava_callback - INFO - Starting async job submit for node 69b1f098a26b422765ba4999 2026-03-13 22:46:00,628 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 22:46:00,642 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b1f098a26b422765ba4999 HTTP/1.1" 200 None 2026-03-13 22:46:00,643 - lava_callback - DEBUG - Processing node 69b1f098a26b422765ba4999: baseline-arm-clabbe 2026-03-13 22:46:00,643 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b1f098a26b422765ba4999 2026-03-13 22:46:00,644 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 22:46:00,657 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b1f098a26b422765ba4999 HTTP/1.1" 200 None 2026-03-13 22:46:00,659 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 22:46:00,672 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b195f7a26b422765ba3705 HTTP/1.1" 200 None 2026-03-13 22:46:00,673 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 22:46:00,709 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b1f098a26b422765ba4999 HTTP/1.1" 200 None 2026-03-13 22:46:00,711 - lava_callback - ERROR - Error processing callback for node 69b1f098a26b422765ba4999: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:52280 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45146 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:45154 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54884 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54900 - "GET /favicon.ico HTTP/1.0" 404 Not Found INFO: 172.21.0.1:54914 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54924 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47368 - "GET / HTTP/1.0" 200 OK 2026-03-13 22:46:40,596 - lava_callback - INFO - Received callback for node 69b1f0bca26b422765ba49a4 INFO: 172.21.0.1:40996 - "POST /node/69b1f0bca26b422765ba49a4 HTTP/1.0" 202 Accepted 2026-03-13 22:46:40,601 - lava_callback - INFO - Starting async job submit for node 69b1f0bca26b422765ba49a4 2026-03-13 22:46:40,602 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 22:46:40,616 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b1f0bca26b422765ba49a4 HTTP/1.1" 200 None 2026-03-13 22:46:40,617 - lava_callback - DEBUG - Processing node 69b1f0bca26b422765ba49a4: baseline-arm-clabbe 2026-03-13 22:46:40,617 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b1f0bca26b422765ba49a4 2026-03-13 22:46:40,618 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 22:46:40,633 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b1f0bca26b422765ba49a4 HTTP/1.1" 200 None 2026-03-13 22:46:40,635 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 22:46:40,654 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b195f7a26b422765ba3705 HTTP/1.1" 200 None 2026-03-13 22:46:40,656 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 22:46:40,684 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b1f0bca26b422765ba49a4 HTTP/1.1" 200 None 2026-03-13 22:46:40,685 - lava_callback - ERROR - Error processing callback for node 69b1f0bca26b422765ba49a4: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:41004 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37236 - "GET / HTTP/1.0" 200 OK 2026-03-13 22:47:00,653 - lava_callback - INFO - Received callback for node 69b1f0e0a26b422765ba49ac INFO: 172.21.0.1:36442 - "POST /node/69b1f0e0a26b422765ba49ac HTTP/1.0" 202 Accepted 2026-03-13 22:47:00,659 - lava_callback - INFO - Starting async job submit for node 69b1f0e0a26b422765ba49ac 2026-03-13 22:47:00,659 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 22:47:00,686 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b1f0e0a26b422765ba49ac HTTP/1.1" 200 None 2026-03-13 22:47:00,687 - lava_callback - DEBUG - Processing node 69b1f0e0a26b422765ba49ac: baseline-arm-clabbe 2026-03-13 22:47:00,687 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b1f0e0a26b422765ba49ac 2026-03-13 22:47:00,688 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 22:47:00,705 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b1f0e0a26b422765ba49ac HTTP/1.1" 200 None 2026-03-13 22:47:00,707 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 22:47:00,725 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b195f7a26b422765ba3705 HTTP/1.1" 200 None 2026-03-13 22:47:00,727 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 22:47:00,748 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b1f0e0a26b422765ba49ac HTTP/1.1" 200 None 2026-03-13 22:47:00,753 - lava_callback - ERROR - Error processing callback for node 69b1f0e0a26b422765ba49ac: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:36446 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38676 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:38686 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47014 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47020 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35368 - "GET / HTTP/1.0" 200 OK 2026-03-13 22:47:40,628 - lava_callback - INFO - Received callback for node 69b1f104a26b422765ba49b7 INFO: 172.21.0.1:58610 - "POST /node/69b1f104a26b422765ba49b7 HTTP/1.0" 202 Accepted 2026-03-13 22:47:40,634 - lava_callback - INFO - Starting async job submit for node 69b1f104a26b422765ba49b7 2026-03-13 22:47:40,634 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 22:47:40,649 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b1f104a26b422765ba49b7 HTTP/1.1" 200 None 2026-03-13 22:47:40,650 - lava_callback - DEBUG - Processing node 69b1f104a26b422765ba49b7: baseline-arm-clabbe 2026-03-13 22:47:40,650 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b1f104a26b422765ba49b7 2026-03-13 22:47:40,651 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 22:47:40,664 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b1f104a26b422765ba49b7 HTTP/1.1" 200 None 2026-03-13 22:47:40,666 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 22:47:40,679 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b195f7a26b422765ba3705 HTTP/1.1" 200 None 2026-03-13 22:47:40,680 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 22:47:40,700 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b1f104a26b422765ba49b7 HTTP/1.1" 200 None 2026-03-13 22:47:40,705 - lava_callback - ERROR - Error processing callback for node 69b1f104a26b422765ba49b7: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:58624 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43322 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38494 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48782 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:48794 - "GET / HTTP/1.0" 200 OK 2026-03-13 22:48:20,722 - lava_callback - INFO - Received callback for node 69b1f129a26b422765ba49c2 INFO: 172.21.0.1:58678 - "POST /node/69b1f129a26b422765ba49c2 HTTP/1.0" 202 Accepted 2026-03-13 22:48:20,727 - lava_callback - INFO - Starting async job submit for node 69b1f129a26b422765ba49c2 2026-03-13 22:48:20,728 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 22:48:20,766 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b1f129a26b422765ba49c2 HTTP/1.1" 200 None 2026-03-13 22:48:20,767 - lava_callback - DEBUG - Processing node 69b1f129a26b422765ba49c2: baseline-arm-clabbe 2026-03-13 22:48:20,767 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b1f129a26b422765ba49c2 2026-03-13 22:48:20,768 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 22:48:20,781 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b1f129a26b422765ba49c2 HTTP/1.1" 200 None 2026-03-13 22:48:20,782 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 22:48:20,805 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b195f7a26b422765ba3705 HTTP/1.1" 200 None 2026-03-13 22:48:20,806 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 22:48:20,826 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b1f129a26b422765ba49c2 HTTP/1.1" 200 None 2026-03-13 22:48:20,833 - lava_callback - ERROR - Error processing callback for node 69b1f129a26b422765ba49c2: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:58686 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58696 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42012 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39812 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40892 - "GET / HTTP/1.0" 200 OK 2026-03-13 22:48:58,716 - lava_callback - INFO - Received callback for node 69b1f149a26b422765ba49cc INFO: 172.21.0.1:40898 - "POST /node/69b1f149a26b422765ba49cc HTTP/1.0" 202 Accepted 2026-03-13 22:48:58,721 - lava_callback - INFO - Starting async job submit for node 69b1f149a26b422765ba49cc 2026-03-13 22:48:58,722 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 22:48:58,736 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b1f149a26b422765ba49cc HTTP/1.1" 200 None 2026-03-13 22:48:58,737 - lava_callback - DEBUG - Processing node 69b1f149a26b422765ba49cc: baseline-arm-baylibre 2026-03-13 22:48:58,737 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b1f149a26b422765ba49cc 2026-03-13 22:48:58,738 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 22:48:58,751 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b1f149a26b422765ba49cc HTTP/1.1" 200 None 2026-03-13 22:48:58,752 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 22:48:58,766 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ac4f6846f7ae8ff3364c2c HTTP/1.1" 200 None 2026-03-13 22:48:58,768 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 22:48:58,789 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b1f149a26b422765ba49cc HTTP/1.1" 200 None 2026-03-13 22:48:58,791 - lava_callback - ERROR - Error processing callback for node 69b1f149a26b422765ba49cc: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:34754 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54302 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:54304 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34888 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34894 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49872 - "GET / HTTP/1.0" 200 OK 2026-03-13 22:49:38,386 - lava_callback - INFO - Received callback for node 69b1f16ea26b422765ba49d9 INFO: 172.21.0.1:49884 - "POST /node/69b1f16ea26b422765ba49d9 HTTP/1.0" 202 Accepted 2026-03-13 22:49:38,391 - lava_callback - INFO - Starting async job submit for node 69b1f16ea26b422765ba49d9 2026-03-13 22:49:38,392 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 22:49:38,407 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b1f16ea26b422765ba49d9 HTTP/1.1" 200 None 2026-03-13 22:49:38,408 - lava_callback - DEBUG - Processing node 69b1f16ea26b422765ba49d9: baseline-arm-baylibre 2026-03-13 22:49:38,408 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b1f16ea26b422765ba49d9 2026-03-13 22:49:38,409 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 22:49:38,428 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b1f16ea26b422765ba49d9 HTTP/1.1" 200 None 2026-03-13 22:49:38,430 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 22:49:38,446 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ac4f6846f7ae8ff3364c2c HTTP/1.1" 200 None 2026-03-13 22:49:38,447 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 22:49:38,468 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b1f16ea26b422765ba49d9 HTTP/1.1" 200 None 2026-03-13 22:49:38,492 - lava_callback - ERROR - Error processing callback for node 69b1f16ea26b422765ba49d9: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:50334 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58050 - "GET / HTTP/1.0" 200 OK 2026-03-13 22:49:58,402 - lava_callback - INFO - Received callback for node 69b1f18fa26b422765ba49e3 INFO: 172.21.0.1:58052 - "POST /node/69b1f18fa26b422765ba49e3 HTTP/1.0" 202 Accepted 2026-03-13 22:49:58,407 - lava_callback - INFO - Starting async job submit for node 69b1f18fa26b422765ba49e3 2026-03-13 22:49:58,408 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 22:49:58,430 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b1f18fa26b422765ba49e3 HTTP/1.1" 200 None 2026-03-13 22:49:58,431 - lava_callback - DEBUG - Processing node 69b1f18fa26b422765ba49e3: baseline-arm-baylibre 2026-03-13 22:49:58,431 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b1f18fa26b422765ba49e3 2026-03-13 22:49:58,432 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 22:49:58,445 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b1f18fa26b422765ba49e3 HTTP/1.1" 200 None 2026-03-13 22:49:58,447 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 22:49:58,460 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ac4f6846f7ae8ff3364c2c HTTP/1.1" 200 None 2026-03-13 22:49:58,462 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 22:49:58,482 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b1f18fa26b422765ba49e3 HTTP/1.1" 200 None 2026-03-13 22:49:58,484 - lava_callback - ERROR - Error processing callback for node 69b1f18fa26b422765ba49e3: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:57942 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49232 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:49234 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48380 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48392 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48586 - "GET / HTTP/1.0" 200 OK 2026-03-13 22:50:38,508 - lava_callback - INFO - Received callback for node 69b1f1b3a26b422765ba49ee INFO: 172.21.0.1:48598 - "POST /node/69b1f1b3a26b422765ba49ee HTTP/1.0" 202 Accepted 2026-03-13 22:50:38,513 - lava_callback - INFO - Starting async job submit for node 69b1f1b3a26b422765ba49ee 2026-03-13 22:50:38,514 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 22:50:38,529 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b1f1b3a26b422765ba49ee HTTP/1.1" 200 None 2026-03-13 22:50:38,529 - lava_callback - DEBUG - Processing node 69b1f1b3a26b422765ba49ee: baseline-arm-baylibre 2026-03-13 22:50:38,530 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b1f1b3a26b422765ba49ee 2026-03-13 22:50:38,530 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 22:50:38,543 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b1f1b3a26b422765ba49ee HTTP/1.1" 200 None 2026-03-13 22:50:38,545 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 22:50:38,558 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ac4f6846f7ae8ff3364c2c HTTP/1.1" 200 None 2026-03-13 22:50:38,560 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 22:50:38,580 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b1f1b3a26b422765ba49ee HTTP/1.1" 200 None 2026-03-13 22:50:38,582 - lava_callback - ERROR - Error processing callback for node 69b1f1b3a26b422765ba49ee: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:35744 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44572 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46642 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46656 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46768 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46776 - "GET /favicon.ico HTTP/1.0" 404 Not Found INFO: 172.21.0.1:46790 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:46800 - "GET / HTTP/1.0" 200 OK 2026-03-13 22:51:18,440 - lava_callback - INFO - Received callback for node 69b1f1d7a26b422765ba49fa INFO: 172.21.0.1:46804 - "POST /node/69b1f1d7a26b422765ba49fa HTTP/1.0" 202 Accepted 2026-03-13 22:51:18,446 - lava_callback - INFO - Starting async job submit for node 69b1f1d7a26b422765ba49fa 2026-03-13 22:51:18,447 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 22:51:18,461 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b1f1d7a26b422765ba49fa HTTP/1.1" 200 None 2026-03-13 22:51:18,461 - lava_callback - DEBUG - Processing node 69b1f1d7a26b422765ba49fa: baseline-arm-baylibre 2026-03-13 22:51:18,462 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b1f1d7a26b422765ba49fa 2026-03-13 22:51:18,462 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 22:51:18,476 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b1f1d7a26b422765ba49fa HTTP/1.1" 200 None 2026-03-13 22:51:18,477 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 22:51:18,491 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ac4f6846f7ae8ff3364c2c HTTP/1.1" 200 None 2026-03-13 22:51:18,493 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 22:51:18,514 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b1f1d7a26b422765ba49fa HTTP/1.1" 200 None 2026-03-13 22:51:18,515 - lava_callback - ERROR - Error processing callback for node 69b1f1d7a26b422765ba49fa: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:49736 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49742 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43684 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55438 - "GET /.well-known/security.txt HTTP/1.0" 404 Not Found INFO: 172.21.0.1:55452 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35348 - "GET / HTTP/1.0" 200 OK 2026-03-13 22:51:58,755 - lava_callback - INFO - Received callback for node 69b1f1fca26b422765ba4a06 INFO: 172.21.0.1:35352 - "POST /node/69b1f1fca26b422765ba4a06 HTTP/1.0" 202 Accepted 2026-03-13 22:51:58,761 - lava_callback - INFO - Starting async job submit for node 69b1f1fca26b422765ba4a06 2026-03-13 22:51:58,762 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 22:51:58,776 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b1f1fca26b422765ba4a06 HTTP/1.1" 200 None 2026-03-13 22:51:58,777 - lava_callback - DEBUG - Processing node 69b1f1fca26b422765ba4a06: baseline-arm-baylibre 2026-03-13 22:51:58,777 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b1f1fca26b422765ba4a06 2026-03-13 22:51:58,777 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 22:51:58,791 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b1f1fca26b422765ba4a06 HTTP/1.1" 200 None 2026-03-13 22:51:58,792 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 22:51:58,805 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ac4f6846f7ae8ff3364c2c HTTP/1.1" 200 None 2026-03-13 22:51:58,807 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 22:51:58,833 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b1f1fca26b422765ba4a06 HTTP/1.1" 200 None 2026-03-13 22:51:58,834 - lava_callback - ERROR - Error processing callback for node 69b1f1fca26b422765ba4a06: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:60234 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36702 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:36706 - "GET / HTTP/1.0" 200 OK 2026-03-13 22:52:20,878 - lava_callback - INFO - Received callback for node 69b1f221a26b422765ba4a14 INFO: 172.21.0.1:46550 - "POST /node/69b1f221a26b422765ba4a14 HTTP/1.0" 202 Accepted 2026-03-13 22:52:20,884 - lava_callback - INFO - Starting async job submit for node 69b1f221a26b422765ba4a14 2026-03-13 22:52:20,885 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 22:52:20,900 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b1f221a26b422765ba4a14 HTTP/1.1" 200 None 2026-03-13 22:52:20,901 - lava_callback - DEBUG - Processing node 69b1f221a26b422765ba4a14: baseline-arm-clabbe 2026-03-13 22:52:20,901 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b1f221a26b422765ba4a14 2026-03-13 22:52:20,902 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 22:52:20,915 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b1f221a26b422765ba4a14 HTTP/1.1" 200 None 2026-03-13 22:52:20,916 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 22:52:20,929 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ac4f6846f7ae8ff3364c2c HTTP/1.1" 200 None 2026-03-13 22:52:20,931 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 22:52:20,974 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b1f221a26b422765ba4a14 HTTP/1.1" 200 None 2026-03-13 22:52:20,976 - lava_callback - ERROR - Error processing callback for node 69b1f221a26b422765ba4a14: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:46560 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46570 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33206 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44296 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51448 - "GET / HTTP/1.0" 200 OK 2026-03-13 22:53:00,871 - lava_callback - INFO - Received callback for node 69b1f246a26b422765ba4a1d INFO: 172.21.0.1:39014 - "POST /node/69b1f246a26b422765ba4a1d HTTP/1.0" 202 Accepted 2026-03-13 22:53:00,877 - lava_callback - INFO - Starting async job submit for node 69b1f246a26b422765ba4a1d 2026-03-13 22:53:00,878 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 22:53:00,892 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b1f246a26b422765ba4a1d HTTP/1.1" 200 None 2026-03-13 22:53:00,893 - lava_callback - DEBUG - Processing node 69b1f246a26b422765ba4a1d: baseline-arm-clabbe 2026-03-13 22:53:00,893 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b1f246a26b422765ba4a1d 2026-03-13 22:53:00,894 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 22:53:00,907 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b1f246a26b422765ba4a1d HTTP/1.1" 200 None 2026-03-13 22:53:00,909 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 22:53:00,923 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ac4f6846f7ae8ff3364c2c HTTP/1.1" 200 None 2026-03-13 22:53:00,925 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 22:53:00,951 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b1f246a26b422765ba4a1d HTTP/1.1" 200 None 2026-03-13 22:53:00,952 - lava_callback - ERROR - Error processing callback for node 69b1f246a26b422765ba4a1d: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:39018 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37826 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:37838 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36136 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36152 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36590 - "GET / HTTP/1.0" 200 OK 2026-03-13 22:53:38,669 - lava_callback - INFO - Received callback for node 69b1f265a26b422765ba4a29 INFO: 172.21.0.1:36594 - "POST /node/69b1f265a26b422765ba4a29 HTTP/1.0" 202 Accepted 2026-03-13 22:53:38,675 - lava_callback - INFO - Starting async job submit for node 69b1f265a26b422765ba4a29 2026-03-13 22:53:38,676 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 22:53:38,690 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b1f265a26b422765ba4a29 HTTP/1.1" 200 None 2026-03-13 22:53:38,691 - lava_callback - DEBUG - Processing node 69b1f265a26b422765ba4a29: baseline-arm-baylibre 2026-03-13 22:53:38,691 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b1f265a26b422765ba4a29 2026-03-13 22:53:38,692 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 22:53:38,705 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b1f265a26b422765ba4a29 HTTP/1.1" 200 None 2026-03-13 22:53:38,706 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 22:53:38,728 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ac4f6846f7ae8ff3364c2c HTTP/1.1" 200 None 2026-03-13 22:53:38,729 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 22:53:38,760 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b1f265a26b422765ba4a29 HTTP/1.1" 200 None 2026-03-13 22:53:38,765 - lava_callback - ERROR - Error processing callback for node 69b1f265a26b422765ba4a29: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:55312 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45858 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44124 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34156 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:34172 - "GET / HTTP/1.0" 200 OK 2026-03-13 22:54:18,834 - lava_callback - INFO - Received callback for node 69b1f28aa26b422765ba4a34 INFO: 172.21.0.1:34176 - "POST /node/69b1f28aa26b422765ba4a34 HTTP/1.0" 202 Accepted 2026-03-13 22:54:18,839 - lava_callback - INFO - Starting async job submit for node 69b1f28aa26b422765ba4a34 2026-03-13 22:54:18,840 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 22:54:18,870 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b1f28aa26b422765ba4a34 HTTP/1.1" 200 None 2026-03-13 22:54:18,870 - lava_callback - DEBUG - Processing node 69b1f28aa26b422765ba4a34: baseline-arm-baylibre 2026-03-13 22:54:18,871 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b1f28aa26b422765ba4a34 2026-03-13 22:54:18,871 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 22:54:18,884 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b1f28aa26b422765ba4a34 HTTP/1.1" 200 None 2026-03-13 22:54:18,886 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 22:54:18,904 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ac4f6846f7ae8ff3364c2c HTTP/1.1" 200 None 2026-03-13 22:54:18,905 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 22:54:18,926 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b1f28aa26b422765ba4a34 HTTP/1.1" 200 None 2026-03-13 22:54:18,928 - lava_callback - ERROR - Error processing callback for node 69b1f28aa26b422765ba4a34: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:50794 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50810 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41274 - "GET / HTTP/1.0" 200 OK 2026-03-13 22:54:38,634 - lava_callback - INFO - Received callback for node 69b1f2aaa26b422765ba4a3d INFO: 172.21.0.1:41282 - "POST /node/69b1f2aaa26b422765ba4a3d HTTP/1.0" 202 Accepted 2026-03-13 22:54:38,639 - lava_callback - INFO - Starting async job submit for node 69b1f2aaa26b422765ba4a3d 2026-03-13 22:54:38,640 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 22:54:38,655 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b1f2aaa26b422765ba4a3d HTTP/1.1" 200 None 2026-03-13 22:54:38,656 - lava_callback - DEBUG - Processing node 69b1f2aaa26b422765ba4a3d: baseline-arm-baylibre 2026-03-13 22:54:38,656 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b1f2aaa26b422765ba4a3d 2026-03-13 22:54:38,657 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 22:54:38,670 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b1f2aaa26b422765ba4a3d HTTP/1.1" 200 None 2026-03-13 22:54:38,672 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 22:54:38,685 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aef424ce46d8ec186ab80e HTTP/1.1" 200 None 2026-03-13 22:54:38,686 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 22:54:38,724 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b1f2aaa26b422765ba4a3d HTTP/1.1" 200 None 2026-03-13 22:54:38,725 - lava_callback - ERROR - Error processing callback for node 69b1f2aaa26b422765ba4a3d: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:42126 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42022 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36354 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36540 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:36546 - "GET / HTTP/1.0" 200 OK 2026-03-13 22:55:18,731 - lava_callback - INFO - Received callback for node 69b1f2cea26b422765ba4a4d INFO: 172.21.0.1:36558 - "POST /node/69b1f2cea26b422765ba4a4d HTTP/1.0" 202 Accepted 2026-03-13 22:55:18,738 - lava_callback - INFO - Starting async job submit for node 69b1f2cea26b422765ba4a4d 2026-03-13 22:55:18,739 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 22:55:18,758 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b1f2cea26b422765ba4a4d HTTP/1.1" 200 None 2026-03-13 22:55:18,759 - lava_callback - DEBUG - Processing node 69b1f2cea26b422765ba4a4d: baseline-arm-baylibre 2026-03-13 22:55:18,759 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b1f2cea26b422765ba4a4d 2026-03-13 22:55:18,760 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 22:55:18,778 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b1f2cea26b422765ba4a4d HTTP/1.1" 200 None 2026-03-13 22:55:18,779 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 22:55:18,794 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aef424ce46d8ec186ab80e HTTP/1.1" 200 None 2026-03-13 22:55:18,795 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 22:55:18,820 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b1f2cea26b422765ba4a4d HTTP/1.1" 200 None 2026-03-13 22:55:18,825 - lava_callback - ERROR - Error processing callback for node 69b1f2cea26b422765ba4a4d: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:52414 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52420 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46888 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60080 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58056 - "GET / HTTP/1.0" 200 OK 2026-03-13 22:55:58,732 - lava_callback - INFO - Received callback for node 69b1f2f2a26b422765ba4a5b INFO: 172.21.0.1:58060 - "POST /node/69b1f2f2a26b422765ba4a5b HTTP/1.0" 202 Accepted 2026-03-13 22:55:58,737 - lava_callback - INFO - Starting async job submit for node 69b1f2f2a26b422765ba4a5b 2026-03-13 22:55:58,738 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 22:55:58,753 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b1f2f2a26b422765ba4a5b HTTP/1.1" 200 None 2026-03-13 22:55:58,754 - lava_callback - DEBUG - Processing node 69b1f2f2a26b422765ba4a5b: baseline-arm-baylibre 2026-03-13 22:55:58,754 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b1f2f2a26b422765ba4a5b 2026-03-13 22:55:58,755 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 22:55:58,771 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b1f2f2a26b422765ba4a5b HTTP/1.1" 200 None 2026-03-13 22:55:58,773 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 22:55:58,788 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aef424ce46d8ec186ab80e HTTP/1.1" 200 None 2026-03-13 22:55:58,790 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 22:55:58,818 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b1f2f2a26b422765ba4a5b HTTP/1.1" 200 None 2026-03-13 22:55:58,826 - lava_callback - ERROR - Error processing callback for node 69b1f2f2a26b422765ba4a5b: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:52926 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54076 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:54086 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48714 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48730 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51912 - "GET / HTTP/1.0" 200 OK 2026-03-13 22:56:38,756 - lava_callback - INFO - Received callback for node 69b1f315a26b422765ba4a64 INFO: 172.21.0.1:51918 - "POST /node/69b1f315a26b422765ba4a64 HTTP/1.0" 202 Accepted 2026-03-13 22:56:38,762 - lava_callback - INFO - Starting async job submit for node 69b1f315a26b422765ba4a64 2026-03-13 22:56:38,763 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 22:56:38,778 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b1f315a26b422765ba4a64 HTTP/1.1" 200 None 2026-03-13 22:56:38,778 - lava_callback - DEBUG - Processing node 69b1f315a26b422765ba4a64: baseline-arm-baylibre 2026-03-13 22:56:38,779 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b1f315a26b422765ba4a64 2026-03-13 22:56:38,779 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 22:56:38,792 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b1f315a26b422765ba4a64 HTTP/1.1" 200 None 2026-03-13 22:56:38,794 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 22:56:38,807 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ac4f6846f7ae8ff3364c2c HTTP/1.1" 200 None 2026-03-13 22:56:38,808 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 22:56:38,828 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b1f315a26b422765ba4a64 HTTP/1.1" 200 None 2026-03-13 22:56:38,837 - lava_callback - ERROR - Error processing callback for node 69b1f315a26b422765ba4a64: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:59560 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51228 - "GET / HTTP/1.0" 200 OK 2026-03-13 22:56:58,767 - lava_callback - INFO - Received callback for node 69b1f339a26b422765ba4a73 INFO: 172.21.0.1:51236 - "POST /node/69b1f339a26b422765ba4a73 HTTP/1.0" 202 Accepted 2026-03-13 22:56:58,772 - lava_callback - INFO - Starting async job submit for node 69b1f339a26b422765ba4a73 2026-03-13 22:56:58,773 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 22:56:58,788 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b1f339a26b422765ba4a73 HTTP/1.1" 200 None 2026-03-13 22:56:58,788 - lava_callback - DEBUG - Processing node 69b1f339a26b422765ba4a73: baseline-arm-baylibre 2026-03-13 22:56:58,789 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b1f339a26b422765ba4a73 2026-03-13 22:56:58,789 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 22:56:58,802 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b1f339a26b422765ba4a73 HTTP/1.1" 200 None 2026-03-13 22:56:58,803 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 22:56:58,816 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ac4f6846f7ae8ff3364c2c HTTP/1.1" 200 None 2026-03-13 22:56:58,818 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 22:56:58,839 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b1f339a26b422765ba4a73 HTTP/1.1" 200 None 2026-03-13 22:56:58,840 - lava_callback - ERROR - Error processing callback for node 69b1f339a26b422765ba4a73: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:39020 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35074 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:35076 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34638 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34646 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54088 - "GET / HTTP/1.0" 200 OK 2026-03-13 22:57:38,808 - lava_callback - INFO - Received callback for node 69b1f35ca26b422765ba4a80 INFO: 172.21.0.1:54092 - "POST /node/69b1f35ca26b422765ba4a80 HTTP/1.0" 202 Accepted 2026-03-13 22:57:38,814 - lava_callback - INFO - Starting async job submit for node 69b1f35ca26b422765ba4a80 2026-03-13 22:57:38,814 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 22:57:38,830 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b1f35ca26b422765ba4a80 HTTP/1.1" 200 None 2026-03-13 22:57:38,831 - lava_callback - DEBUG - Processing node 69b1f35ca26b422765ba4a80: baseline-arm-baylibre 2026-03-13 22:57:38,831 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b1f35ca26b422765ba4a80 2026-03-13 22:57:38,832 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 22:57:38,877 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b1f35ca26b422765ba4a80 HTTP/1.1" 200 None 2026-03-13 22:57:38,879 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 22:57:38,893 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aef424ce46d8ec186ab80e HTTP/1.1" 200 None 2026-03-13 22:57:38,894 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 22:57:38,915 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b1f35ca26b422765ba4a80 HTTP/1.1" 200 None 2026-03-13 22:57:38,917 - lava_callback - ERROR - Error processing callback for node 69b1f35ca26b422765ba4a80: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:51206 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57088 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51950 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46566 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:46574 - "GET / HTTP/1.0" 200 OK 2026-03-13 22:58:18,866 - lava_callback - INFO - Received callback for node 69b1f381a26b422765ba4a89 INFO: 172.21.0.1:46576 - "POST /node/69b1f381a26b422765ba4a89 HTTP/1.0" 202 Accepted 2026-03-13 22:58:18,872 - lava_callback - INFO - Starting async job submit for node 69b1f381a26b422765ba4a89 2026-03-13 22:58:18,873 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 22:58:18,887 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b1f381a26b422765ba4a89 HTTP/1.1" 200 None 2026-03-13 22:58:18,887 - lava_callback - DEBUG - Processing node 69b1f381a26b422765ba4a89: baseline-arm-baylibre 2026-03-13 22:58:18,888 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b1f381a26b422765ba4a89 2026-03-13 22:58:18,888 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 22:58:18,902 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b1f381a26b422765ba4a89 HTTP/1.1" 200 None 2026-03-13 22:58:18,903 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 22:58:18,917 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aef424ce46d8ec186ab80e HTTP/1.1" 200 None 2026-03-13 22:58:18,919 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 22:58:18,945 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b1f381a26b422765ba4a89 HTTP/1.1" 200 None 2026-03-13 22:58:18,946 - lava_callback - ERROR - Error processing callback for node 69b1f381a26b422765ba4a89: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:40264 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40276 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45190 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44354 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34168 - "GET / HTTP/1.0" 200 OK 2026-03-13 22:58:58,904 - lava_callback - INFO - Received callback for node 69b1f3a4a26b422765ba4a95 INFO: 172.21.0.1:34174 - "POST /node/69b1f3a4a26b422765ba4a95 HTTP/1.0" 202 Accepted 2026-03-13 22:58:58,909 - lava_callback - INFO - Starting async job submit for node 69b1f3a4a26b422765ba4a95 2026-03-13 22:58:58,910 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 22:58:58,924 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b1f3a4a26b422765ba4a95 HTTP/1.1" 200 None 2026-03-13 22:58:58,925 - lava_callback - DEBUG - Processing node 69b1f3a4a26b422765ba4a95: baseline-arm-baylibre 2026-03-13 22:58:58,925 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b1f3a4a26b422765ba4a95 2026-03-13 22:58:58,926 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 22:58:58,945 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b1f3a4a26b422765ba4a95 HTTP/1.1" 200 None 2026-03-13 22:58:58,946 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 22:58:58,959 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aef424ce46d8ec186ab80e HTTP/1.1" 200 None 2026-03-13 22:58:58,960 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 22:58:58,980 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b1f3a4a26b422765ba4a95 HTTP/1.1" 200 None 2026-03-13 22:58:58,986 - lava_callback - ERROR - Error processing callback for node 69b1f3a4a26b422765ba4a95: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:33340 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51148 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:51162 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60120 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60126 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46888 - "GET / HTTP/1.0" 200 OK 2026-03-13 22:59:39,022 - lava_callback - INFO - Received callback for node 69b1f3c5a26b422765ba4aa3 INFO: 172.21.0.1:46898 - "POST /node/69b1f3c5a26b422765ba4aa3 HTTP/1.0" 202 Accepted 2026-03-13 22:59:39,028 - lava_callback - INFO - Starting async job submit for node 69b1f3c5a26b422765ba4aa3 2026-03-13 22:59:39,028 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 22:59:39,043 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b1f3c5a26b422765ba4aa3 HTTP/1.1" 200 None 2026-03-13 22:59:39,044 - lava_callback - DEBUG - Processing node 69b1f3c5a26b422765ba4aa3: baseline-arm-baylibre 2026-03-13 22:59:39,044 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b1f3c5a26b422765ba4aa3 2026-03-13 22:59:39,045 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 22:59:39,059 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b1f3c5a26b422765ba4aa3 HTTP/1.1" 200 None 2026-03-13 22:59:39,060 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 22:59:39,073 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ac4f6846f7ae8ff3364c2c HTTP/1.1" 200 None 2026-03-13 22:59:39,074 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 22:59:39,100 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b1f3c5a26b422765ba4aa3 HTTP/1.1" 200 None 2026-03-13 22:59:39,108 - lava_callback - ERROR - Error processing callback for node 69b1f3c5a26b422765ba4aa3: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:57434 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60590 - "GET / HTTP/1.0" 200 OK 2026-03-13 22:59:58,942 - lava_callback - INFO - Received callback for node 69b1f3eba26b422765ba4aac INFO: 172.21.0.1:60604 - "POST /node/69b1f3eba26b422765ba4aac HTTP/1.0" 202 Accepted 2026-03-13 22:59:58,947 - lava_callback - INFO - Starting async job submit for node 69b1f3eba26b422765ba4aac 2026-03-13 22:59:58,948 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 22:59:58,962 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b1f3eba26b422765ba4aac HTTP/1.1" 200 None 2026-03-13 22:59:58,963 - lava_callback - DEBUG - Processing node 69b1f3eba26b422765ba4aac: baseline-arm-baylibre 2026-03-13 22:59:58,963 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b1f3eba26b422765ba4aac 2026-03-13 22:59:58,964 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 22:59:58,977 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b1f3eba26b422765ba4aac HTTP/1.1" 200 None 2026-03-13 22:59:58,978 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 22:59:59,014 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ac4f6846f7ae8ff3364c2c HTTP/1.1" 200 None 2026-03-13 22:59:59,015 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 22:59:59,055 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b1f3eba26b422765ba4aac HTTP/1.1" 200 None 2026-03-13 22:59:59,056 - lava_callback - ERROR - Error processing callback for node 69b1f3eba26b422765ba4aac: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:54084 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46652 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:46654 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53686 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53698 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59886 - "GET / HTTP/1.0" 200 OK 2026-03-13 23:00:41,250 - lava_callback - INFO - Received callback for node 69b1f410a26b422765ba4ab7 INFO: 172.21.0.1:46412 - "POST /node/69b1f410a26b422765ba4ab7 HTTP/1.0" 202 Accepted 2026-03-13 23:00:41,255 - lava_callback - INFO - Starting async job submit for node 69b1f410a26b422765ba4ab7 2026-03-13 23:00:41,256 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 23:00:41,293 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b1f410a26b422765ba4ab7 HTTP/1.1" 200 None 2026-03-13 23:00:41,294 - lava_callback - DEBUG - Processing node 69b1f410a26b422765ba4ab7: baseline-arm-clabbe 2026-03-13 23:00:41,294 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b1f410a26b422765ba4ab7 2026-03-13 23:00:41,295 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 23:00:41,319 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b1f410a26b422765ba4ab7 HTTP/1.1" 200 None 2026-03-13 23:00:41,321 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 23:00:41,334 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ac4f6846f7ae8ff3364c2c HTTP/1.1" 200 None 2026-03-13 23:00:41,335 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 23:00:41,355 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b1f410a26b422765ba4ab7 HTTP/1.1" 200 None 2026-03-13 23:00:41,364 - lava_callback - ERROR - Error processing callback for node 69b1f410a26b422765ba4ab7: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:46428 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53322 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38618 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60162 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:60170 - "GET / HTTP/1.0" 200 OK 2026-03-13 23:01:21,249 - lava_callback - INFO - Received callback for node 69b1f434a26b422765ba4ac8 INFO: 172.21.0.1:34624 - "POST /node/69b1f434a26b422765ba4ac8 HTTP/1.0" 202 Accepted 2026-03-13 23:01:21,254 - lava_callback - INFO - Starting async job submit for node 69b1f434a26b422765ba4ac8 2026-03-13 23:01:21,255 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 23:01:21,271 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b1f434a26b422765ba4ac8 HTTP/1.1" 200 None 2026-03-13 23:01:21,272 - lava_callback - DEBUG - Processing node 69b1f434a26b422765ba4ac8: baseline-arm-clabbe 2026-03-13 23:01:21,272 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b1f434a26b422765ba4ac8 2026-03-13 23:01:21,273 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 23:01:21,286 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b1f434a26b422765ba4ac8 HTTP/1.1" 200 None 2026-03-13 23:01:21,287 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 23:01:21,301 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ac4f6846f7ae8ff3364c2c HTTP/1.1" 200 None 2026-03-13 23:01:21,302 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 23:01:21,322 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b1f434a26b422765ba4ac8 HTTP/1.1" 200 None 2026-03-13 23:01:21,324 - lava_callback - ERROR - Error processing callback for node 69b1f434a26b422765ba4ac8: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:34630 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34638 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34322 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41598 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57278 - "GET / HTTP/1.0" 200 OK 2026-03-13 23:02:01,288 - lava_callback - INFO - Received callback for node 69b1f459a26b422765ba4ad9 INFO: 172.21.0.1:48640 - "POST /node/69b1f459a26b422765ba4ad9 HTTP/1.0" 202 Accepted 2026-03-13 23:02:01,294 - lava_callback - INFO - Starting async job submit for node 69b1f459a26b422765ba4ad9 2026-03-13 23:02:01,294 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 23:02:01,309 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b1f459a26b422765ba4ad9 HTTP/1.1" 200 None 2026-03-13 23:02:01,310 - lava_callback - DEBUG - Processing node 69b1f459a26b422765ba4ad9: baseline-arm-clabbe 2026-03-13 23:02:01,310 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b1f459a26b422765ba4ad9 2026-03-13 23:02:01,311 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 23:02:01,325 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b1f459a26b422765ba4ad9 HTTP/1.1" 200 None 2026-03-13 23:02:01,326 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 23:02:01,345 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ac4f6846f7ae8ff3364c2c HTTP/1.1" 200 None 2026-03-13 23:02:01,346 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 23:02:01,368 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b1f459a26b422765ba4ad9 HTTP/1.1" 200 None 2026-03-13 23:02:01,370 - lava_callback - ERROR - Error processing callback for node 69b1f459a26b422765ba4ad9: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:48642 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56756 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:56764 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50792 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50800 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54762 - "GET / HTTP/1.0" 200 OK 2026-03-13 23:02:41,298 - lava_callback - INFO - Received callback for node 69b1f47ca26b422765ba4ae6 INFO: 172.21.0.1:37448 - "POST /node/69b1f47ca26b422765ba4ae6 HTTP/1.0" 202 Accepted 2026-03-13 23:02:41,303 - lava_callback - INFO - Starting async job submit for node 69b1f47ca26b422765ba4ae6 2026-03-13 23:02:41,304 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 23:02:41,319 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b1f47ca26b422765ba4ae6 HTTP/1.1" 200 None 2026-03-13 23:02:41,320 - lava_callback - DEBUG - Processing node 69b1f47ca26b422765ba4ae6: baseline-arm-clabbe 2026-03-13 23:02:41,320 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b1f47ca26b422765ba4ae6 2026-03-13 23:02:41,321 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 23:02:41,342 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b1f47ca26b422765ba4ae6 HTTP/1.1" 200 None 2026-03-13 23:02:41,343 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 23:02:41,366 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aef424ce46d8ec186ab80e HTTP/1.1" 200 None 2026-03-13 23:02:41,368 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 23:02:41,388 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b1f47ca26b422765ba4ae6 HTTP/1.1" 200 None 2026-03-13 23:02:41,389 - lava_callback - ERROR - Error processing callback for node 69b1f47ca26b422765ba4ae6: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:37454 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40608 - "GET / HTTP/1.0" 200 OK 2026-03-13 23:03:01,334 - lava_callback - INFO - Received callback for node 69b1f4a0a26b422765ba4af0 INFO: 172.21.0.1:38482 - "POST /node/69b1f4a0a26b422765ba4af0 HTTP/1.0" 202 Accepted 2026-03-13 23:03:01,339 - lava_callback - INFO - Starting async job submit for node 69b1f4a0a26b422765ba4af0 2026-03-13 23:03:01,340 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 23:03:01,356 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b1f4a0a26b422765ba4af0 HTTP/1.1" 200 None 2026-03-13 23:03:01,357 - lava_callback - DEBUG - Processing node 69b1f4a0a26b422765ba4af0: baseline-arm-clabbe 2026-03-13 23:03:01,357 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b1f4a0a26b422765ba4af0 2026-03-13 23:03:01,358 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 23:03:01,371 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b1f4a0a26b422765ba4af0 HTTP/1.1" 200 None 2026-03-13 23:03:01,373 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 23:03:01,401 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aef424ce46d8ec186ab80e HTTP/1.1" 200 None 2026-03-13 23:03:01,402 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 23:03:01,422 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b1f4a0a26b422765ba4af0 HTTP/1.1" 200 None 2026-03-13 23:03:01,428 - lava_callback - ERROR - Error processing callback for node 69b1f4a0a26b422765ba4af0: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:38490 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60694 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:60708 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51456 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51466 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45780 - "GET / HTTP/1.0" 200 OK 2026-03-13 23:03:41,292 - lava_callback - INFO - Received callback for node 69b1f4c4a26b422765ba4afb INFO: 172.21.0.1:34010 - "POST /node/69b1f4c4a26b422765ba4afb HTTP/1.0" 202 Accepted 2026-03-13 23:03:41,297 - lava_callback - INFO - Starting async job submit for node 69b1f4c4a26b422765ba4afb 2026-03-13 23:03:41,298 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 23:03:41,312 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b1f4c4a26b422765ba4afb HTTP/1.1" 200 None 2026-03-13 23:03:41,313 - lava_callback - DEBUG - Processing node 69b1f4c4a26b422765ba4afb: baseline-arm-clabbe 2026-03-13 23:03:41,314 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b1f4c4a26b422765ba4afb 2026-03-13 23:03:41,314 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 23:03:41,328 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b1f4c4a26b422765ba4afb HTTP/1.1" 200 None 2026-03-13 23:03:41,329 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 23:03:41,342 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aef424ce46d8ec186ab80e HTTP/1.1" 200 None 2026-03-13 23:03:41,344 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 23:03:41,365 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b1f4c4a26b422765ba4afb HTTP/1.1" 200 None 2026-03-13 23:03:41,369 - lava_callback - ERROR - Error processing callback for node 69b1f4c4a26b422765ba4afb: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:34022 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50776 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56768 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42364 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:42370 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46350 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46362 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39094 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40030 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57666 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44562 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39592 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:39600 - "GET / HTTP/1.0" 200 OK 2026-03-13 23:05:21,466 - lava_callback - INFO - Received callback for node 69b1f51ba26b422765ba4b18 INFO: 172.21.0.1:47374 - "POST /node/69b1f51ba26b422765ba4b18 HTTP/1.0" 202 Accepted 2026-03-13 23:05:21,472 - lava_callback - INFO - Starting async job submit for node 69b1f51ba26b422765ba4b18 2026-03-13 23:05:21,473 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 23:05:21,487 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b1f51ba26b422765ba4b18 HTTP/1.1" 200 None 2026-03-13 23:05:21,488 - lava_callback - DEBUG - Processing node 69b1f51ba26b422765ba4b18: baseline-arm-clabbe 2026-03-13 23:05:21,488 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b1f51ba26b422765ba4b18 2026-03-13 23:05:21,489 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 23:05:21,502 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b1f51ba26b422765ba4b18 HTTP/1.1" 200 None 2026-03-13 23:05:21,504 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 23:05:21,519 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ac4f6846f7ae8ff3364c2c HTTP/1.1" 200 None 2026-03-13 23:05:21,521 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 23:05:21,544 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b1f51ba26b422765ba4b18 HTTP/1.1" 200 None 2026-03-13 23:05:21,548 - lava_callback - ERROR - Error processing callback for node 69b1f51ba26b422765ba4b18: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:47382 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47396 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53512 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44528 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43480 - "GET / HTTP/1.0" 200 OK 2026-03-13 23:06:01,399 - lava_callback - INFO - Received callback for node 69b1f542a26b422765ba4b24 INFO: 172.21.0.1:39590 - "POST /node/69b1f542a26b422765ba4b24 HTTP/1.0" 202 Accepted 2026-03-13 23:06:01,405 - lava_callback - INFO - Starting async job submit for node 69b1f542a26b422765ba4b24 2026-03-13 23:06:01,405 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 23:06:01,420 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b1f542a26b422765ba4b24 HTTP/1.1" 200 None 2026-03-13 23:06:01,421 - lava_callback - DEBUG - Processing node 69b1f542a26b422765ba4b24: baseline-arm-clabbe 2026-03-13 23:06:01,422 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b1f542a26b422765ba4b24 2026-03-13 23:06:01,422 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 23:06:01,438 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b1f542a26b422765ba4b24 HTTP/1.1" 200 None 2026-03-13 23:06:01,440 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 23:06:01,453 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aef424ce46d8ec186ab80e HTTP/1.1" 200 None 2026-03-13 23:06:01,455 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 23:06:01,476 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b1f542a26b422765ba4b24 HTTP/1.1" 200 None 2026-03-13 23:06:01,478 - lava_callback - ERROR - Error processing callback for node 69b1f542a26b422765ba4b24: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:39604 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49856 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:49864 - "GET / HTTP/1.0" 200 OK 2026-03-13 23:06:19,513 - lava_callback - INFO - Received callback for node 69b1f565a26b422765ba4b35 INFO: 172.21.0.1:49872 - "POST /node/69b1f565a26b422765ba4b35 HTTP/1.0" 202 Accepted 2026-03-13 23:06:19,518 - lava_callback - INFO - Starting async job submit for node 69b1f565a26b422765ba4b35 2026-03-13 23:06:19,519 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 23:06:19,542 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b1f565a26b422765ba4b35 HTTP/1.1" 200 None 2026-03-13 23:06:19,543 - lava_callback - DEBUG - Processing node 69b1f565a26b422765ba4b35: baseline-arm-baylibre 2026-03-13 23:06:19,543 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b1f565a26b422765ba4b35 2026-03-13 23:06:19,543 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 23:06:19,556 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b1f565a26b422765ba4b35 HTTP/1.1" 200 None 2026-03-13 23:06:19,558 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 23:06:19,571 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aef424ce46d8ec186ab80e HTTP/1.1" 200 None 2026-03-13 23:06:19,572 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 23:06:19,593 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b1f565a26b422765ba4b35 HTTP/1.1" 200 None 2026-03-13 23:06:19,598 - lava_callback - ERROR - Error processing callback for node 69b1f565a26b422765ba4b35: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:58484 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58498 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35574 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51100 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49816 - "GET / HTTP/1.0" 200 OK 2026-03-13 23:06:59,302 - lava_callback - INFO - Received callback for node 69b1f58ba26b422765ba4b43 INFO: 172.21.0.1:49828 - "POST /node/69b1f58ba26b422765ba4b43 HTTP/1.0" 202 Accepted 2026-03-13 23:06:59,308 - lava_callback - INFO - Starting async job submit for node 69b1f58ba26b422765ba4b43 2026-03-13 23:06:59,308 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 23:06:59,330 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b1f58ba26b422765ba4b43 HTTP/1.1" 200 None 2026-03-13 23:06:59,331 - lava_callback - DEBUG - Processing node 69b1f58ba26b422765ba4b43: baseline-arm-baylibre 2026-03-13 23:06:59,331 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b1f58ba26b422765ba4b43 2026-03-13 23:06:59,332 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 23:06:59,353 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b1f58ba26b422765ba4b43 HTTP/1.1" 200 None 2026-03-13 23:06:59,354 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 23:06:59,367 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aef424ce46d8ec186ab80e HTTP/1.1" 200 None 2026-03-13 23:06:59,369 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 23:06:59,388 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b1f58ba26b422765ba4b43 HTTP/1.1" 200 None 2026-03-13 23:06:59,395 - lava_callback - ERROR - Error processing callback for node 69b1f58ba26b422765ba4b43: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:47996 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43750 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:43766 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54934 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54938 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45296 - "GET / HTTP/1.0" 200 OK 2026-03-13 23:07:41,519 - lava_callback - INFO - Received callback for node 69b1f5b7a26b422765ba4b4e INFO: 172.21.0.1:49836 - "POST /node/69b1f5b7a26b422765ba4b4e HTTP/1.0" 202 Accepted 2026-03-13 23:07:41,524 - lava_callback - INFO - Starting async job submit for node 69b1f5b7a26b422765ba4b4e 2026-03-13 23:07:41,525 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 23:07:41,540 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b1f5b7a26b422765ba4b4e HTTP/1.1" 200 None 2026-03-13 23:07:41,541 - lava_callback - DEBUG - Processing node 69b1f5b7a26b422765ba4b4e: baseline-arm-clabbe 2026-03-13 23:07:41,541 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b1f5b7a26b422765ba4b4e 2026-03-13 23:07:41,542 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 23:07:41,555 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b1f5b7a26b422765ba4b4e HTTP/1.1" 200 None 2026-03-13 23:07:41,557 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 23:07:41,577 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aef424ce46d8ec186ab80e HTTP/1.1" 200 None 2026-03-13 23:07:41,579 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 23:07:41,613 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b1f5b7a26b422765ba4b4e HTTP/1.1" 200 None 2026-03-13 23:07:41,614 - lava_callback - ERROR - Error processing callback for node 69b1f5b7a26b422765ba4b4e: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:49838 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46822 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38220 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39554 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:39556 - "GET / HTTP/1.0" 200 OK 2026-03-13 23:08:19,491 - lava_callback - INFO - Received callback for node 69b1f5d8a26b422765ba4b5c INFO: 172.21.0.1:39558 - "POST /node/69b1f5d8a26b422765ba4b5c HTTP/1.0" 202 Accepted 2026-03-13 23:08:19,496 - lava_callback - INFO - Starting async job submit for node 69b1f5d8a26b422765ba4b5c 2026-03-13 23:08:19,497 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 23:08:19,510 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b1f5d8a26b422765ba4b5c HTTP/1.1" 200 None 2026-03-13 23:08:19,511 - lava_callback - DEBUG - Processing node 69b1f5d8a26b422765ba4b5c: baseline-arm-baylibre 2026-03-13 23:08:19,511 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b1f5d8a26b422765ba4b5c 2026-03-13 23:08:19,512 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 23:08:19,526 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b1f5d8a26b422765ba4b5c HTTP/1.1" 200 None 2026-03-13 23:08:19,527 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 23:08:19,540 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aef424ce46d8ec186ab80e HTTP/1.1" 200 None 2026-03-13 23:08:19,541 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 23:08:19,562 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b1f5d8a26b422765ba4b5c HTTP/1.1" 200 None 2026-03-13 23:08:19,569 - lava_callback - ERROR - Error processing callback for node 69b1f5d8a26b422765ba4b5c: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:51112 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51118 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54564 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60826 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51006 - "GET / HTTP/1.0" 200 OK 2026-03-13 23:08:59,446 - lava_callback - INFO - Received callback for node 69b1f5fca26b422765ba4b65 INFO: 172.21.0.1:51008 - "POST /node/69b1f5fca26b422765ba4b65 HTTP/1.0" 202 Accepted 2026-03-13 23:08:59,451 - lava_callback - INFO - Starting async job submit for node 69b1f5fca26b422765ba4b65 2026-03-13 23:08:59,452 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 23:08:59,466 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b1f5fca26b422765ba4b65 HTTP/1.1" 200 None 2026-03-13 23:08:59,467 - lava_callback - DEBUG - Processing node 69b1f5fca26b422765ba4b65: baseline-arm-baylibre 2026-03-13 23:08:59,467 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b1f5fca26b422765ba4b65 2026-03-13 23:08:59,468 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 23:08:59,491 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b1f5fca26b422765ba4b65 HTTP/1.1" 200 None 2026-03-13 23:08:59,492 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 23:08:59,505 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aef424ce46d8ec186ab80e HTTP/1.1" 200 None 2026-03-13 23:08:59,507 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 23:08:59,528 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b1f5fca26b422765ba4b65 HTTP/1.1" 200 None 2026-03-13 23:08:59,533 - lava_callback - ERROR - Error processing callback for node 69b1f5fca26b422765ba4b65: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:60680 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48702 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:48704 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35630 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35642 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55436 - "GET / HTTP/1.0" 200 OK 2026-03-13 23:09:39,531 - lava_callback - INFO - Received callback for node 69b1f61fa26b422765ba4b71 INFO: 172.21.0.1:55444 - "POST /node/69b1f61fa26b422765ba4b71 HTTP/1.0" 202 Accepted 2026-03-13 23:09:39,537 - lava_callback - INFO - Starting async job submit for node 69b1f61fa26b422765ba4b71 2026-03-13 23:09:39,538 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 23:09:39,558 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b1f61fa26b422765ba4b71 HTTP/1.1" 200 None 2026-03-13 23:09:39,559 - lava_callback - DEBUG - Processing node 69b1f61fa26b422765ba4b71: baseline-arm-baylibre 2026-03-13 23:09:39,559 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b1f61fa26b422765ba4b71 2026-03-13 23:09:39,560 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 23:09:39,579 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b1f61fa26b422765ba4b71 HTTP/1.1" 200 None 2026-03-13 23:09:39,581 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 23:09:39,594 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aef424ce46d8ec186ab80e HTTP/1.1" 200 None 2026-03-13 23:09:39,596 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 23:09:39,617 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b1f61fa26b422765ba4b71 HTTP/1.1" 200 None 2026-03-13 23:09:39,618 - lava_callback - ERROR - Error processing callback for node 69b1f61fa26b422765ba4b71: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:43576 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56098 - "GET / HTTP/1.0" 200 OK 2026-03-13 23:09:59,487 - lava_callback - INFO - Received callback for node 69b1f641a26b422765ba4b7a INFO: 172.21.0.1:56102 - "POST /node/69b1f641a26b422765ba4b7a HTTP/1.0" 202 Accepted 2026-03-13 23:09:59,493 - lava_callback - INFO - Starting async job submit for node 69b1f641a26b422765ba4b7a 2026-03-13 23:09:59,494 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 23:09:59,508 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b1f641a26b422765ba4b7a HTTP/1.1" 200 None 2026-03-13 23:09:59,509 - lava_callback - DEBUG - Processing node 69b1f641a26b422765ba4b7a: baseline-arm-baylibre 2026-03-13 23:09:59,509 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b1f641a26b422765ba4b7a 2026-03-13 23:09:59,509 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 23:09:59,523 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b1f641a26b422765ba4b7a HTTP/1.1" 200 None 2026-03-13 23:09:59,524 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 23:09:59,538 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aef424ce46d8ec186ab80e HTTP/1.1" 200 None 2026-03-13 23:09:59,540 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 23:09:59,568 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b1f641a26b422765ba4b7a HTTP/1.1" 200 None 2026-03-13 23:09:59,576 - lava_callback - ERROR - Error processing callback for node 69b1f641a26b422765ba4b7a: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:34124 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38094 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:38098 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45148 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45150 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59450 - "GET / HTTP/1.0" 200 OK 2026-03-13 23:10:41,634 - lava_callback - INFO - Received callback for node 69b1f66aa26b422765ba4b84 INFO: 172.21.0.1:36506 - "POST /node/69b1f66aa26b422765ba4b84 HTTP/1.0" 202 Accepted 2026-03-13 23:10:41,640 - lava_callback - INFO - Starting async job submit for node 69b1f66aa26b422765ba4b84 2026-03-13 23:10:41,640 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 23:10:41,655 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b1f66aa26b422765ba4b84 HTTP/1.1" 200 None 2026-03-13 23:10:41,656 - lava_callback - DEBUG - Processing node 69b1f66aa26b422765ba4b84: baseline-arm-clabbe 2026-03-13 23:10:41,656 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b1f66aa26b422765ba4b84 2026-03-13 23:10:41,656 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 23:10:41,670 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b1f66aa26b422765ba4b84 HTTP/1.1" 200 None 2026-03-13 23:10:41,671 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 23:10:41,685 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aef424ce46d8ec186ab80e HTTP/1.1" 200 None 2026-03-13 23:10:41,686 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 23:10:41,714 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b1f66aa26b422765ba4b84 HTTP/1.1" 200 None 2026-03-13 23:10:41,715 - lava_callback - ERROR - Error processing callback for node 69b1f66aa26b422765ba4b84: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:36508 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51082 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57790 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43104 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:43110 - "GET / HTTP/1.0" 200 OK 2026-03-13 23:11:21,613 - lava_callback - INFO - Received callback for node 69b1f68ea26b422765ba4b90 INFO: 172.21.0.1:47944 - "POST /node/69b1f68ea26b422765ba4b90 HTTP/1.0" 202 Accepted 2026-03-13 23:11:21,619 - lava_callback - INFO - Starting async job submit for node 69b1f68ea26b422765ba4b90 2026-03-13 23:11:21,619 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 23:11:21,643 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b1f68ea26b422765ba4b90 HTTP/1.1" 200 None 2026-03-13 23:11:21,644 - lava_callback - DEBUG - Processing node 69b1f68ea26b422765ba4b90: baseline-arm-clabbe 2026-03-13 23:11:21,644 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b1f68ea26b422765ba4b90 2026-03-13 23:11:21,645 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 23:11:21,658 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b1f68ea26b422765ba4b90 HTTP/1.1" 200 None 2026-03-13 23:11:21,659 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 23:11:21,672 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ac4f6846f7ae8ff3364c2c HTTP/1.1" 200 None 2026-03-13 23:11:21,673 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 23:11:21,698 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b1f68ea26b422765ba4b90 HTTP/1.1" 200 None 2026-03-13 23:11:21,704 - lava_callback - ERROR - Error processing callback for node 69b1f68ea26b422765ba4b90: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:47950 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47962 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35936 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49442 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60044 - "GET / HTTP/1.0" 200 OK 2026-03-13 23:12:01,687 - lava_callback - INFO - Received callback for node 69b1f6b2a26b422765ba4b9d INFO: 172.21.0.1:38986 - "POST /node/69b1f6b2a26b422765ba4b9d HTTP/1.0" 202 Accepted 2026-03-13 23:12:01,693 - lava_callback - INFO - Starting async job submit for node 69b1f6b2a26b422765ba4b9d 2026-03-13 23:12:01,693 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 23:12:01,707 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b1f6b2a26b422765ba4b9d HTTP/1.1" 200 None 2026-03-13 23:12:01,708 - lava_callback - DEBUG - Processing node 69b1f6b2a26b422765ba4b9d: baseline-arm-clabbe 2026-03-13 23:12:01,708 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b1f6b2a26b422765ba4b9d 2026-03-13 23:12:01,709 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 23:12:01,726 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b1f6b2a26b422765ba4b9d HTTP/1.1" 200 None 2026-03-13 23:12:01,728 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 23:12:01,749 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aef424ce46d8ec186ab80e HTTP/1.1" 200 None 2026-03-13 23:12:01,750 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 23:12:01,771 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b1f6b2a26b422765ba4b9d HTTP/1.1" 200 None 2026-03-13 23:12:01,777 - lava_callback - ERROR - Error processing callback for node 69b1f6b2a26b422765ba4b9d: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:38992 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34564 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:34576 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54934 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54950 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35860 - "GET / HTTP/1.0" 200 OK 2026-03-13 23:12:41,696 - lava_callback - INFO - Received callback for node 69b1f6d6a26b422765ba4ba9 INFO: 172.21.0.1:58750 - "POST /node/69b1f6d6a26b422765ba4ba9 HTTP/1.0" 202 Accepted 2026-03-13 23:12:41,701 - lava_callback - INFO - Starting async job submit for node 69b1f6d6a26b422765ba4ba9 2026-03-13 23:12:41,702 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 23:12:41,727 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b1f6d6a26b422765ba4ba9 HTTP/1.1" 200 None 2026-03-13 23:12:41,728 - lava_callback - DEBUG - Processing node 69b1f6d6a26b422765ba4ba9: baseline-arm-clabbe 2026-03-13 23:12:41,728 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b1f6d6a26b422765ba4ba9 2026-03-13 23:12:41,729 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 23:12:41,742 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b1f6d6a26b422765ba4ba9 HTTP/1.1" 200 None 2026-03-13 23:12:41,743 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 23:12:41,758 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aef424ce46d8ec186ab80e HTTP/1.1" 200 None 2026-03-13 23:12:41,759 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 23:12:41,788 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b1f6d6a26b422765ba4ba9 HTTP/1.1" 200 None 2026-03-13 23:12:41,789 - lava_callback - ERROR - Error processing callback for node 69b1f6d6a26b422765ba4ba9: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:58764 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45186 - "GET / HTTP/1.0" 200 OK 2026-03-13 23:13:01,739 - lava_callback - INFO - Received callback for node 69b1f6f9a26b422765ba4bb3 INFO: 172.21.0.1:55354 - "POST /node/69b1f6f9a26b422765ba4bb3 HTTP/1.0" 202 Accepted 2026-03-13 23:13:01,744 - lava_callback - INFO - Starting async job submit for node 69b1f6f9a26b422765ba4bb3 2026-03-13 23:13:01,745 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 23:13:01,759 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b1f6f9a26b422765ba4bb3 HTTP/1.1" 200 None 2026-03-13 23:13:01,760 - lava_callback - DEBUG - Processing node 69b1f6f9a26b422765ba4bb3: baseline-arm-clabbe 2026-03-13 23:13:01,760 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b1f6f9a26b422765ba4bb3 2026-03-13 23:13:01,761 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 23:13:01,774 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b1f6f9a26b422765ba4bb3 HTTP/1.1" 200 None 2026-03-13 23:13:01,775 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 23:13:01,788 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ac4f6846f7ae8ff3364c2c HTTP/1.1" 200 None 2026-03-13 23:13:01,790 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 23:13:01,809 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b1f6f9a26b422765ba4bb3 HTTP/1.1" 200 None 2026-03-13 23:13:01,811 - lava_callback - ERROR - Error processing callback for node 69b1f6f9a26b422765ba4bb3: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:55370 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58006 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:58012 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52416 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52426 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35936 - "GET / HTTP/1.0" 200 OK 2026-03-13 23:13:41,743 - lava_callback - INFO - Received callback for node 69b1f71fa26b422765ba4bbd INFO: 172.21.0.1:39070 - "POST /node/69b1f71fa26b422765ba4bbd HTTP/1.0" 202 Accepted 2026-03-13 23:13:41,748 - lava_callback - INFO - Starting async job submit for node 69b1f71fa26b422765ba4bbd 2026-03-13 23:13:41,749 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 23:13:41,781 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b1f71fa26b422765ba4bbd HTTP/1.1" 200 None 2026-03-13 23:13:41,782 - lava_callback - DEBUG - Processing node 69b1f71fa26b422765ba4bbd: baseline-arm-clabbe 2026-03-13 23:13:41,782 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b1f71fa26b422765ba4bbd 2026-03-13 23:13:41,783 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 23:13:41,796 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b1f71fa26b422765ba4bbd HTTP/1.1" 200 None 2026-03-13 23:13:41,797 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 23:13:41,810 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ac4f6846f7ae8ff3364c2c HTTP/1.1" 200 None 2026-03-13 23:13:41,812 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 23:13:41,833 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b1f71fa26b422765ba4bbd HTTP/1.1" 200 None 2026-03-13 23:13:41,834 - lava_callback - ERROR - Error processing callback for node 69b1f71fa26b422765ba4bbd: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:39078 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55972 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49136 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47076 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:47086 - "GET / HTTP/1.0" 200 OK 2026-03-13 23:14:21,775 - lava_callback - INFO - Received callback for node 69b1f743a26b422765ba4bc8 INFO: 172.21.0.1:37466 - "POST /node/69b1f743a26b422765ba4bc8 HTTP/1.0" 202 Accepted 2026-03-13 23:14:21,780 - lava_callback - INFO - Starting async job submit for node 69b1f743a26b422765ba4bc8 2026-03-13 23:14:21,781 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 23:14:21,796 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b1f743a26b422765ba4bc8 HTTP/1.1" 200 None 2026-03-13 23:14:21,796 - lava_callback - DEBUG - Processing node 69b1f743a26b422765ba4bc8: baseline-arm-clabbe 2026-03-13 23:14:21,797 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b1f743a26b422765ba4bc8 2026-03-13 23:14:21,797 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 23:14:21,812 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b1f743a26b422765ba4bc8 HTTP/1.1" 200 None 2026-03-13 23:14:21,813 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 23:14:21,827 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aef424ce46d8ec186ab80e HTTP/1.1" 200 None 2026-03-13 23:14:21,828 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 23:14:21,852 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b1f743a26b422765ba4bc8 HTTP/1.1" 200 None 2026-03-13 23:14:21,854 - lava_callback - ERROR - Error processing callback for node 69b1f743a26b422765ba4bc8: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:37478 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37482 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51010 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42886 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41006 - "GET / HTTP/1.0" 200 OK 2026-03-13 23:15:01,795 - lava_callback - INFO - Received callback for node 69b1f767a26b422765ba4bd4 INFO: 172.21.0.1:44600 - "POST /node/69b1f767a26b422765ba4bd4 HTTP/1.0" 202 Accepted 2026-03-13 23:15:01,801 - lava_callback - INFO - Starting async job submit for node 69b1f767a26b422765ba4bd4 2026-03-13 23:15:01,802 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 23:15:01,817 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b1f767a26b422765ba4bd4 HTTP/1.1" 200 None 2026-03-13 23:15:01,818 - lava_callback - DEBUG - Processing node 69b1f767a26b422765ba4bd4: baseline-arm-clabbe 2026-03-13 23:15:01,818 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b1f767a26b422765ba4bd4 2026-03-13 23:15:01,819 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 23:15:01,832 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b1f767a26b422765ba4bd4 HTTP/1.1" 200 None 2026-03-13 23:15:01,834 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 23:15:01,847 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aef424ce46d8ec186ab80e HTTP/1.1" 200 None 2026-03-13 23:15:01,849 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 23:15:01,869 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b1f767a26b422765ba4bd4 HTTP/1.1" 200 None 2026-03-13 23:15:01,870 - lava_callback - ERROR - Error processing callback for node 69b1f767a26b422765ba4bd4: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:44610 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59652 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:59654 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41802 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41812 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43704 - "GET / HTTP/1.0" 200 OK 2026-03-13 23:15:39,800 - lava_callback - INFO - Received callback for node 69b1f790a26b422765ba4bde INFO: 172.21.0.1:49604 - "POST /node/69b1f790a26b422765ba4bde HTTP/1.0" 202 Accepted 2026-03-13 23:15:39,806 - lava_callback - INFO - Starting async job submit for node 69b1f790a26b422765ba4bde 2026-03-13 23:15:39,807 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 23:15:39,821 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b1f790a26b422765ba4bde HTTP/1.1" 200 None 2026-03-13 23:15:39,822 - lava_callback - DEBUG - Processing node 69b1f790a26b422765ba4bde: baseline-arm64-baylibre 2026-03-13 23:15:39,822 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b1f790a26b422765ba4bde 2026-03-13 23:15:39,823 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 23:15:39,836 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b1f790a26b422765ba4bde HTTP/1.1" 200 None 2026-03-13 23:15:39,837 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 23:15:39,850 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ac4f7446f7ae8ff3364c45 HTTP/1.1" 200 None 2026-03-13 23:15:39,852 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 23:15:39,872 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b1f790a26b422765ba4bde HTTP/1.1" 200 None 2026-03-13 23:15:39,873 - lava_callback - ERROR - Error processing callback for node 69b1f790a26b422765ba4bde: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:49616 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45686 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33042 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57472 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:57474 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53992 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54006 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51310 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34694 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53230 - "GET / HTTP/1.0" 200 OK 2026-03-13 23:16:59,956 - lava_callback - INFO - Received callback for node 69b1f7dfa26b422765ba4bf0 INFO: 172.21.0.1:43448 - "POST /node/69b1f7dfa26b422765ba4bf0 HTTP/1.0" 202 Accepted 2026-03-13 23:16:59,962 - lava_callback - INFO - Starting async job submit for node 69b1f7dfa26b422765ba4bf0 2026-03-13 23:16:59,963 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 23:16:59,978 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b1f7dfa26b422765ba4bf0 HTTP/1.1" 200 None 2026-03-13 23:16:59,979 - lava_callback - DEBUG - Processing node 69b1f7dfa26b422765ba4bf0: baseline-arm64-baylibre 2026-03-13 23:16:59,979 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b1f7dfa26b422765ba4bf0 2026-03-13 23:16:59,980 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 23:16:59,993 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b1f7dfa26b422765ba4bf0 HTTP/1.1" 200 None 2026-03-13 23:16:59,995 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 23:17:00,008 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ac4f7446f7ae8ff3364c45 HTTP/1.1" 200 None 2026-03-13 23:17:00,009 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 23:17:00,038 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b1f7dfa26b422765ba4bf0 HTTP/1.1" 200 None 2026-03-13 23:17:00,040 - lava_callback - ERROR - Error processing callback for node 69b1f7dfa26b422765ba4bf0: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:43462 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60236 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:60240 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57006 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57022 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44844 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34986 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48356 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38534 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38856 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:38858 - "GET / HTTP/1.0" 200 OK 2026-03-13 23:18:20,065 - lava_callback - INFO - Received callback for node 69b1f830a26b422765ba4bfa INFO: 172.21.0.1:41000 - "POST /node/69b1f830a26b422765ba4bfa HTTP/1.0" 202 Accepted 2026-03-13 23:18:20,071 - lava_callback - INFO - Starting async job submit for node 69b1f830a26b422765ba4bfa 2026-03-13 23:18:20,072 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 23:18:20,093 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b1f830a26b422765ba4bfa HTTP/1.1" 200 None 2026-03-13 23:18:20,094 - lava_callback - DEBUG - Processing node 69b1f830a26b422765ba4bfa: baseline-arm64-baylibre 2026-03-13 23:18:20,094 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b1f830a26b422765ba4bfa 2026-03-13 23:18:20,095 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 23:18:20,134 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b1f830a26b422765ba4bfa HTTP/1.1" 200 None 2026-03-13 23:18:20,135 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 23:18:20,168 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ac4f7446f7ae8ff3364c45 HTTP/1.1" 200 None 2026-03-13 23:18:20,170 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 23:18:20,205 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b1f830a26b422765ba4bfa HTTP/1.1" 200 None 2026-03-13 23:18:20,208 - lava_callback - ERROR - Error processing callback for node 69b1f830a26b422765ba4bfa: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:41006 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41008 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49552 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50358 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34396 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53942 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44928 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:44938 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42106 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42112 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38982 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38988 - "GET / HTTP/1.0" 200 OK 2026-03-13 23:19:40,019 - lava_callback - INFO - Received callback for node 69b1f87fa26b422765ba4c08 INFO: 172.21.0.1:34544 - "POST /node/69b1f87fa26b422765ba4c08 HTTP/1.0" 202 Accepted 2026-03-13 23:19:40,024 - lava_callback - INFO - Starting async job submit for node 69b1f87fa26b422765ba4c08 2026-03-13 23:19:40,025 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 23:19:40,042 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b1f87fa26b422765ba4c08 HTTP/1.1" 200 None 2026-03-13 23:19:40,043 - lava_callback - DEBUG - Processing node 69b1f87fa26b422765ba4c08: baseline-arm64-baylibre 2026-03-13 23:19:40,043 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b1f87fa26b422765ba4c08 2026-03-13 23:19:40,044 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 23:19:40,081 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b1f87fa26b422765ba4c08 HTTP/1.1" 200 None 2026-03-13 23:19:40,082 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 23:19:40,095 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ac4f7446f7ae8ff3364c45 HTTP/1.1" 200 None 2026-03-13 23:19:40,097 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 23:19:40,118 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b1f87fa26b422765ba4c08 HTTP/1.1" 200 None 2026-03-13 23:19:40,124 - lava_callback - ERROR - Error processing callback for node 69b1f87fa26b422765ba4c08: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:34546 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56518 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57760 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34400 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:34402 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50820 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50826 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45512 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38214 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52006 - "GET / HTTP/1.0" 200 OK 2026-03-13 23:21:00,191 - lava_callback - INFO - Received callback for node 69b1f8d0a26b422765ba4c12 INFO: 172.21.0.1:33016 - "POST /node/69b1f8d0a26b422765ba4c12 HTTP/1.0" 202 Accepted 2026-03-13 23:21:00,196 - lava_callback - INFO - Starting async job submit for node 69b1f8d0a26b422765ba4c12 2026-03-13 23:21:00,197 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 23:21:00,212 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b1f8d0a26b422765ba4c12 HTTP/1.1" 200 None 2026-03-13 23:21:00,213 - lava_callback - DEBUG - Processing node 69b1f8d0a26b422765ba4c12: baseline-arm64-baylibre 2026-03-13 23:21:00,214 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b1f8d0a26b422765ba4c12 2026-03-13 23:21:00,214 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 23:21:00,228 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b1f8d0a26b422765ba4c12 HTTP/1.1" 200 None 2026-03-13 23:21:00,229 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 23:21:00,242 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ac4f7446f7ae8ff3364c45 HTTP/1.1" 200 None 2026-03-13 23:21:00,243 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 23:21:00,302 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b1f8d0a26b422765ba4c12 HTTP/1.1" 200 None 2026-03-13 23:21:00,304 - lava_callback - ERROR - Error processing callback for node 69b1f8d0a26b422765ba4c12: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:33032 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57902 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:57910 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34252 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34264 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60330 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57060 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55956 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51052 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59396 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:59410 - "GET / HTTP/1.0" 200 OK 2026-03-13 23:22:20,253 - lava_callback - INFO - Received callback for node 69b1f91fa26b422765ba4c1e INFO: 172.21.0.1:40498 - "POST /node/69b1f91fa26b422765ba4c1e HTTP/1.0" 202 Accepted 2026-03-13 23:22:20,258 - lava_callback - INFO - Starting async job submit for node 69b1f91fa26b422765ba4c1e 2026-03-13 23:22:20,259 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 23:22:20,282 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b1f91fa26b422765ba4c1e HTTP/1.1" 200 None 2026-03-13 23:22:20,283 - lava_callback - DEBUG - Processing node 69b1f91fa26b422765ba4c1e: baseline-arm64-baylibre 2026-03-13 23:22:20,283 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b1f91fa26b422765ba4c1e 2026-03-13 23:22:20,284 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 23:22:20,306 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b1f91fa26b422765ba4c1e HTTP/1.1" 200 None 2026-03-13 23:22:20,308 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 23:22:20,329 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ac4f7446f7ae8ff3364c45 HTTP/1.1" 200 None 2026-03-13 23:22:20,331 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 23:22:20,361 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b1f91fa26b422765ba4c1e HTTP/1.1" 200 None 2026-03-13 23:22:20,362 - lava_callback - ERROR - Error processing callback for node 69b1f91fa26b422765ba4c1e: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:40510 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40512 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60054 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58554 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48354 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40922 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46762 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:46768 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45498 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45504 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35286 - "GET / HTTP/1.0" 200 OK 2026-03-13 23:23:40,272 - lava_callback - INFO - Received callback for node 69b1f96ea26b422765ba4c2b INFO: 172.21.0.1:34436 - "POST /node/69b1f96ea26b422765ba4c2b HTTP/1.0" 202 Accepted 2026-03-13 23:23:40,277 - lava_callback - INFO - Starting async job submit for node 69b1f96ea26b422765ba4c2b 2026-03-13 23:23:40,278 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 23:23:40,315 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b1f96ea26b422765ba4c2b HTTP/1.1" 200 None 2026-03-13 23:23:40,316 - lava_callback - DEBUG - Processing node 69b1f96ea26b422765ba4c2b: baseline-arm64-baylibre 2026-03-13 23:23:40,316 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b1f96ea26b422765ba4c2b 2026-03-13 23:23:40,316 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 23:23:40,351 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b1f96ea26b422765ba4c2b HTTP/1.1" 200 None 2026-03-13 23:23:40,352 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 23:23:40,374 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ac4f7446f7ae8ff3364c45 HTTP/1.1" 200 None 2026-03-13 23:23:40,376 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 23:23:40,427 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b1f96ea26b422765ba4c2b HTTP/1.1" 200 None 2026-03-13 23:23:40,428 - lava_callback - ERROR - Error processing callback for node 69b1f96ea26b422765ba4c2b: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:34440 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39524 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43728 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60330 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:60342 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44718 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44722 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47320 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60334 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60536 - "GET / HTTP/1.0" 200 OK 2026-03-13 23:25:00,333 - lava_callback - INFO - Received callback for node 69b1f9bca26b422765ba4c35 INFO: 172.21.0.1:53594 - "POST /node/69b1f9bca26b422765ba4c35 HTTP/1.0" 202 Accepted 2026-03-13 23:25:00,339 - lava_callback - INFO - Starting async job submit for node 69b1f9bca26b422765ba4c35 2026-03-13 23:25:00,340 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 23:25:00,354 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b1f9bca26b422765ba4c35 HTTP/1.1" 200 None 2026-03-13 23:25:00,355 - lava_callback - DEBUG - Processing node 69b1f9bca26b422765ba4c35: baseline-arm64-baylibre 2026-03-13 23:25:00,355 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b1f9bca26b422765ba4c35 2026-03-13 23:25:00,356 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 23:25:00,391 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b1f9bca26b422765ba4c35 HTTP/1.1" 200 None 2026-03-13 23:25:00,392 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 23:25:00,428 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ac4f7446f7ae8ff3364c45 HTTP/1.1" 200 None 2026-03-13 23:25:00,429 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 23:25:00,449 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b1f9bca26b422765ba4c35 HTTP/1.1" 200 None 2026-03-13 23:25:00,459 - lava_callback - ERROR - Error processing callback for node 69b1f9bca26b422765ba4c35: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:53598 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56526 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:56532 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43994 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43998 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47054 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42118 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55750 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35170 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47698 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:47714 - "GET / HTTP/1.0" 200 OK 2026-03-13 23:26:20,466 - lava_callback - INFO - Received callback for node 69b1fa0aa26b422765ba4c43 INFO: 172.21.0.1:52310 - "POST /node/69b1fa0aa26b422765ba4c43 HTTP/1.0" 202 Accepted 2026-03-13 23:26:20,471 - lava_callback - INFO - Starting async job submit for node 69b1fa0aa26b422765ba4c43 2026-03-13 23:26:20,472 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 23:26:20,487 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b1fa0aa26b422765ba4c43 HTTP/1.1" 200 None 2026-03-13 23:26:20,488 - lava_callback - DEBUG - Processing node 69b1fa0aa26b422765ba4c43: baseline-arm64-baylibre 2026-03-13 23:26:20,488 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b1fa0aa26b422765ba4c43 2026-03-13 23:26:20,488 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 23:26:20,508 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b1fa0aa26b422765ba4c43 HTTP/1.1" 200 None 2026-03-13 23:26:20,509 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 23:26:20,523 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ac4f7446f7ae8ff3364c45 HTTP/1.1" 200 None 2026-03-13 23:26:20,524 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 23:26:20,544 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b1fa0aa26b422765ba4c43 HTTP/1.1" 200 None 2026-03-13 23:26:20,547 - lava_callback - ERROR - Error processing callback for node 69b1fa0aa26b422765ba4c43: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:52322 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52326 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52802 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48672 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47016 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43038 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48430 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:48444 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50630 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50638 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47814 - "GET / HTTP/1.0" 200 OK 2026-03-13 23:27:40,488 - lava_callback - INFO - Received callback for node 69b1fa59a26b422765ba4c51 INFO: 172.21.0.1:55708 - "POST /node/69b1fa59a26b422765ba4c51 HTTP/1.0" 202 Accepted 2026-03-13 23:27:40,493 - lava_callback - INFO - Starting async job submit for node 69b1fa59a26b422765ba4c51 2026-03-13 23:27:40,494 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 23:27:40,509 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b1fa59a26b422765ba4c51 HTTP/1.1" 200 None 2026-03-13 23:27:40,510 - lava_callback - DEBUG - Processing node 69b1fa59a26b422765ba4c51: baseline-arm64-baylibre 2026-03-13 23:27:40,510 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b1fa59a26b422765ba4c51 2026-03-13 23:27:40,511 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 23:27:40,523 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b1fa59a26b422765ba4c51 HTTP/1.1" 200 None 2026-03-13 23:27:40,525 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 23:27:40,544 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ac4f7446f7ae8ff3364c45 HTTP/1.1" 200 None 2026-03-13 23:27:40,546 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 23:27:40,567 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b1fa59a26b422765ba4c51 HTTP/1.1" 200 None 2026-03-13 23:27:40,576 - lava_callback - ERROR - Error processing callback for node 69b1fa59a26b422765ba4c51: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:55710 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53870 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39930 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53630 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:53644 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35290 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35294 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42424 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46938 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52984 - "GET / HTTP/1.0" 200 OK 2026-03-13 23:29:00,536 - lava_callback - INFO - Received callback for node 69b1faa7a26b422765ba4c5c INFO: 172.21.0.1:38366 - "POST /node/69b1faa7a26b422765ba4c5c HTTP/1.0" 202 Accepted 2026-03-13 23:29:00,542 - lava_callback - INFO - Starting async job submit for node 69b1faa7a26b422765ba4c5c 2026-03-13 23:29:00,543 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 23:29:00,557 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b1faa7a26b422765ba4c5c HTTP/1.1" 200 None 2026-03-13 23:29:00,558 - lava_callback - DEBUG - Processing node 69b1faa7a26b422765ba4c5c: baseline-arm64-baylibre 2026-03-13 23:29:00,558 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b1faa7a26b422765ba4c5c 2026-03-13 23:29:00,559 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 23:29:00,572 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b1faa7a26b422765ba4c5c HTTP/1.1" 200 None 2026-03-13 23:29:00,573 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 23:29:00,587 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ac4f7446f7ae8ff3364c45 HTTP/1.1" 200 None 2026-03-13 23:29:00,588 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 23:29:00,614 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b1faa7a26b422765ba4c5c HTTP/1.1" 200 None 2026-03-13 23:29:00,616 - lava_callback - ERROR - Error processing callback for node 69b1faa7a26b422765ba4c5c: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:38368 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39338 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:39352 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48946 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48962 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45038 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37794 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52870 - "GET / HTTP/1.0" 200 OK 2026-03-13 23:30:00,514 - lava_callback - INFO - Received callback for node 69b1faf5a26b422765ba4c6a INFO: 172.21.0.1:51006 - "POST /node/69b1faf5a26b422765ba4c6a HTTP/1.0" 202 Accepted 2026-03-13 23:30:00,520 - lava_callback - INFO - Starting async job submit for node 69b1faf5a26b422765ba4c6a 2026-03-13 23:30:00,520 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 23:30:00,534 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b1faf5a26b422765ba4c6a HTTP/1.1" 200 None 2026-03-13 23:30:00,535 - lava_callback - DEBUG - Processing node 69b1faf5a26b422765ba4c6a: baseline-arm64-baylibre 2026-03-13 23:30:00,535 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b1faf5a26b422765ba4c6a 2026-03-13 23:30:00,536 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 23:30:00,549 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b1faf5a26b422765ba4c6a HTTP/1.1" 200 None 2026-03-13 23:30:00,550 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 23:30:00,575 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ac4f7446f7ae8ff3364c45 HTTP/1.1" 200 None 2026-03-13 23:30:00,576 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 23:30:00,597 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b1faf5a26b422765ba4c6a HTTP/1.1" 200 None 2026-03-13 23:30:00,604 - lava_callback - ERROR - Error processing callback for node 69b1faf5a26b422765ba4c6a: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:51020 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47354 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:47370 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44756 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44766 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35742 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42610 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59704 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33576 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51234 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:51240 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41850 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41864 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58094 - "GET / HTTP/1.0" 200 OK 2026-03-13 23:31:42,564 - lava_callback - INFO - Received callback for node 69b1fb4aa26b422765ba4c77 INFO: 172.21.0.1:42306 - "POST /node/69b1fb4aa26b422765ba4c77 HTTP/1.0" 202 Accepted 2026-03-13 23:31:42,569 - lava_callback - INFO - Starting async job submit for node 69b1fb4aa26b422765ba4c77 2026-03-13 23:31:42,570 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 23:31:42,589 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b1fb4aa26b422765ba4c77 HTTP/1.1" 200 None 2026-03-13 23:31:42,590 - lava_callback - DEBUG - Processing node 69b1fb4aa26b422765ba4c77: baseline-arm64-clabbe 2026-03-13 23:31:42,591 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b1fb4aa26b422765ba4c77 2026-03-13 23:31:42,591 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 23:31:42,605 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b1fb4aa26b422765ba4c77 HTTP/1.1" 200 None 2026-03-13 23:31:42,606 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 23:31:42,619 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ac4f7446f7ae8ff3364c45 HTTP/1.1" 200 None 2026-03-13 23:31:42,620 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 23:31:42,645 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b1fb4aa26b422765ba4c77 HTTP/1.1" 200 None 2026-03-13 23:31:42,652 - lava_callback - ERROR - Error processing callback for node 69b1fb4aa26b422765ba4c77: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:42318 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60334 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57192 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52776 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:52782 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38920 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38932 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35190 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40198 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52942 - "GET / HTTP/1.0" 200 OK 2026-03-13 23:33:02,579 - lava_callback - INFO - Received callback for node 69b1fb9ba26b422765ba4c80 INFO: 172.21.0.1:59618 - "POST /node/69b1fb9ba26b422765ba4c80 HTTP/1.0" 202 Accepted 2026-03-13 23:33:02,585 - lava_callback - INFO - Starting async job submit for node 69b1fb9ba26b422765ba4c80 2026-03-13 23:33:02,586 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 23:33:02,620 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b1fb9ba26b422765ba4c80 HTTP/1.1" 200 None 2026-03-13 23:33:02,621 - lava_callback - DEBUG - Processing node 69b1fb9ba26b422765ba4c80: baseline-arm64-clabbe 2026-03-13 23:33:02,621 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b1fb9ba26b422765ba4c80 2026-03-13 23:33:02,622 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 23:33:02,635 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b1fb9ba26b422765ba4c80 HTTP/1.1" 200 None 2026-03-13 23:33:02,636 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 23:33:02,651 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ac4f7446f7ae8ff3364c45 HTTP/1.1" 200 None 2026-03-13 23:33:02,653 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 23:33:02,677 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b1fb9ba26b422765ba4c80 HTTP/1.1" 200 None 2026-03-13 23:33:02,683 - lava_callback - ERROR - Error processing callback for node 69b1fb9ba26b422765ba4c80: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:59620 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48032 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:48038 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:32826 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:32838 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40308 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35600 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56066 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40224 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42330 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:42342 - "GET / HTTP/1.0" 200 OK 2026-03-13 23:34:22,678 - lava_callback - INFO - Received callback for node 69b1fbeba26b422765ba4c8e INFO: 172.21.0.1:48312 - "POST /node/69b1fbeba26b422765ba4c8e HTTP/1.0" 202 Accepted 2026-03-13 23:34:22,684 - lava_callback - INFO - Starting async job submit for node 69b1fbeba26b422765ba4c8e 2026-03-13 23:34:22,684 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 23:34:22,707 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b1fbeba26b422765ba4c8e HTTP/1.1" 200 None 2026-03-13 23:34:22,708 - lava_callback - DEBUG - Processing node 69b1fbeba26b422765ba4c8e: baseline-arm64-clabbe 2026-03-13 23:34:22,709 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b1fbeba26b422765ba4c8e 2026-03-13 23:34:22,709 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 23:34:22,722 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b1fbeba26b422765ba4c8e HTTP/1.1" 200 None 2026-03-13 23:34:22,724 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 23:34:22,740 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ac4f7446f7ae8ff3364c45 HTTP/1.1" 200 None 2026-03-13 23:34:22,742 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 23:34:22,762 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b1fbeba26b422765ba4c8e HTTP/1.1" 200 None 2026-03-13 23:34:22,767 - lava_callback - ERROR - Error processing callback for node 69b1fbeba26b422765ba4c8e: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:48318 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48320 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38974 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37556 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45868 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60982 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36192 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:36198 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40798 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40810 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37804 - "GET / HTTP/1.0" 200 OK 2026-03-13 23:35:42,760 - lava_callback - INFO - Received callback for node 69b1fc3aa26b422765ba4c9c INFO: 172.21.0.1:44880 - "POST /node/69b1fc3aa26b422765ba4c9c HTTP/1.0" 202 Accepted 2026-03-13 23:35:42,765 - lava_callback - INFO - Starting async job submit for node 69b1fc3aa26b422765ba4c9c 2026-03-13 23:35:42,766 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 23:35:42,781 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b1fc3aa26b422765ba4c9c HTTP/1.1" 200 None 2026-03-13 23:35:42,782 - lava_callback - DEBUG - Processing node 69b1fc3aa26b422765ba4c9c: baseline-arm64-clabbe 2026-03-13 23:35:42,782 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b1fc3aa26b422765ba4c9c 2026-03-13 23:35:42,783 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 23:35:42,796 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b1fc3aa26b422765ba4c9c HTTP/1.1" 200 None 2026-03-13 23:35:42,797 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 23:35:42,810 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ac4f7446f7ae8ff3364c45 HTTP/1.1" 200 None 2026-03-13 23:35:42,811 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 23:35:42,861 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b1fc3aa26b422765ba4c9c HTTP/1.1" 200 None 2026-03-13 23:35:42,862 - lava_callback - ERROR - Error processing callback for node 69b1fc3aa26b422765ba4c9c: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:44882 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46818 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:32952 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33274 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:33290 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46114 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46128 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34756 - "GET / HTTP/1.0" 200 OK 2026-03-13 23:36:40,860 - lava_callback - INFO - Received callback for node 69b1fc82a26b422765ba4ca6 INFO: 172.21.0.1:41560 - "POST /node/69b1fc82a26b422765ba4ca6 HTTP/1.0" 202 Accepted 2026-03-13 23:36:40,866 - lava_callback - INFO - Starting async job submit for node 69b1fc82a26b422765ba4ca6 2026-03-13 23:36:40,867 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 23:36:40,882 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b1fc82a26b422765ba4ca6 HTTP/1.1" 200 None 2026-03-13 23:36:40,883 - lava_callback - DEBUG - Processing node 69b1fc82a26b422765ba4ca6: baseline-arm64-baylibre 2026-03-13 23:36:40,883 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b1fc82a26b422765ba4ca6 2026-03-13 23:36:40,884 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 23:36:40,908 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b1fc82a26b422765ba4ca6 HTTP/1.1" 200 None 2026-03-13 23:36:40,909 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 23:36:40,927 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ac4f7446f7ae8ff3364c45 HTTP/1.1" 200 None 2026-03-13 23:36:40,929 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 23:36:40,957 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b1fc82a26b422765ba4ca6 HTTP/1.1" 200 None 2026-03-13 23:36:40,958 - lava_callback - ERROR - Error processing callback for node 69b1fc82a26b422765ba4ca6: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:41562 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58876 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57900 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35276 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:35278 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51306 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51322 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57324 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37874 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41314 - "GET / HTTP/1.0" 200 OK 2026-03-13 23:38:01,015 - lava_callback - INFO - Received callback for node 69b1fccda26b422765ba4cb3 INFO: 172.21.0.1:34106 - "POST /node/69b1fccda26b422765ba4cb3 HTTP/1.0" 202 Accepted 2026-03-13 23:38:01,021 - lava_callback - INFO - Starting async job submit for node 69b1fccda26b422765ba4cb3 2026-03-13 23:38:01,022 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 23:38:01,036 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b1fccda26b422765ba4cb3 HTTP/1.1" 200 None 2026-03-13 23:38:01,037 - lava_callback - DEBUG - Processing node 69b1fccda26b422765ba4cb3: baseline-arm64-baylibre 2026-03-13 23:38:01,037 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b1fccda26b422765ba4cb3 2026-03-13 23:38:01,038 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 23:38:01,050 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b1fccda26b422765ba4cb3 HTTP/1.1" 200 None 2026-03-13 23:38:01,052 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 23:38:01,070 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aef431ce46d8ec186ab81d HTTP/1.1" 200 None 2026-03-13 23:38:01,071 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 23:38:01,101 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b1fccda26b422765ba4cb3 HTTP/1.1" 200 None 2026-03-13 23:38:01,103 - lava_callback - ERROR - Error processing callback for node 69b1fccda26b422765ba4cb3: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:34114 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35876 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:35886 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53590 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53592 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51172 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54220 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36710 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50358 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59182 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:59186 - "GET / HTTP/1.0" 200 OK 2026-03-13 23:39:22,855 - lava_callback - INFO - Received callback for node 69b1fd23a26b422765ba4cc0 INFO: 172.21.0.1:52130 - "POST /node/69b1fd23a26b422765ba4cc0 HTTP/1.0" 202 Accepted 2026-03-13 23:39:22,861 - lava_callback - INFO - Starting async job submit for node 69b1fd23a26b422765ba4cc0 2026-03-13 23:39:22,862 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 23:39:22,876 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b1fd23a26b422765ba4cc0 HTTP/1.1" 200 None 2026-03-13 23:39:22,876 - lava_callback - DEBUG - Processing node 69b1fd23a26b422765ba4cc0: baseline-arm64-clabbe 2026-03-13 23:39:22,877 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b1fd23a26b422765ba4cc0 2026-03-13 23:39:22,877 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 23:39:22,890 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b1fd23a26b422765ba4cc0 HTTP/1.1" 200 None 2026-03-13 23:39:22,892 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 23:39:22,905 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ac4f7446f7ae8ff3364c45 HTTP/1.1" 200 None 2026-03-13 23:39:22,906 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 23:39:22,943 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b1fd23a26b422765ba4cc0 HTTP/1.1" 200 None 2026-03-13 23:39:22,946 - lava_callback - ERROR - Error processing callback for node 69b1fd23a26b422765ba4cc0: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:52136 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52150 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59812 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50128 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39650 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33760 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36188 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:36196 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58760 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58766 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57044 - "GET / HTTP/1.0" 200 OK 2026-03-13 23:40:41,204 - lava_callback - INFO - Received callback for node 69b1fd6aa26b422765ba4ccb INFO: 172.21.0.1:53446 - "POST /node/69b1fd6aa26b422765ba4ccb HTTP/1.0" 202 Accepted 2026-03-13 23:40:41,210 - lava_callback - INFO - Starting async job submit for node 69b1fd6aa26b422765ba4ccb 2026-03-13 23:40:41,211 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 23:40:41,225 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b1fd6aa26b422765ba4ccb HTTP/1.1" 200 None 2026-03-13 23:40:41,226 - lava_callback - DEBUG - Processing node 69b1fd6aa26b422765ba4ccb: baseline-arm64-baylibre 2026-03-13 23:40:41,226 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b1fd6aa26b422765ba4ccb 2026-03-13 23:40:41,227 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 23:40:41,251 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b1fd6aa26b422765ba4ccb HTTP/1.1" 200 None 2026-03-13 23:40:41,252 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 23:40:41,265 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aef431ce46d8ec186ab81d HTTP/1.1" 200 None 2026-03-13 23:40:41,266 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 23:40:41,287 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b1fd6aa26b422765ba4ccb HTTP/1.1" 200 None 2026-03-13 23:40:41,293 - lava_callback - ERROR - Error processing callback for node 69b1fd6aa26b422765ba4ccb: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:53448 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42470 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46854 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41944 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:41946 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59936 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59946 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48890 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50518 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40544 - "GET / HTTP/1.0" 200 OK 2026-03-13 23:42:02,942 - lava_callback - INFO - Received callback for node 69b1fdc1a26b422765ba4cda INFO: 172.21.0.1:45374 - "POST /node/69b1fdc1a26b422765ba4cda HTTP/1.0" 202 Accepted 2026-03-13 23:42:02,948 - lava_callback - INFO - Starting async job submit for node 69b1fdc1a26b422765ba4cda 2026-03-13 23:42:02,948 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 23:42:02,988 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b1fdc1a26b422765ba4cda HTTP/1.1" 200 None 2026-03-13 23:42:02,989 - lava_callback - DEBUG - Processing node 69b1fdc1a26b422765ba4cda: baseline-arm64-clabbe 2026-03-13 23:42:02,989 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b1fdc1a26b422765ba4cda 2026-03-13 23:42:02,990 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 23:42:03,013 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b1fdc1a26b422765ba4cda HTTP/1.1" 200 None 2026-03-13 23:42:03,014 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 23:42:03,038 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ac4f7446f7ae8ff3364c45 HTTP/1.1" 200 None 2026-03-13 23:42:03,040 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 23:42:03,066 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b1fdc1a26b422765ba4cda HTTP/1.1" 200 None 2026-03-13 23:42:03,068 - lava_callback - ERROR - Error processing callback for node 69b1fdc1a26b422765ba4cda: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:45380 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35704 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:35706 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58598 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58612 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52898 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57968 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41716 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53360 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54434 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:54436 - "GET / HTTP/1.0" 200 OK 2026-03-13 23:43:21,395 - lava_callback - INFO - Received callback for node 69b1fe07a26b422765ba4ce3 INFO: 172.21.0.1:58116 - "POST /node/69b1fe07a26b422765ba4ce3 HTTP/1.0" 202 Accepted 2026-03-13 23:43:21,401 - lava_callback - INFO - Starting async job submit for node 69b1fe07a26b422765ba4ce3 2026-03-13 23:43:21,401 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 23:43:21,448 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b1fe07a26b422765ba4ce3 HTTP/1.1" 200 None 2026-03-13 23:43:21,449 - lava_callback - DEBUG - Processing node 69b1fe07a26b422765ba4ce3: baseline-arm64-baylibre 2026-03-13 23:43:21,449 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b1fe07a26b422765ba4ce3 2026-03-13 23:43:21,450 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 23:43:21,487 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b1fe07a26b422765ba4ce3 HTTP/1.1" 200 None 2026-03-13 23:43:21,488 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 23:43:21,655 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aef431ce46d8ec186ab81d HTTP/1.1" 200 None 2026-03-13 23:43:21,656 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 23:43:21,677 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b1fe07a26b422765ba4ce3 HTTP/1.1" 200 None 2026-03-13 23:43:21,682 - lava_callback - ERROR - Error processing callback for node 69b1fe07a26b422765ba4ce3: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:58126 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58140 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38224 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59590 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41674 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56744 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39916 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:39922 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34464 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34476 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35114 - "GET / HTTP/1.0" 200 OK 2026-03-13 23:44:41,648 - lava_callback - INFO - Received callback for node 69b1fe56a26b422765ba4cf0 INFO: 172.21.0.1:43240 - "POST /node/69b1fe56a26b422765ba4cf0 HTTP/1.0" 202 Accepted 2026-03-13 23:44:41,653 - lava_callback - INFO - Starting async job submit for node 69b1fe56a26b422765ba4cf0 2026-03-13 23:44:41,654 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 23:44:41,668 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b1fe56a26b422765ba4cf0 HTTP/1.1" 200 None 2026-03-13 23:44:41,669 - lava_callback - DEBUG - Processing node 69b1fe56a26b422765ba4cf0: baseline-arm64-baylibre 2026-03-13 23:44:41,669 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b1fe56a26b422765ba4cf0 2026-03-13 23:44:41,670 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 23:44:41,684 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b1fe56a26b422765ba4cf0 HTTP/1.1" 200 None 2026-03-13 23:44:41,685 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 23:44:41,704 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aef431ce46d8ec186ab81d HTTP/1.1" 200 None 2026-03-13 23:44:41,705 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 23:44:41,725 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b1fe56a26b422765ba4cf0 HTTP/1.1" 200 None 2026-03-13 23:44:41,737 - lava_callback - ERROR - Error processing callback for node 69b1fe56a26b422765ba4cf0: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:43248 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33238 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55380 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56154 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:56170 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57876 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57880 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43022 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49542 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52576 - "GET / HTTP/1.0" 200 OK 2026-03-13 23:46:01,436 - lava_callback - INFO - Received callback for node 69b1fea5a26b422765ba4cf9 INFO: 172.21.0.1:56842 - "POST /node/69b1fea5a26b422765ba4cf9 HTTP/1.0" 202 Accepted 2026-03-13 23:46:01,446 - lava_callback - INFO - Starting async job submit for node 69b1fea5a26b422765ba4cf9 2026-03-13 23:46:01,447 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 23:46:01,462 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b1fea5a26b422765ba4cf9 HTTP/1.1" 200 None 2026-03-13 23:46:01,463 - lava_callback - DEBUG - Processing node 69b1fea5a26b422765ba4cf9: baseline-arm64-baylibre 2026-03-13 23:46:01,463 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b1fea5a26b422765ba4cf9 2026-03-13 23:46:01,463 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 23:46:01,476 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b1fea5a26b422765ba4cf9 HTTP/1.1" 200 None 2026-03-13 23:46:01,477 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 23:46:01,490 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aef431ce46d8ec186ab81d HTTP/1.1" 200 None 2026-03-13 23:46:01,492 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 23:46:01,514 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b1fea5a26b422765ba4cf9 HTTP/1.1" 200 None 2026-03-13 23:46:01,521 - lava_callback - ERROR - Error processing callback for node 69b1fea5a26b422765ba4cf9: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:56846 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38272 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:38286 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53978 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53984 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44074 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37826 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50812 - "GET / HTTP/1.0" 200 OK 2026-03-13 23:47:01,425 - lava_callback - INFO - Received callback for node 69b1fef3a26b422765ba4d0d INFO: 172.21.0.1:48936 - "POST /node/69b1fef3a26b422765ba4d0d HTTP/1.0" 202 Accepted 2026-03-13 23:47:01,430 - lava_callback - INFO - Starting async job submit for node 69b1fef3a26b422765ba4d0d 2026-03-13 23:47:01,431 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 23:47:01,447 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b1fef3a26b422765ba4d0d HTTP/1.1" 200 None 2026-03-13 23:47:01,448 - lava_callback - DEBUG - Processing node 69b1fef3a26b422765ba4d0d: baseline-arm64-baylibre 2026-03-13 23:47:01,448 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b1fef3a26b422765ba4d0d 2026-03-13 23:47:01,449 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 23:47:01,462 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b1fef3a26b422765ba4d0d HTTP/1.1" 200 None 2026-03-13 23:47:01,463 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 23:47:01,479 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aef431ce46d8ec186ab81d HTTP/1.1" 200 None 2026-03-13 23:47:01,480 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 23:47:01,503 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b1fef3a26b422765ba4d0d HTTP/1.1" 200 None 2026-03-13 23:47:01,505 - lava_callback - ERROR - Error processing callback for node 69b1fef3a26b422765ba4d0d: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:48948 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56148 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:56150 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:32932 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:32936 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43036 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36874 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48036 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41602 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49396 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:49408 - "GET / HTTP/1.0" 200 OK 2026-03-13 23:48:21,558 - lava_callback - INFO - Received callback for node 69b1ff3da26b422765ba4d18 INFO: 172.21.0.1:56372 - "POST /node/69b1ff3da26b422765ba4d18 HTTP/1.0" 202 Accepted 2026-03-13 23:48:21,563 - lava_callback - INFO - Starting async job submit for node 69b1ff3da26b422765ba4d18 2026-03-13 23:48:21,564 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 23:48:21,578 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b1ff3da26b422765ba4d18 HTTP/1.1" 200 None 2026-03-13 23:48:21,579 - lava_callback - DEBUG - Processing node 69b1ff3da26b422765ba4d18: baseline-arm64-baylibre 2026-03-13 23:48:21,579 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b1ff3da26b422765ba4d18 2026-03-13 23:48:21,580 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 23:48:21,593 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b1ff3da26b422765ba4d18 HTTP/1.1" 200 None 2026-03-13 23:48:21,595 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 23:48:21,615 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aef431ce46d8ec186ab81d HTTP/1.1" 200 None 2026-03-13 23:48:21,616 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 23:48:21,638 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b1ff3da26b422765ba4d18 HTTP/1.1" 200 None 2026-03-13 23:48:21,644 - lava_callback - ERROR - Error processing callback for node 69b1ff3da26b422765ba4d18: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:56388 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56402 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34944 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43888 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49574 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54260 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48104 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:48114 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60192 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60204 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48756 - "GET / HTTP/1.0" 200 OK 2026-03-13 23:49:43,392 - lava_callback - INFO - Received callback for node 69b1ff94a26b422765ba4d23 INFO: 172.21.0.1:45198 - "POST /node/69b1ff94a26b422765ba4d23 HTTP/1.0" 202 Accepted 2026-03-13 23:49:43,397 - lava_callback - INFO - Starting async job submit for node 69b1ff94a26b422765ba4d23 2026-03-13 23:49:43,398 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 23:49:43,412 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b1ff94a26b422765ba4d23 HTTP/1.1" 200 None 2026-03-13 23:49:43,412 - lava_callback - DEBUG - Processing node 69b1ff94a26b422765ba4d23: baseline-arm64-clabbe 2026-03-13 23:49:43,413 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b1ff94a26b422765ba4d23 2026-03-13 23:49:43,413 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 23:49:43,427 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b1ff94a26b422765ba4d23 HTTP/1.1" 200 None 2026-03-13 23:49:43,428 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 23:49:43,442 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aef431ce46d8ec186ab81d HTTP/1.1" 200 None 2026-03-13 23:49:43,444 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 23:49:43,464 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b1ff94a26b422765ba4d23 HTTP/1.1" 200 None 2026-03-13 23:49:43,472 - lava_callback - ERROR - Error processing callback for node 69b1ff94a26b422765ba4d23: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:45208 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44270 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39780 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40974 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:40976 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47482 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47484 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43618 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45418 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54750 - "GET / HTTP/1.0" 200 OK 2026-03-13 23:51:01,928 - lava_callback - INFO - Received callback for node 69b1ffd9a26b422765ba4d2f INFO: 172.21.0.1:49184 - "POST /node/69b1ffd9a26b422765ba4d2f HTTP/1.0" 202 Accepted 2026-03-13 23:51:01,934 - lava_callback - INFO - Starting async job submit for node 69b1ffd9a26b422765ba4d2f 2026-03-13 23:51:01,935 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 23:51:01,949 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b1ffd9a26b422765ba4d2f HTTP/1.1" 200 None 2026-03-13 23:51:01,950 - lava_callback - DEBUG - Processing node 69b1ffd9a26b422765ba4d2f: baseline-arm64-baylibre 2026-03-13 23:51:01,950 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b1ffd9a26b422765ba4d2f 2026-03-13 23:51:01,951 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 23:51:01,964 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b1ffd9a26b422765ba4d2f HTTP/1.1" 200 None 2026-03-13 23:51:01,965 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 23:51:01,995 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aef431ce46d8ec186ab81d HTTP/1.1" 200 None 2026-03-13 23:51:01,997 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 23:51:02,021 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b1ffd9a26b422765ba4d2f HTTP/1.1" 200 None 2026-03-13 23:51:02,022 - lava_callback - ERROR - Error processing callback for node 69b1ffd9a26b422765ba4d2f: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:49188 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48768 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:48770 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52680 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52688 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44160 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42720 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44704 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51532 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45124 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:45138 - "GET / HTTP/1.0" 200 OK 2026-03-13 23:52:21,853 - lava_callback - INFO - Received callback for node 69b20027a26b422765ba4d35 INFO: 172.21.0.1:47386 - "POST /node/69b20027a26b422765ba4d35 HTTP/1.0" 202 Accepted 2026-03-13 23:52:21,859 - lava_callback - INFO - Starting async job submit for node 69b20027a26b422765ba4d35 2026-03-13 23:52:21,859 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 23:52:21,876 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b20027a26b422765ba4d35 HTTP/1.1" 200 None 2026-03-13 23:52:21,877 - lava_callback - DEBUG - Processing node 69b20027a26b422765ba4d35: baseline-arm64-baylibre 2026-03-13 23:52:21,877 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b20027a26b422765ba4d35 2026-03-13 23:52:21,877 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 23:52:21,893 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b20027a26b422765ba4d35 HTTP/1.1" 200 None 2026-03-13 23:52:21,894 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 23:52:21,907 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aef431ce46d8ec186ab81d HTTP/1.1" 200 None 2026-03-13 23:52:21,909 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 23:52:21,931 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b20027a26b422765ba4d35 HTTP/1.1" 200 None 2026-03-13 23:52:21,941 - lava_callback - ERROR - Error processing callback for node 69b20027a26b422765ba4d35: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:47394 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47402 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56094 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35516 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58228 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58328 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38378 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:38394 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39318 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39320 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57764 - "GET / HTTP/1.0" 200 OK 2026-03-13 23:53:43,571 - lava_callback - INFO - Received callback for node 69b2007ca26b422765ba4d40 INFO: 172.21.0.1:37134 - "POST /node/69b2007ca26b422765ba4d40 HTTP/1.0" 202 Accepted 2026-03-13 23:53:43,576 - lava_callback - INFO - Starting async job submit for node 69b2007ca26b422765ba4d40 2026-03-13 23:53:43,577 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 23:53:43,591 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b2007ca26b422765ba4d40 HTTP/1.1" 200 None 2026-03-13 23:53:43,592 - lava_callback - DEBUG - Processing node 69b2007ca26b422765ba4d40: baseline-arm64-clabbe 2026-03-13 23:53:43,593 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b2007ca26b422765ba4d40 2026-03-13 23:53:43,593 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 23:53:43,606 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b2007ca26b422765ba4d40 HTTP/1.1" 200 None 2026-03-13 23:53:43,608 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 23:53:43,621 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aef431ce46d8ec186ab81d HTTP/1.1" 200 None 2026-03-13 23:53:43,622 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 23:53:43,643 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b2007ca26b422765ba4d40 HTTP/1.1" 200 None 2026-03-13 23:53:43,644 - lava_callback - ERROR - Error processing callback for node 69b2007ca26b422765ba4d40: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:37142 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58376 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57994 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49224 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:49234 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36312 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36328 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46828 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55450 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60612 - "GET / HTTP/1.0" 200 OK 2026-03-13 23:55:01,924 - lava_callback - INFO - Received callback for node 69b200c3a26b422765ba4d46 INFO: 172.21.0.1:34236 - "POST /node/69b200c3a26b422765ba4d46 HTTP/1.0" 202 Accepted 2026-03-13 23:55:01,929 - lava_callback - INFO - Starting async job submit for node 69b200c3a26b422765ba4d46 2026-03-13 23:55:01,930 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 23:55:01,945 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b200c3a26b422765ba4d46 HTTP/1.1" 200 None 2026-03-13 23:55:01,947 - lava_callback - DEBUG - Processing node 69b200c3a26b422765ba4d46: baseline-arm64-baylibre 2026-03-13 23:55:01,947 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b200c3a26b422765ba4d46 2026-03-13 23:55:01,948 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 23:55:01,966 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b200c3a26b422765ba4d46 HTTP/1.1" 200 None 2026-03-13 23:55:01,967 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 23:55:01,980 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aef431ce46d8ec186ab81d HTTP/1.1" 200 None 2026-03-13 23:55:01,982 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 23:55:02,002 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b200c3a26b422765ba4d46 HTTP/1.1" 200 None 2026-03-13 23:55:02,004 - lava_callback - ERROR - Error processing callback for node 69b200c3a26b422765ba4d46: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:34246 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49786 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:49802 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33802 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33816 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33250 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49394 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41786 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53896 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49798 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:49808 - "GET / HTTP/1.0" 200 OK 2026-03-13 23:56:23,648 - lava_callback - INFO - Received callback for node 69b20118a26b422765ba4d52 INFO: 172.21.0.1:57326 - "POST /node/69b20118a26b422765ba4d52 HTTP/1.0" 202 Accepted 2026-03-13 23:56:23,653 - lava_callback - INFO - Starting async job submit for node 69b20118a26b422765ba4d52 2026-03-13 23:56:23,654 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 23:56:23,667 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b20118a26b422765ba4d52 HTTP/1.1" 200 None 2026-03-13 23:56:23,668 - lava_callback - DEBUG - Processing node 69b20118a26b422765ba4d52: baseline-arm64-clabbe 2026-03-13 23:56:23,668 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b20118a26b422765ba4d52 2026-03-13 23:56:23,669 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 23:56:23,686 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b20118a26b422765ba4d52 HTTP/1.1" 200 None 2026-03-13 23:56:23,688 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 23:56:23,701 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aef431ce46d8ec186ab81d HTTP/1.1" 200 None 2026-03-13 23:56:23,702 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 23:56:23,723 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b20118a26b422765ba4d52 HTTP/1.1" 200 None 2026-03-13 23:56:23,724 - lava_callback - ERROR - Error processing callback for node 69b20118a26b422765ba4d52: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:57336 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57344 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53038 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48660 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40434 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52190 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42430 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:42444 - "GET / HTTP/1.0" 200 OK 2026-03-13 23:57:22,052 - lava_callback - INFO - Received callback for node 69b2015fa26b422765ba4d5d INFO: 172.21.0.1:58790 - "POST /node/69b2015fa26b422765ba4d5d HTTP/1.0" 202 Accepted 2026-03-13 23:57:22,058 - lava_callback - INFO - Starting async job submit for node 69b2015fa26b422765ba4d5d 2026-03-13 23:57:22,059 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 23:57:22,074 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b2015fa26b422765ba4d5d HTTP/1.1" 200 None 2026-03-13 23:57:22,075 - lava_callback - DEBUG - Processing node 69b2015fa26b422765ba4d5d: baseline-arm64-baylibre 2026-03-13 23:57:22,075 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b2015fa26b422765ba4d5d 2026-03-13 23:57:22,076 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 23:57:22,089 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b2015fa26b422765ba4d5d HTTP/1.1" 200 None 2026-03-13 23:57:22,091 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 23:57:22,115 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aef431ce46d8ec186ab81d HTTP/1.1" 200 None 2026-03-13 23:57:22,116 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 23:57:22,148 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b2015fa26b422765ba4d5d HTTP/1.1" 200 None 2026-03-13 23:57:22,160 - lava_callback - ERROR - Error processing callback for node 69b2015fa26b422765ba4d5d: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:58806 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58816 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51146 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45652 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37170 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54208 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43112 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:43122 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36492 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36498 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55694 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45664 - "GET / HTTP/1.0" 200 OK 2026-03-13 23:58:47,826 - lava_callback - INFO - Received callback for node 69b201b2a26b422765ba4d63 INFO: 172.21.0.1:45676 - "POST /node/69b201b2a26b422765ba4d63 HTTP/1.0" 202 Accepted 2026-03-13 23:58:47,831 - lava_callback - INFO - Starting async job submit for node 69b201b2a26b422765ba4d63 2026-03-13 23:58:47,832 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 23:58:47,846 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b201b2a26b422765ba4d63 HTTP/1.1" 200 None 2026-03-13 23:58:47,846 - lava_callback - DEBUG - Processing node 69b201b2a26b422765ba4d63: baseline-arm64-clabbe 2026-03-13 23:58:47,847 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b201b2a26b422765ba4d63 2026-03-13 23:58:47,847 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 23:58:47,860 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b201b2a26b422765ba4d63 HTTP/1.1" 200 None 2026-03-13 23:58:47,861 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 23:58:47,887 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aef431ce46d8ec186ab81d HTTP/1.1" 200 None 2026-03-13 23:58:47,888 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-13 23:58:47,914 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b201b2a26b422765ba4d63 HTTP/1.1" 200 None 2026-03-13 23:58:47,915 - lava_callback - ERROR - Error processing callback for node 69b201b2a26b422765ba4d63: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:44464 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39732 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34992 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:35004 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38252 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38258 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49392 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46884 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44292 - "GET / HTTP/1.0" 200 OK 2026-03-14 00:00:02,188 - lava_callback - INFO - Received callback for node 69b201f8a26b422765ba4d6f INFO: 172.21.0.1:35846 - "POST /node/69b201f8a26b422765ba4d6f HTTP/1.0" 202 Accepted 2026-03-14 00:00:02,196 - lava_callback - INFO - Starting async job submit for node 69b201f8a26b422765ba4d6f 2026-03-14 00:00:02,197 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 00:00:02,218 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b201f8a26b422765ba4d6f HTTP/1.1" 200 None 2026-03-14 00:00:02,219 - lava_callback - DEBUG - Processing node 69b201f8a26b422765ba4d6f: baseline-arm64-baylibre 2026-03-14 00:00:02,219 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b201f8a26b422765ba4d6f 2026-03-14 00:00:02,220 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 00:00:02,237 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b201f8a26b422765ba4d6f HTTP/1.1" 200 None 2026-03-14 00:00:02,239 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 00:00:02,258 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aef431ce46d8ec186ab81d HTTP/1.1" 200 None 2026-03-14 00:00:02,259 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 00:00:02,291 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b201f8a26b422765ba4d6f HTTP/1.1" 200 None 2026-03-14 00:00:02,292 - lava_callback - ERROR - Error processing callback for node 69b201f8a26b422765ba4d6f: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:35862 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60700 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:60710 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42992 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43004 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36678 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55270 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53622 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40922 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57366 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:57370 - "GET / HTTP/1.0" 200 OK 2026-03-14 00:01:23,900 - lava_callback - INFO - Received callback for node 69b2024da26b422765ba4d77 INFO: 172.21.0.1:56166 - "POST /node/69b2024da26b422765ba4d77 HTTP/1.0" 202 Accepted 2026-03-14 00:01:23,908 - lava_callback - INFO - Starting async job submit for node 69b2024da26b422765ba4d77 2026-03-14 00:01:23,909 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 00:01:23,932 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b2024da26b422765ba4d77 HTTP/1.1" 200 None 2026-03-14 00:01:23,933 - lava_callback - DEBUG - Processing node 69b2024da26b422765ba4d77: baseline-arm64-clabbe 2026-03-14 00:01:23,933 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b2024da26b422765ba4d77 2026-03-14 00:01:23,934 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 00:01:23,956 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b2024da26b422765ba4d77 HTTP/1.1" 200 None 2026-03-14 00:01:23,957 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 00:01:23,975 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aef431ce46d8ec186ab81d HTTP/1.1" 200 None 2026-03-14 00:01:23,977 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 00:01:24,019 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b2024da26b422765ba4d77 HTTP/1.1" 200 None 2026-03-14 00:01:24,020 - lava_callback - ERROR - Error processing callback for node 69b2024da26b422765ba4d77: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:56176 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56184 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33576 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42362 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53816 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56840 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45552 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:45556 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59498 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59510 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49354 - "GET / HTTP/1.0" 200 OK 2026-03-14 00:02:43,925 - lava_callback - INFO - Received callback for node 69b2029da26b422765ba4d7d INFO: 172.21.0.1:48008 - "POST /node/69b2029da26b422765ba4d7d HTTP/1.0" 202 Accepted 2026-03-14 00:02:43,930 - lava_callback - INFO - Starting async job submit for node 69b2029da26b422765ba4d7d 2026-03-14 00:02:43,931 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 00:02:43,953 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b2029da26b422765ba4d7d HTTP/1.1" 200 None 2026-03-14 00:02:43,954 - lava_callback - DEBUG - Processing node 69b2029da26b422765ba4d7d: baseline-arm64-clabbe 2026-03-14 00:02:43,954 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b2029da26b422765ba4d7d 2026-03-14 00:02:43,955 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 00:02:43,968 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b2029da26b422765ba4d7d HTTP/1.1" 200 None 2026-03-14 00:02:43,969 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 00:02:43,982 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aef431ce46d8ec186ab81d HTTP/1.1" 200 None 2026-03-14 00:02:43,983 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 00:02:44,005 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b2029da26b422765ba4d7d HTTP/1.1" 200 None 2026-03-14 00:02:44,010 - lava_callback - ERROR - Error processing callback for node 69b2029da26b422765ba4d7d: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:48022 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55730 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55342 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53248 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:53260 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52896 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52898 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52498 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52796 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51340 - "GET / HTTP/1.0" 200 OK 2026-03-14 00:04:03,963 - lava_callback - INFO - Received callback for node 69b202eca26b422765ba4d87 INFO: 172.21.0.1:33158 - "POST /node/69b202eca26b422765ba4d87 HTTP/1.0" 202 Accepted 2026-03-14 00:04:03,968 - lava_callback - INFO - Starting async job submit for node 69b202eca26b422765ba4d87 2026-03-14 00:04:03,969 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 00:04:03,983 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b202eca26b422765ba4d87 HTTP/1.1" 200 None 2026-03-14 00:04:03,983 - lava_callback - DEBUG - Processing node 69b202eca26b422765ba4d87: baseline-arm64-clabbe 2026-03-14 00:04:03,984 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b202eca26b422765ba4d87 2026-03-14 00:04:03,984 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 00:04:03,997 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b202eca26b422765ba4d87 HTTP/1.1" 200 None 2026-03-14 00:04:03,998 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 00:04:04,012 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aef431ce46d8ec186ab81d HTTP/1.1" 200 None 2026-03-14 00:04:04,013 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 00:04:04,038 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b202eca26b422765ba4d87 HTTP/1.1" 200 None 2026-03-14 00:04:04,039 - lava_callback - ERROR - Error processing callback for node 69b202eca26b422765ba4d87: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:33166 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33768 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:33780 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57534 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57548 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34096 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42038 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60526 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44184 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56092 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:56104 - "GET / HTTP/1.0" 200 OK 2026-03-14 00:05:24,034 - lava_callback - INFO - Received callback for node 69b2033aa26b422765ba4d8c INFO: 172.21.0.1:58264 - "POST /node/69b2033aa26b422765ba4d8c HTTP/1.0" 202 Accepted 2026-03-14 00:05:24,040 - lava_callback - INFO - Starting async job submit for node 69b2033aa26b422765ba4d8c 2026-03-14 00:05:24,040 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 00:05:24,054 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b2033aa26b422765ba4d8c HTTP/1.1" 200 None 2026-03-14 00:05:24,055 - lava_callback - DEBUG - Processing node 69b2033aa26b422765ba4d8c: baseline-arm64-clabbe 2026-03-14 00:05:24,056 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b2033aa26b422765ba4d8c 2026-03-14 00:05:24,056 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 00:05:24,069 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b2033aa26b422765ba4d8c HTTP/1.1" 200 None 2026-03-14 00:05:24,071 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 00:05:24,088 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aef431ce46d8ec186ab81d HTTP/1.1" 200 None 2026-03-14 00:05:24,090 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 00:05:24,109 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b2033aa26b422765ba4d8c HTTP/1.1" 200 None 2026-03-14 00:05:24,114 - lava_callback - ERROR - Error processing callback for node 69b2033aa26b422765ba4d8c: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:58278 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58286 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39682 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36788 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53388 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56484 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38564 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:38568 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33196 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33210 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36558 - "GET / HTTP/1.0" 200 OK 2026-03-14 00:06:44,100 - lava_callback - INFO - Received callback for node 69b2038aa26b422765ba4d96 INFO: 172.21.0.1:56416 - "POST /node/69b2038aa26b422765ba4d96 HTTP/1.0" 202 Accepted 2026-03-14 00:06:44,106 - lava_callback - INFO - Starting async job submit for node 69b2038aa26b422765ba4d96 2026-03-14 00:06:44,106 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 00:06:44,121 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b2038aa26b422765ba4d96 HTTP/1.1" 200 None 2026-03-14 00:06:44,122 - lava_callback - DEBUG - Processing node 69b2038aa26b422765ba4d96: baseline-arm64-clabbe 2026-03-14 00:06:44,122 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b2038aa26b422765ba4d96 2026-03-14 00:06:44,123 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 00:06:44,147 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b2038aa26b422765ba4d96 HTTP/1.1" 200 None 2026-03-14 00:06:44,149 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 00:06:44,162 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aef431ce46d8ec186ab81d HTTP/1.1" 200 None 2026-03-14 00:06:44,163 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 00:06:44,184 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b2038aa26b422765ba4d96 HTTP/1.1" 200 None 2026-03-14 00:06:44,191 - lava_callback - ERROR - Error processing callback for node 69b2038aa26b422765ba4d96: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:56420 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37534 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45754 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42232 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:42244 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56670 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56680 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53888 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34678 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37538 - "GET / HTTP/1.0" 200 OK 2026-03-14 00:08:04,131 - lava_callback - INFO - Received callback for node 69b203d9a26b422765ba4d9f INFO: 172.21.0.1:42164 - "POST /node/69b203d9a26b422765ba4d9f HTTP/1.0" 202 Accepted 2026-03-14 00:08:04,136 - lava_callback - INFO - Starting async job submit for node 69b203d9a26b422765ba4d9f 2026-03-14 00:08:04,137 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 00:08:04,152 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b203d9a26b422765ba4d9f HTTP/1.1" 200 None 2026-03-14 00:08:04,153 - lava_callback - DEBUG - Processing node 69b203d9a26b422765ba4d9f: baseline-arm64-clabbe 2026-03-14 00:08:04,153 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b203d9a26b422765ba4d9f 2026-03-14 00:08:04,153 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 00:08:04,168 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b203d9a26b422765ba4d9f HTTP/1.1" 200 None 2026-03-14 00:08:04,170 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 00:08:04,183 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aef431ce46d8ec186ab81d HTTP/1.1" 200 None 2026-03-14 00:08:04,184 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 00:08:04,205 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b203d9a26b422765ba4d9f HTTP/1.1" 200 None 2026-03-14 00:08:04,206 - lava_callback - ERROR - Error processing callback for node 69b203d9a26b422765ba4d9f: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:42180 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48710 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:48726 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55426 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55440 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45372 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45374 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44770 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46910 - "GET /favicon.ico HTTP/1.0" 404 Not Found INFO: 172.21.0.1:46912 - "GET /robots.txt HTTP/1.0" 404 Not Found INFO: 172.21.0.1:46924 - "GET /sitemap.xml HTTP/1.0" 404 Not Found INFO: 172.21.0.1:46926 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46940 - "GET /config.json HTTP/1.0" 404 Not Found INFO: 172.21.0.1:60868 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55078 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:55086 - "GET / HTTP/1.0" 200 OK 2026-03-14 00:09:24,204 - lava_callback - INFO - Received callback for node 69b20429a26b422765ba4da4 INFO: 172.21.0.1:49686 - "POST /node/69b20429a26b422765ba4da4 HTTP/1.0" 202 Accepted 2026-03-14 00:09:24,210 - lava_callback - INFO - Starting async job submit for node 69b20429a26b422765ba4da4 2026-03-14 00:09:24,211 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 00:09:24,227 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b20429a26b422765ba4da4 HTTP/1.1" 200 None 2026-03-14 00:09:24,228 - lava_callback - DEBUG - Processing node 69b20429a26b422765ba4da4: baseline-arm64-clabbe 2026-03-14 00:09:24,228 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b20429a26b422765ba4da4 2026-03-14 00:09:24,229 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 00:09:24,248 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b20429a26b422765ba4da4 HTTP/1.1" 200 None 2026-03-14 00:09:24,250 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 00:09:24,263 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aef431ce46d8ec186ab81d HTTP/1.1" 200 None 2026-03-14 00:09:24,264 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 00:09:24,285 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b20429a26b422765ba4da4 HTTP/1.1" 200 None 2026-03-14 00:09:24,300 - lava_callback - ERROR - Error processing callback for node 69b20429a26b422765ba4da4: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:49700 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49714 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35746 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41816 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56260 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36078 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55254 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:55270 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38074 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38090 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41320 - "GET / HTTP/1.0" 200 OK 2026-03-14 00:10:44,264 - lava_callback - INFO - Received callback for node 69b20479a26b422765ba4dae INFO: 172.21.0.1:45388 - "POST /node/69b20479a26b422765ba4dae HTTP/1.0" 202 Accepted 2026-03-14 00:10:44,272 - lava_callback - INFO - Starting async job submit for node 69b20479a26b422765ba4dae 2026-03-14 00:10:44,273 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 00:10:44,291 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b20479a26b422765ba4dae HTTP/1.1" 200 None 2026-03-14 00:10:44,292 - lava_callback - DEBUG - Processing node 69b20479a26b422765ba4dae: baseline-arm64-clabbe 2026-03-14 00:10:44,292 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b20479a26b422765ba4dae 2026-03-14 00:10:44,292 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 00:10:44,305 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b20479a26b422765ba4dae HTTP/1.1" 200 None 2026-03-14 00:10:44,307 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 00:10:44,328 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aef431ce46d8ec186ab81d HTTP/1.1" 200 None 2026-03-14 00:10:44,329 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 00:10:44,356 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b20479a26b422765ba4dae HTTP/1.1" 200 None 2026-03-14 00:10:44,357 - lava_callback - ERROR - Error processing callback for node 69b20479a26b422765ba4dae: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:45390 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49178 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60958 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41026 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:41028 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40354 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40358 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49874 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44696 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40040 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57848 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38820 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:38830 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55590 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55594 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47498 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40928 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38008 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43432 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38218 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:38232 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48156 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48158 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56258 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50132 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44442 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43746 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47994 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:48008 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57630 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57638 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35136 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53116 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35332 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54356 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51810 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:51816 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33244 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33246 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52082 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46606 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37434 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56462 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48384 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:48392 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34562 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34578 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49230 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34016 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39062 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41026 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59894 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:59906 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34254 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34256 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53092 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41678 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39250 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55612 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39082 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:39092 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47398 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47408 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44716 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50166 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50170 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37046 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50846 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50854 - "GET /favicon.ico HTTP/1.0" 404 Not Found INFO: 172.21.0.1:34210 - "GET /robots.txt HTTP/1.0" 404 Not Found INFO: 172.21.0.1:34212 - "GET /sitemap.xml HTTP/1.0" 404 Not Found INFO: 172.21.0.1:34224 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:34230 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51026 - "GET /config.json HTTP/1.0" 404 Not Found INFO: 172.21.0.1:51030 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51034 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37864 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54016 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41126 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43080 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54534 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:54550 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41862 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41876 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54078 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53926 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52064 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48422 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39796 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:39810 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38346 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38356 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36442 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44132 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57344 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39806 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42312 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:42324 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58328 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58338 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46826 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53746 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57304 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40248 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:32798 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:32802 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56706 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56712 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53736 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45432 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:32864 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41754 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56904 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:56920 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36022 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36038 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55128 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42888 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33950 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33032 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56448 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:56462 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41858 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41866 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55748 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47522 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49304 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50144 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53584 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:53588 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40618 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40630 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57032 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51380 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40512 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51214 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56752 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:56760 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55840 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55842 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57026 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42736 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54440 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39926 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38282 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:38292 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44966 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44982 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37620 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55606 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36072 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40246 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57334 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:57342 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51384 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51398 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43746 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54870 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55470 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46730 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46696 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:46700 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43142 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43144 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41888 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38126 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41222 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38482 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48238 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:48252 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45350 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45358 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52004 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56066 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45460 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57882 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42066 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:42082 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46804 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46820 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57404 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46174 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56952 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33530 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45378 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:45388 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34638 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34650 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47206 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53222 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37256 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53912 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43016 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:43024 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59168 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59182 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46502 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53322 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60488 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42450 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46478 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:46494 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38814 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38820 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55712 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41114 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35734 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57794 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60726 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:60736 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54932 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54938 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44542 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38088 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51560 - "GET / HTTP/1.0" 200 OK 2026-03-14 00:37:04,733 - lava_callback - INFO - Received callback for node 69b20aa2b0f5558b5d7cc9fa INFO: 172.21.0.1:38382 - "POST /node/69b20aa2b0f5558b5d7cc9fa HTTP/1.0" 202 Accepted 2026-03-14 00:37:04,738 - lava_callback - INFO - Starting async job submit for node 69b20aa2b0f5558b5d7cc9fa 2026-03-14 00:37:04,740 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 00:37:04,759 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b20aa2b0f5558b5d7cc9fa HTTP/1.1" 200 None 2026-03-14 00:37:04,760 - lava_callback - DEBUG - Processing node 69b20aa2b0f5558b5d7cc9fa: baseline-arm-baylibre 2026-03-14 00:37:04,760 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b20aa2b0f5558b5d7cc9fa 2026-03-14 00:37:04,761 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 00:37:04,797 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b20aa2b0f5558b5d7cc9fa HTTP/1.1" 200 None 2026-03-14 00:37:04,799 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 00:37:04,826 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69af632c275c8d3b79399db4 HTTP/1.1" 200 None 2026-03-14 00:37:04,827 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 00:37:04,851 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b20aa2b0f5558b5d7cc9fa HTTP/1.1" 200 None 2026-03-14 00:37:04,857 - lava_callback - ERROR - Error processing callback for node 69b20aa2b0f5558b5d7cc9fa: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:38398 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52924 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52938 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:52950 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55978 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55986 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42310 - "GET / HTTP/1.0" 200 OK 2026-03-14 00:37:44,176 - lava_callback - INFO - Received callback for node 69b20ac8b0f5558b5d7cca0d INFO: 172.21.0.1:35748 - "POST /node/69b20ac8b0f5558b5d7cca0d HTTP/1.0" 202 Accepted 2026-03-14 00:37:44,182 - lava_callback - INFO - Starting async job submit for node 69b20ac8b0f5558b5d7cca0d 2026-03-14 00:37:44,182 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 00:37:44,196 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b20ac8b0f5558b5d7cca0d HTTP/1.1" 200 None 2026-03-14 00:37:44,197 - lava_callback - DEBUG - Processing node 69b20ac8b0f5558b5d7cca0d: baseline-arm-baylibre 2026-03-14 00:37:44,198 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b20ac8b0f5558b5d7cca0d 2026-03-14 00:37:44,198 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 00:37:44,211 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b20ac8b0f5558b5d7cca0d HTTP/1.1" 200 None 2026-03-14 00:37:44,213 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 00:37:44,226 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69af632c275c8d3b79399db4 HTTP/1.1" 200 None 2026-03-14 00:37:44,228 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 00:37:44,248 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b20ac8b0f5558b5d7cca0d HTTP/1.1" 200 None 2026-03-14 00:37:44,255 - lava_callback - ERROR - Error processing callback for node 69b20ac8b0f5558b5d7cca0d: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:35752 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35758 - "GET /robots.txt HTTP/1.0" 404 Not Found INFO: 172.21.0.1:55340 - "GET /sitemap.xml HTTP/1.0" 404 Not Found INFO: 172.21.0.1:55342 - "GET /config.json HTTP/1.0" 404 Not Found INFO: 172.21.0.1:55346 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39756 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40054 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:40062 - "GET / HTTP/1.0" 200 OK 2026-03-14 00:38:24,301 - lava_callback - INFO - Received callback for node 69b20aecb0f5558b5d7cca16 INFO: 172.21.0.1:37158 - "POST /node/69b20aecb0f5558b5d7cca16 HTTP/1.0" 202 Accepted 2026-03-14 00:38:24,306 - lava_callback - INFO - Starting async job submit for node 69b20aecb0f5558b5d7cca16 2026-03-14 00:38:24,307 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 00:38:24,321 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b20aecb0f5558b5d7cca16 HTTP/1.1" 200 None 2026-03-14 00:38:24,322 - lava_callback - DEBUG - Processing node 69b20aecb0f5558b5d7cca16: baseline-arm-baylibre 2026-03-14 00:38:24,322 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b20aecb0f5558b5d7cca16 2026-03-14 00:38:24,323 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 00:38:24,337 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b20aecb0f5558b5d7cca16 HTTP/1.1" 200 None 2026-03-14 00:38:24,338 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 00:38:24,352 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69af632c275c8d3b79399db4 HTTP/1.1" 200 None 2026-03-14 00:38:24,354 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 00:38:24,382 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b20aecb0f5558b5d7cca16 HTTP/1.1" 200 None 2026-03-14 00:38:24,384 - lava_callback - ERROR - Error processing callback for node 69b20aecb0f5558b5d7cca16: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:37162 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37174 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56634 - "GET / HTTP/1.0" 200 OK 2026-03-14 00:38:44,276 - lava_callback - INFO - Received callback for node 69b20b10b0f5558b5d7cca21 INFO: 172.21.0.1:48074 - "POST /node/69b20b10b0f5558b5d7cca21 HTTP/1.0" 202 Accepted 2026-03-14 00:38:44,282 - lava_callback - INFO - Starting async job submit for node 69b20b10b0f5558b5d7cca21 2026-03-14 00:38:44,282 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 00:38:44,296 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b20b10b0f5558b5d7cca21 HTTP/1.1" 200 None 2026-03-14 00:38:44,297 - lava_callback - DEBUG - Processing node 69b20b10b0f5558b5d7cca21: baseline-arm-baylibre 2026-03-14 00:38:44,298 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b20b10b0f5558b5d7cca21 2026-03-14 00:38:44,298 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 00:38:44,311 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b20b10b0f5558b5d7cca21 HTTP/1.1" 200 None 2026-03-14 00:38:44,313 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 00:38:44,325 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69af632c275c8d3b79399db4 HTTP/1.1" 200 None 2026-03-14 00:38:44,327 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 00:38:44,347 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b20b10b0f5558b5d7cca21 HTTP/1.1" 200 None 2026-03-14 00:38:44,348 - lava_callback - ERROR - Error processing callback for node 69b20b10b0f5558b5d7cca21: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:48076 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52996 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34980 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49762 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:49770 - "GET / HTTP/1.0" 200 OK 2026-03-14 00:39:24,313 - lava_callback - INFO - Received callback for node 69b20b35b0f5558b5d7cca29 INFO: 172.21.0.1:58120 - "POST /node/69b20b35b0f5558b5d7cca29 HTTP/1.0" 202 Accepted 2026-03-14 00:39:24,318 - lava_callback - INFO - Starting async job submit for node 69b20b35b0f5558b5d7cca29 2026-03-14 00:39:24,319 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 00:39:24,333 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b20b35b0f5558b5d7cca29 HTTP/1.1" 200 None 2026-03-14 00:39:24,334 - lava_callback - DEBUG - Processing node 69b20b35b0f5558b5d7cca29: baseline-arm-baylibre 2026-03-14 00:39:24,334 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b20b35b0f5558b5d7cca29 2026-03-14 00:39:24,335 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 00:39:24,347 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b20b35b0f5558b5d7cca29 HTTP/1.1" 200 None 2026-03-14 00:39:24,349 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 00:39:24,362 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69af632c275c8d3b79399db4 HTTP/1.1" 200 None 2026-03-14 00:39:24,363 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 00:39:24,384 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b20b35b0f5558b5d7cca29 HTTP/1.1" 200 None 2026-03-14 00:39:24,388 - lava_callback - ERROR - Error processing callback for node 69b20b35b0f5558b5d7cca29: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:58132 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58144 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56364 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36460 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46800 - "GET / HTTP/1.0" 200 OK 2026-03-14 00:40:04,389 - lava_callback - INFO - Received callback for node 69b20b59b0f5558b5d7cca33 INFO: 172.21.0.1:50636 - "POST /node/69b20b59b0f5558b5d7cca33 HTTP/1.0" 202 Accepted 2026-03-14 00:40:04,395 - lava_callback - INFO - Starting async job submit for node 69b20b59b0f5558b5d7cca33 2026-03-14 00:40:04,396 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 00:40:04,411 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b20b59b0f5558b5d7cca33 HTTP/1.1" 200 None 2026-03-14 00:40:04,412 - lava_callback - DEBUG - Processing node 69b20b59b0f5558b5d7cca33: baseline-arm-baylibre 2026-03-14 00:40:04,412 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b20b59b0f5558b5d7cca33 2026-03-14 00:40:04,412 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 00:40:04,431 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b20b59b0f5558b5d7cca33 HTTP/1.1" 200 None 2026-03-14 00:40:04,432 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 00:40:04,448 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69af632c275c8d3b79399db4 HTTP/1.1" 200 None 2026-03-14 00:40:04,449 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 00:40:04,471 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b20b59b0f5558b5d7cca33 HTTP/1.1" 200 None 2026-03-14 00:40:04,482 - lava_callback - ERROR - Error processing callback for node 69b20b59b0f5558b5d7cca33: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:50644 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33032 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:33036 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36126 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36138 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40448 - "GET / HTTP/1.0" 200 OK 2026-03-14 00:40:45,568 - lava_callback - INFO - Received callback for node 69b20b7eb0f5558b5d7cca3c INFO: 172.21.0.1:38352 - "POST /node/69b20b7eb0f5558b5d7cca3c HTTP/1.0" 202 Accepted 2026-03-14 00:40:45,573 - lava_callback - INFO - Starting async job submit for node 69b20b7eb0f5558b5d7cca3c 2026-03-14 00:40:45,574 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 00:40:45,588 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b20b7eb0f5558b5d7cca3c HTTP/1.1" 200 None 2026-03-14 00:40:45,589 - lava_callback - DEBUG - Processing node 69b20b7eb0f5558b5d7cca3c: baseline-arm-clabbe 2026-03-14 00:40:45,589 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b20b7eb0f5558b5d7cca3c 2026-03-14 00:40:45,590 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 00:40:45,613 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b20b7eb0f5558b5d7cca3c HTTP/1.1" 200 None 2026-03-14 00:40:45,615 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 00:40:45,635 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69af632c275c8d3b79399db4 HTTP/1.1" 200 None 2026-03-14 00:40:45,636 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 00:40:45,658 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b20b7eb0f5558b5d7cca3c HTTP/1.1" 200 None 2026-03-14 00:40:45,660 - lava_callback - ERROR - Error processing callback for node 69b20b7eb0f5558b5d7cca3c: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:38366 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42358 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44976 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58854 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:58860 - "GET / HTTP/1.0" 200 OK 2026-03-14 00:41:25,567 - lava_callback - INFO - Received callback for node 69b20ba3b0f5558b5d7cca47 INFO: 172.21.0.1:40334 - "POST /node/69b20ba3b0f5558b5d7cca47 HTTP/1.0" 202 Accepted 2026-03-14 00:41:25,572 - lava_callback - INFO - Starting async job submit for node 69b20ba3b0f5558b5d7cca47 2026-03-14 00:41:25,573 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 00:41:25,587 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b20ba3b0f5558b5d7cca47 HTTP/1.1" 200 None 2026-03-14 00:41:25,588 - lava_callback - DEBUG - Processing node 69b20ba3b0f5558b5d7cca47: baseline-arm-clabbe 2026-03-14 00:41:25,588 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b20ba3b0f5558b5d7cca47 2026-03-14 00:41:25,589 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 00:41:25,636 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b20ba3b0f5558b5d7cca47 HTTP/1.1" 200 None 2026-03-14 00:41:25,637 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 00:41:25,651 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69af632c275c8d3b79399db4 HTTP/1.1" 200 None 2026-03-14 00:41:25,653 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 00:41:25,673 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b20ba3b0f5558b5d7cca47 HTTP/1.1" 200 None 2026-03-14 00:41:25,686 - lava_callback - ERROR - Error processing callback for node 69b20ba3b0f5558b5d7cca47: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:40340 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40350 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56198 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51746 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40404 - "GET / HTTP/1.0" 200 OK 2026-03-14 00:42:05,897 - lava_callback - INFO - Received callback for node 69b20bc8b0f5558b5d7cca53 INFO: 172.21.0.1:45622 - "POST /node/69b20bc8b0f5558b5d7cca53 HTTP/1.0" 202 Accepted 2026-03-14 00:42:05,902 - lava_callback - INFO - Starting async job submit for node 69b20bc8b0f5558b5d7cca53 2026-03-14 00:42:05,903 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 00:42:05,939 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b20bc8b0f5558b5d7cca53 HTTP/1.1" 200 None 2026-03-14 00:42:05,940 - lava_callback - DEBUG - Processing node 69b20bc8b0f5558b5d7cca53: baseline-arm-clabbe 2026-03-14 00:42:05,940 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b20bc8b0f5558b5d7cca53 2026-03-14 00:42:05,941 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 00:42:05,954 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b20bc8b0f5558b5d7cca53 HTTP/1.1" 200 None 2026-03-14 00:42:05,955 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 00:42:05,977 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69af632c275c8d3b79399db4 HTTP/1.1" 200 None 2026-03-14 00:42:05,978 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 00:42:05,998 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b20bc8b0f5558b5d7cca53 HTTP/1.1" 200 None 2026-03-14 00:42:05,999 - lava_callback - ERROR - Error processing callback for node 69b20bc8b0f5558b5d7cca53: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:45628 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45600 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:45612 - "GET / HTTP/1.0" 200 OK 2026-03-14 00:42:25,590 - lava_callback - INFO - Received callback for node 69b20bedb0f5558b5d7cca5a INFO: 172.21.0.1:48166 - "POST /node/69b20bedb0f5558b5d7cca5a HTTP/1.0" 202 Accepted 2026-03-14 00:42:25,596 - lava_callback - INFO - Starting async job submit for node 69b20bedb0f5558b5d7cca5a 2026-03-14 00:42:25,596 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 00:42:25,613 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b20bedb0f5558b5d7cca5a HTTP/1.1" 200 None 2026-03-14 00:42:25,614 - lava_callback - DEBUG - Processing node 69b20bedb0f5558b5d7cca5a: baseline-arm-clabbe 2026-03-14 00:42:25,614 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b20bedb0f5558b5d7cca5a 2026-03-14 00:42:25,615 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 00:42:25,628 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b20bedb0f5558b5d7cca5a HTTP/1.1" 200 None 2026-03-14 00:42:25,629 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 00:42:25,651 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69af632c275c8d3b79399db4 HTTP/1.1" 200 None 2026-03-14 00:42:25,652 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 00:42:25,672 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b20bedb0f5558b5d7cca5a HTTP/1.1" 200 None 2026-03-14 00:42:25,673 - lava_callback - ERROR - Error processing callback for node 69b20bedb0f5558b5d7cca5a: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:48174 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48188 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42798 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59260 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53496 - "GET / HTTP/1.0" 200 OK 2026-03-14 00:43:05,661 - lava_callback - INFO - Received callback for node 69b20c11b0f5558b5d7cca67 INFO: 172.21.0.1:43260 - "POST /node/69b20c11b0f5558b5d7cca67 HTTP/1.0" 202 Accepted 2026-03-14 00:43:05,666 - lava_callback - INFO - Starting async job submit for node 69b20c11b0f5558b5d7cca67 2026-03-14 00:43:05,668 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 00:43:05,696 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b20c11b0f5558b5d7cca67 HTTP/1.1" 200 None 2026-03-14 00:43:05,697 - lava_callback - DEBUG - Processing node 69b20c11b0f5558b5d7cca67: baseline-arm-clabbe 2026-03-14 00:43:05,697 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b20c11b0f5558b5d7cca67 2026-03-14 00:43:05,698 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 00:43:05,711 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b20c11b0f5558b5d7cca67 HTTP/1.1" 200 None 2026-03-14 00:43:05,712 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 00:43:05,729 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69af632c275c8d3b79399db4 HTTP/1.1" 200 None 2026-03-14 00:43:05,731 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 00:43:05,752 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b20c11b0f5558b5d7cca67 HTTP/1.1" 200 None 2026-03-14 00:43:05,753 - lava_callback - ERROR - Error processing callback for node 69b20c11b0f5558b5d7cca67: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:43264 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45966 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:45970 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46332 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46342 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50240 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49582 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46886 - "GET / HTTP/1.0" 200 OK 2026-03-14 00:44:05,698 - lava_callback - INFO - Received callback for node 69b20c46b0f5558b5d7cca76 INFO: 172.21.0.1:34692 - "POST /node/69b20c46b0f5558b5d7cca76 HTTP/1.0" 202 Accepted 2026-03-14 00:44:05,704 - lava_callback - INFO - Starting async job submit for node 69b20c46b0f5558b5d7cca76 2026-03-14 00:44:05,705 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 00:44:05,733 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b20c46b0f5558b5d7cca76 HTTP/1.1" 200 None 2026-03-14 00:44:05,734 - lava_callback - DEBUG - Processing node 69b20c46b0f5558b5d7cca76: baseline-arm-clabbe 2026-03-14 00:44:05,734 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b20c46b0f5558b5d7cca76 2026-03-14 00:44:05,735 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 00:44:05,755 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b20c46b0f5558b5d7cca76 HTTP/1.1" 200 None 2026-03-14 00:44:05,757 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 00:44:05,804 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aa1d368c4d487a0e751145 HTTP/1.1" 200 None 2026-03-14 00:44:05,805 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 00:44:05,827 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b20c46b0f5558b5d7cca76 HTTP/1.1" 200 None 2026-03-14 00:44:05,829 - lava_callback - ERROR - Error processing callback for node 69b20c46b0f5558b5d7cca76: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:34704 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35248 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:35258 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38464 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38478 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44424 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58128 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57106 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55438 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52116 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:52130 - "GET / HTTP/1.0" 200 OK 2026-03-14 00:45:25,754 - lava_callback - INFO - Received callback for node 69b20c97b0f5558b5d7cca86 INFO: 172.21.0.1:58562 - "POST /node/69b20c97b0f5558b5d7cca86 HTTP/1.0" 202 Accepted 2026-03-14 00:45:25,760 - lava_callback - INFO - Starting async job submit for node 69b20c97b0f5558b5d7cca86 2026-03-14 00:45:25,760 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 00:45:25,792 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b20c97b0f5558b5d7cca86 HTTP/1.1" 200 None 2026-03-14 00:45:25,793 - lava_callback - DEBUG - Processing node 69b20c97b0f5558b5d7cca86: baseline-arm-clabbe 2026-03-14 00:45:25,793 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b20c97b0f5558b5d7cca86 2026-03-14 00:45:25,793 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 00:45:25,829 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b20c97b0f5558b5d7cca86 HTTP/1.1" 200 None 2026-03-14 00:45:25,830 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 00:45:25,879 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aa1d368c4d487a0e751145 HTTP/1.1" 200 None 2026-03-14 00:45:25,881 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 00:45:25,902 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b20c97b0f5558b5d7cca86 HTTP/1.1" 200 None 2026-03-14 00:45:25,913 - lava_callback - ERROR - Error processing callback for node 69b20c97b0f5558b5d7cca86: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:58576 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58590 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36214 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33034 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50798 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43840 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57832 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:57840 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57614 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57618 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47468 - "GET / HTTP/1.0" 200 OK 2026-03-14 00:46:45,808 - lava_callback - INFO - Received callback for node 69b20ce6b0f5558b5d7cca95 INFO: 172.21.0.1:38656 - "POST /node/69b20ce6b0f5558b5d7cca95 HTTP/1.0" 202 Accepted 2026-03-14 00:46:45,814 - lava_callback - INFO - Starting async job submit for node 69b20ce6b0f5558b5d7cca95 2026-03-14 00:46:45,814 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 00:46:45,835 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b20ce6b0f5558b5d7cca95 HTTP/1.1" 200 None 2026-03-14 00:46:45,836 - lava_callback - DEBUG - Processing node 69b20ce6b0f5558b5d7cca95: baseline-arm-clabbe 2026-03-14 00:46:45,836 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b20ce6b0f5558b5d7cca95 2026-03-14 00:46:45,837 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 00:46:45,856 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b20ce6b0f5558b5d7cca95 HTTP/1.1" 200 None 2026-03-14 00:46:45,858 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 00:46:45,882 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aa1d368c4d487a0e751145 HTTP/1.1" 200 None 2026-03-14 00:46:45,884 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 00:46:45,904 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b20ce6b0f5558b5d7cca95 HTTP/1.1" 200 None 2026-03-14 00:46:45,914 - lava_callback - ERROR - Error processing callback for node 69b20ce6b0f5558b5d7cca95: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:38660 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60776 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51242 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41700 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:41710 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41640 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41654 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45562 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49498 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52826 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50446 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58442 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:58450 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56712 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56722 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46900 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45784 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49836 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45208 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40176 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:40190 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52086 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52094 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38634 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56836 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34498 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45770 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45410 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:45416 - "GET / HTTP/1.0" 200 OK 2026-03-14 00:50:25,021 - lava_callback - INFO - Received callback for node 69b20dcfb0f5558b5d7ccac1 INFO: 172.21.0.1:54920 - "POST /node/69b20dcfb0f5558b5d7ccac1 HTTP/1.0" 202 Accepted 2026-03-14 00:50:25,027 - lava_callback - INFO - Starting async job submit for node 69b20dcfb0f5558b5d7ccac1 2026-03-14 00:50:25,028 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 00:50:25,047 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b20dcfb0f5558b5d7ccac1 HTTP/1.1" 200 None 2026-03-14 00:50:25,048 - lava_callback - DEBUG - Processing node 69b20dcfb0f5558b5d7ccac1: baseline-arm-baylibre 2026-03-14 00:50:25,048 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b20dcfb0f5558b5d7ccac1 2026-03-14 00:50:25,049 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 00:50:25,085 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b20dcfb0f5558b5d7ccac1 HTTP/1.1" 200 None 2026-03-14 00:50:25,086 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 00:50:25,099 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b2060ab0f5558b5d7cc5e3 HTTP/1.1" 200 None 2026-03-14 00:50:25,101 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 00:50:25,121 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b20dcfb0f5558b5d7ccac1 HTTP/1.1" 200 None 2026-03-14 00:50:25,133 - lava_callback - ERROR - Error processing callback for node 69b20dcfb0f5558b5d7ccac1: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:54930 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54938 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46486 - "GET / HTTP/1.0" 200 OK 2026-03-14 00:50:44,925 - lava_callback - INFO - Received callback for node 69b20dd0b0f5558b5d7ccac4 INFO: 172.21.0.1:50768 - "POST /node/69b20dd0b0f5558b5d7ccac4 HTTP/1.0" 202 Accepted 2026-03-14 00:50:44,931 - lava_callback - INFO - Starting async job submit for node 69b20dd0b0f5558b5d7ccac4 2026-03-14 00:50:44,932 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 00:50:44,951 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b20dd0b0f5558b5d7ccac4 HTTP/1.1" 200 None 2026-03-14 00:50:44,952 - lava_callback - DEBUG - Processing node 69b20dd0b0f5558b5d7ccac4: baseline-arm-baylibre 2026-03-14 00:50:44,953 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b20dd0b0f5558b5d7ccac4 2026-03-14 00:50:44,953 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 00:50:44,967 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b20dd0b0f5558b5d7ccac4 HTTP/1.1" 200 None 2026-03-14 00:50:44,969 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 00:50:44,982 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b2060ab0f5558b5d7cc5e3 HTTP/1.1" 200 None 2026-03-14 00:50:44,983 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 00:50:45,017 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b20dd0b0f5558b5d7ccac4 HTTP/1.1" 200 None 2026-03-14 00:50:45,023 - lava_callback - ERROR - Error processing callback for node 69b20dd0b0f5558b5d7ccac4: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' 2026-03-14 00:50:45,573 - lava_callback - INFO - Received callback for node 69b20dd2b0f5558b5d7ccac7 INFO: 172.21.0.1:50778 - "POST /node/69b20dd2b0f5558b5d7ccac7 HTTP/1.0" 202 Accepted 2026-03-14 00:50:45,579 - lava_callback - INFO - Starting async job submit for node 69b20dd2b0f5558b5d7ccac7 2026-03-14 00:50:45,579 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 00:50:45,594 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b20dd2b0f5558b5d7ccac7 HTTP/1.1" 200 None 2026-03-14 00:50:45,595 - lava_callback - DEBUG - Processing node 69b20dd2b0f5558b5d7ccac7: baseline-arm-baylibre 2026-03-14 00:50:45,595 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b20dd2b0f5558b5d7ccac7 2026-03-14 00:50:45,596 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 00:50:45,611 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b20dd2b0f5558b5d7ccac7 HTTP/1.1" 200 None 2026-03-14 00:50:45,613 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 00:50:45,626 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b2060ab0f5558b5d7cc5e3 HTTP/1.1" 200 None 2026-03-14 00:50:45,628 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 00:50:45,648 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b20dd2b0f5558b5d7ccac7 HTTP/1.1" 200 None 2026-03-14 00:50:45,652 - lava_callback - ERROR - Error processing callback for node 69b20dd2b0f5558b5d7ccac7: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' 2026-03-14 00:50:45,998 - lava_callback - INFO - Received callback for node 69b20de0b0f5558b5d7ccaf5 INFO: 172.21.0.1:50790 - "POST /node/69b20de0b0f5558b5d7ccaf5 HTTP/1.0" 202 Accepted 2026-03-14 00:50:46,004 - lava_callback - INFO - Starting async job submit for node 69b20de0b0f5558b5d7ccaf5 2026-03-14 00:50:46,005 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 00:50:46,019 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b20de0b0f5558b5d7ccaf5 HTTP/1.1" 200 None 2026-03-14 00:50:46,020 - lava_callback - DEBUG - Processing node 69b20de0b0f5558b5d7ccaf5: baseline-arm-clabbe 2026-03-14 00:50:46,020 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b20de0b0f5558b5d7ccaf5 2026-03-14 00:50:46,020 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 00:50:46,033 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b20de0b0f5558b5d7ccaf5 HTTP/1.1" 200 None 2026-03-14 00:50:46,035 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 00:50:46,048 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b2060ab0f5558b5d7cc5e3 HTTP/1.1" 200 None 2026-03-14 00:50:46,050 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 00:50:46,072 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b20de0b0f5558b5d7ccaf5 HTTP/1.1" 200 None 2026-03-14 00:50:46,073 - lava_callback - ERROR - Error processing callback for node 69b20de0b0f5558b5d7ccaf5: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' 2026-03-14 00:50:46,260 - lava_callback - INFO - Received callback for node 69b20dd7b0f5558b5d7ccad7 INFO: 172.21.0.1:50806 - "POST /node/69b20dd7b0f5558b5d7ccad7 HTTP/1.0" 202 Accepted 2026-03-14 00:50:46,266 - lava_callback - INFO - Starting async job submit for node 69b20dd7b0f5558b5d7ccad7 2026-03-14 00:50:46,268 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 00:50:46,286 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b20dd7b0f5558b5d7ccad7 HTTP/1.1" 200 None 2026-03-14 00:50:46,287 - lava_callback - DEBUG - Processing node 69b20dd7b0f5558b5d7ccad7: baseline-arm-baylibre 2026-03-14 00:50:46,287 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b20dd7b0f5558b5d7ccad7 2026-03-14 00:50:46,288 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 00:50:46,300 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b20dd7b0f5558b5d7ccad7 HTTP/1.1" 200 None 2026-03-14 00:50:46,302 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 00:50:46,316 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b2060ab0f5558b5d7cc5e3 HTTP/1.1" 200 None 2026-03-14 00:50:46,318 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 00:50:46,340 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b20dd7b0f5558b5d7ccad7 HTTP/1.1" 200 None 2026-03-14 00:50:46,341 - lava_callback - ERROR - Error processing callback for node 69b20dd7b0f5558b5d7ccad7: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:50808 - "GET / HTTP/1.0" 200 OK 2026-03-14 00:50:46,652 - lava_callback - INFO - Received callback for node 69b20de4b0f5558b5d7ccb24 INFO: 172.21.0.1:50822 - "POST /node/69b20de4b0f5558b5d7ccb24 HTTP/1.0" 202 Accepted 2026-03-14 00:50:46,658 - lava_callback - INFO - Starting async job submit for node 69b20de4b0f5558b5d7ccb24 2026-03-14 00:50:46,659 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 00:50:46,673 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b20de4b0f5558b5d7ccb24 HTTP/1.1" 200 None 2026-03-14 00:50:46,674 - lava_callback - DEBUG - Processing node 69b20de4b0f5558b5d7ccb24: baseline-arm-clabbe 2026-03-14 00:50:46,674 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b20de4b0f5558b5d7ccb24 2026-03-14 00:50:46,675 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 00:50:46,688 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b20de4b0f5558b5d7ccb24 HTTP/1.1" 200 None 2026-03-14 00:50:46,689 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 00:50:46,703 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b2060ab0f5558b5d7cc5e3 HTTP/1.1" 200 None 2026-03-14 00:50:46,704 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 00:50:46,731 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b20de4b0f5558b5d7ccb24 HTTP/1.1" 200 None 2026-03-14 00:50:46,737 - lava_callback - ERROR - Error processing callback for node 69b20de4b0f5558b5d7ccb24: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' 2026-03-14 00:50:46,905 - lava_callback - INFO - Received callback for node 69b20dd3b0f5558b5d7ccaca INFO: 172.21.0.1:50828 - "POST /node/69b20dd3b0f5558b5d7ccaca HTTP/1.0" 202 Accepted 2026-03-14 00:50:46,911 - lava_callback - INFO - Starting async job submit for node 69b20dd3b0f5558b5d7ccaca 2026-03-14 00:50:46,912 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 00:50:46,931 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b20dd3b0f5558b5d7ccaca HTTP/1.1" 200 None 2026-03-14 00:50:46,932 - lava_callback - DEBUG - Processing node 69b20dd3b0f5558b5d7ccaca: baseline-arm-baylibre 2026-03-14 00:50:46,933 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b20dd3b0f5558b5d7ccaca 2026-03-14 00:50:46,933 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 00:50:46,949 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b20dd3b0f5558b5d7ccaca HTTP/1.1" 200 None 2026-03-14 00:50:46,951 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 00:50:46,968 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b2060ab0f5558b5d7cc5e3 HTTP/1.1" 200 None 2026-03-14 00:50:46,969 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 00:50:46,994 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b20dd3b0f5558b5d7ccaca HTTP/1.1" 200 None 2026-03-14 00:50:46,996 - lava_callback - ERROR - Error processing callback for node 69b20dd3b0f5558b5d7ccaca: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' 2026-03-14 00:50:47,548 - lava_callback - INFO - Received callback for node 69b20dd8b0f5558b5d7ccada INFO: 172.21.0.1:50830 - "POST /node/69b20dd8b0f5558b5d7ccada HTTP/1.0" 202 Accepted 2026-03-14 00:50:47,554 - lava_callback - INFO - Starting async job submit for node 69b20dd8b0f5558b5d7ccada 2026-03-14 00:50:47,554 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 00:50:47,568 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b20dd8b0f5558b5d7ccada HTTP/1.1" 200 None 2026-03-14 00:50:47,569 - lava_callback - DEBUG - Processing node 69b20dd8b0f5558b5d7ccada: baseline-arm-baylibre 2026-03-14 00:50:47,570 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b20dd8b0f5558b5d7ccada 2026-03-14 00:50:47,570 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 00:50:47,583 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b20dd8b0f5558b5d7ccada HTTP/1.1" 200 None 2026-03-14 00:50:47,585 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 00:50:47,598 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b2060ab0f5558b5d7cc5e3 HTTP/1.1" 200 None 2026-03-14 00:50:47,599 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 00:50:47,625 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b20dd8b0f5558b5d7ccada HTTP/1.1" 200 None 2026-03-14 00:50:47,627 - lava_callback - ERROR - Error processing callback for node 69b20dd8b0f5558b5d7ccada: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:39236 - "GET / HTTP/1.0" 200 OK 2026-03-14 00:51:05,999 - lava_callback - INFO - Received callback for node 69b20de5b0f5558b5d7ccb27 INFO: 172.21.0.1:51094 - "POST /node/69b20de5b0f5558b5d7ccb27 HTTP/1.0" 202 Accepted 2026-03-14 00:51:06,005 - lava_callback - INFO - Starting async job submit for node 69b20de5b0f5558b5d7ccb27 2026-03-14 00:51:06,006 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 00:51:06,020 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b20de5b0f5558b5d7ccb27 HTTP/1.1" 200 None 2026-03-14 00:51:06,021 - lava_callback - DEBUG - Processing node 69b20de5b0f5558b5d7ccb27: baseline-arm-clabbe 2026-03-14 00:51:06,021 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b20de5b0f5558b5d7ccb27 2026-03-14 00:51:06,022 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 00:51:06,035 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b20de5b0f5558b5d7ccb27 HTTP/1.1" 200 None 2026-03-14 00:51:06,037 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 00:51:06,055 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b2060ab0f5558b5d7cc5e3 HTTP/1.1" 200 None 2026-03-14 00:51:06,056 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 00:51:06,077 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b20de5b0f5558b5d7ccb27 HTTP/1.1" 200 None 2026-03-14 00:51:06,083 - lava_callback - ERROR - Error processing callback for node 69b20de5b0f5558b5d7ccb27: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:51100 - "GET / HTTP/1.0" 200 OK 2026-03-14 00:51:06,672 - lava_callback - INFO - Received callback for node 69b20de6b0f5558b5d7ccb2a INFO: 172.21.0.1:51102 - "POST /node/69b20de6b0f5558b5d7ccb2a HTTP/1.0" 202 Accepted 2026-03-14 00:51:06,682 - lava_callback - INFO - Starting async job submit for node 69b20de6b0f5558b5d7ccb2a 2026-03-14 00:51:06,684 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 00:51:06,707 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b20de6b0f5558b5d7ccb2a HTTP/1.1" 200 None 2026-03-14 00:51:06,708 - lava_callback - DEBUG - Processing node 69b20de6b0f5558b5d7ccb2a: baseline-arm-clabbe 2026-03-14 00:51:06,708 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b20de6b0f5558b5d7ccb2a 2026-03-14 00:51:06,709 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 00:51:06,724 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b20de6b0f5558b5d7ccb2a HTTP/1.1" 200 None 2026-03-14 00:51:06,726 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 00:51:06,745 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b2060ab0f5558b5d7cc5e3 HTTP/1.1" 200 None 2026-03-14 00:51:06,747 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 00:51:06,775 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b20de6b0f5558b5d7ccb2a HTTP/1.1" 200 None 2026-03-14 00:51:06,777 - lava_callback - ERROR - Error processing callback for node 69b20de6b0f5558b5d7ccb2a: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' 2026-03-14 00:51:07,332 - lava_callback - INFO - Received callback for node 69b20de8b0f5558b5d7ccb35 INFO: 172.21.0.1:51114 - "POST /node/69b20de8b0f5558b5d7ccb35 HTTP/1.0" 202 Accepted 2026-03-14 00:51:07,338 - lava_callback - INFO - Starting async job submit for node 69b20de8b0f5558b5d7ccb35 2026-03-14 00:51:07,339 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 00:51:07,357 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b20de8b0f5558b5d7ccb35 HTTP/1.1" 200 None 2026-03-14 00:51:07,357 - lava_callback - DEBUG - Processing node 69b20de8b0f5558b5d7ccb35: baseline-arm-clabbe 2026-03-14 00:51:07,358 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b20de8b0f5558b5d7ccb35 2026-03-14 00:51:07,358 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 00:51:07,371 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b20de8b0f5558b5d7ccb35 HTTP/1.1" 200 None 2026-03-14 00:51:07,373 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 00:51:07,386 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b2060ab0f5558b5d7cc5e3 HTTP/1.1" 200 None 2026-03-14 00:51:07,388 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 00:51:07,411 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b20de8b0f5558b5d7ccb35 HTTP/1.1" 200 None 2026-03-14 00:51:07,412 - lava_callback - ERROR - Error processing callback for node 69b20de8b0f5558b5d7ccb35: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:52650 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:52652 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58542 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58546 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58382 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33100 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39652 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38060 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48562 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:48578 - "GET / HTTP/1.0" 200 OK 2026-03-14 00:52:25,093 - lava_callback - INFO - Received callback for node 69b20e40b0f5558b5d7ccc87 INFO: 172.21.0.1:34336 - "POST /node/69b20e40b0f5558b5d7ccc87 HTTP/1.0" 202 Accepted 2026-03-14 00:52:25,099 - lava_callback - INFO - Starting async job submit for node 69b20e40b0f5558b5d7ccc87 2026-03-14 00:52:25,099 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 00:52:25,118 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b20e40b0f5558b5d7ccc87 HTTP/1.1" 200 None 2026-03-14 00:52:25,119 - lava_callback - DEBUG - Processing node 69b20e40b0f5558b5d7ccc87: baseline-arm64-baylibre 2026-03-14 00:52:25,119 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b20e40b0f5558b5d7ccc87 2026-03-14 00:52:25,120 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 00:52:25,133 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b20e40b0f5558b5d7ccc87 HTTP/1.1" 200 None 2026-03-14 00:52:25,135 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 00:52:25,158 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b2061ab0f5558b5d7cc5f2 HTTP/1.1" 200 None 2026-03-14 00:52:25,160 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 00:52:25,183 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b20e40b0f5558b5d7ccc87 HTTP/1.1" 200 None 2026-03-14 00:52:25,184 - lava_callback - ERROR - Error processing callback for node 69b20e40b0f5558b5d7ccc87: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' 2026-03-14 00:52:25,737 - lava_callback - INFO - Received callback for node 69b20e42b0f5558b5d7ccc8a INFO: 172.21.0.1:34340 - "POST /node/69b20e42b0f5558b5d7ccc8a HTTP/1.0" 202 Accepted 2026-03-14 00:52:25,743 - lava_callback - INFO - Starting async job submit for node 69b20e42b0f5558b5d7ccc8a 2026-03-14 00:52:25,743 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 00:52:25,758 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b20e42b0f5558b5d7ccc8a HTTP/1.1" 200 None 2026-03-14 00:52:25,759 - lava_callback - DEBUG - Processing node 69b20e42b0f5558b5d7ccc8a: baseline-arm64-baylibre 2026-03-14 00:52:25,759 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b20e42b0f5558b5d7ccc8a 2026-03-14 00:52:25,760 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 00:52:25,773 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b20e42b0f5558b5d7ccc8a HTTP/1.1" 200 None 2026-03-14 00:52:25,774 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 00:52:25,787 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b2061ab0f5558b5d7cc5f2 HTTP/1.1" 200 None 2026-03-14 00:52:25,788 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 00:52:25,813 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b20e42b0f5558b5d7ccc8a HTTP/1.1" 200 None 2026-03-14 00:52:25,815 - lava_callback - ERROR - Error processing callback for node 69b20e42b0f5558b5d7ccc8a: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' 2026-03-14 00:52:26,408 - lava_callback - INFO - Received callback for node 69b20e43b0f5558b5d7ccc8d INFO: 172.21.0.1:34356 - "POST /node/69b20e43b0f5558b5d7ccc8d HTTP/1.0" 202 Accepted 2026-03-14 00:52:26,414 - lava_callback - INFO - Starting async job submit for node 69b20e43b0f5558b5d7ccc8d 2026-03-14 00:52:26,414 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 00:52:26,437 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b20e43b0f5558b5d7ccc8d HTTP/1.1" 200 None 2026-03-14 00:52:26,438 - lava_callback - DEBUG - Processing node 69b20e43b0f5558b5d7ccc8d: baseline-arm64-baylibre 2026-03-14 00:52:26,438 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b20e43b0f5558b5d7ccc8d 2026-03-14 00:52:26,438 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 00:52:26,452 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b20e43b0f5558b5d7ccc8d HTTP/1.1" 200 None 2026-03-14 00:52:26,453 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 00:52:26,472 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b2061ab0f5558b5d7cc5f2 HTTP/1.1" 200 None 2026-03-14 00:52:26,474 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 00:52:26,494 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b20e43b0f5558b5d7ccc8d HTTP/1.1" 200 None 2026-03-14 00:52:26,499 - lava_callback - ERROR - Error processing callback for node 69b20e43b0f5558b5d7ccc8d: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:34366 - "GET / HTTP/1.0" 200 OK 2026-03-14 00:52:27,079 - lava_callback - INFO - Received callback for node 69b20e45b0f5558b5d7ccc94 INFO: 172.21.0.1:34370 - "POST /node/69b20e45b0f5558b5d7ccc94 HTTP/1.0" 202 Accepted 2026-03-14 00:52:27,085 - lava_callback - INFO - Starting async job submit for node 69b20e45b0f5558b5d7ccc94 2026-03-14 00:52:27,085 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 00:52:27,100 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b20e45b0f5558b5d7ccc94 HTTP/1.1" 200 None 2026-03-14 00:52:27,101 - lava_callback - DEBUG - Processing node 69b20e45b0f5558b5d7ccc94: baseline-arm64-baylibre 2026-03-14 00:52:27,101 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b20e45b0f5558b5d7ccc94 2026-03-14 00:52:27,102 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 00:52:27,115 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b20e45b0f5558b5d7ccc94 HTTP/1.1" 200 None 2026-03-14 00:52:27,116 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 00:52:27,129 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b2061ab0f5558b5d7cc5f2 HTTP/1.1" 200 None 2026-03-14 00:52:27,130 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 00:52:27,157 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b20e45b0f5558b5d7ccc94 HTTP/1.1" 200 None 2026-03-14 00:52:27,159 - lava_callback - ERROR - Error processing callback for node 69b20e45b0f5558b5d7ccc94: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:34378 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56118 - "GET / HTTP/1.0" 200 OK 2026-03-14 00:52:45,025 - lava_callback - INFO - Received callback for node 69b20e47b0f5558b5d7ccc9a INFO: 172.21.0.1:39620 - "POST /node/69b20e47b0f5558b5d7ccc9a HTTP/1.0" 202 Accepted 2026-03-14 00:52:45,031 - lava_callback - INFO - Starting async job submit for node 69b20e47b0f5558b5d7ccc9a 2026-03-14 00:52:45,032 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 00:52:45,046 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b20e47b0f5558b5d7ccc9a HTTP/1.1" 200 None 2026-03-14 00:52:45,047 - lava_callback - DEBUG - Processing node 69b20e47b0f5558b5d7ccc9a: baseline-arm64-baylibre 2026-03-14 00:52:45,047 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b20e47b0f5558b5d7ccc9a 2026-03-14 00:52:45,048 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 00:52:45,061 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b20e47b0f5558b5d7ccc9a HTTP/1.1" 200 None 2026-03-14 00:52:45,062 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 00:52:45,076 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b2061ab0f5558b5d7cc5f2 HTTP/1.1" 200 None 2026-03-14 00:52:45,078 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 00:52:45,099 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b20e47b0f5558b5d7ccc9a HTTP/1.1" 200 None 2026-03-14 00:52:45,108 - lava_callback - ERROR - Error processing callback for node 69b20e47b0f5558b5d7ccc9a: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' 2026-03-14 00:52:45,671 - lava_callback - INFO - Received callback for node 69b20e49b0f5558b5d7ccca0 INFO: 172.21.0.1:39628 - "POST /node/69b20e49b0f5558b5d7ccca0 HTTP/1.0" 202 Accepted 2026-03-14 00:52:45,677 - lava_callback - INFO - Starting async job submit for node 69b20e49b0f5558b5d7ccca0 2026-03-14 00:52:45,678 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 00:52:45,691 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b20e49b0f5558b5d7ccca0 HTTP/1.1" 200 None 2026-03-14 00:52:45,692 - lava_callback - DEBUG - Processing node 69b20e49b0f5558b5d7ccca0: baseline-arm64-baylibre 2026-03-14 00:52:45,693 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b20e49b0f5558b5d7ccca0 2026-03-14 00:52:45,693 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 00:52:45,734 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b20e49b0f5558b5d7ccca0 HTTP/1.1" 200 None 2026-03-14 00:52:45,736 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 00:52:45,749 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b2061ab0f5558b5d7cc5f2 HTTP/1.1" 200 None 2026-03-14 00:52:45,750 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 00:52:45,775 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b20e49b0f5558b5d7ccca0 HTTP/1.1" 200 None 2026-03-14 00:52:45,789 - lava_callback - ERROR - Error processing callback for node 69b20e49b0f5558b5d7ccca0: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' 2026-03-14 00:52:46,079 - lava_callback - INFO - Received callback for node 69b20e59b0f5558b5d7ccd03 INFO: 172.21.0.1:39638 - "POST /node/69b20e59b0f5558b5d7ccd03 HTTP/1.0" 202 Accepted 2026-03-14 00:52:46,085 - lava_callback - INFO - Starting async job submit for node 69b20e59b0f5558b5d7ccd03 2026-03-14 00:52:46,085 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 00:52:46,101 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b20e59b0f5558b5d7ccd03 HTTP/1.1" 200 None 2026-03-14 00:52:46,102 - lava_callback - DEBUG - Processing node 69b20e59b0f5558b5d7ccd03: baseline-arm64-clabbe 2026-03-14 00:52:46,102 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b20e59b0f5558b5d7ccd03 2026-03-14 00:52:46,102 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 00:52:46,115 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b20e59b0f5558b5d7ccd03 HTTP/1.1" 200 None 2026-03-14 00:52:46,117 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 00:52:46,130 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b2061ab0f5558b5d7cc5f2 HTTP/1.1" 200 None 2026-03-14 00:52:46,131 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 00:52:46,155 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b20e59b0f5558b5d7ccd03 HTTP/1.1" 200 None 2026-03-14 00:52:46,160 - lava_callback - ERROR - Error processing callback for node 69b20e59b0f5558b5d7ccd03: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:39640 - "GET / HTTP/1.0" 200 OK 2026-03-14 00:52:46,753 - lava_callback - INFO - Received callback for node 69b20e5bb0f5558b5d7ccd0a INFO: 172.21.0.1:39654 - "POST /node/69b20e5bb0f5558b5d7ccd0a HTTP/1.0" 202 Accepted 2026-03-14 00:52:46,758 - lava_callback - INFO - Starting async job submit for node 69b20e5bb0f5558b5d7ccd0a 2026-03-14 00:52:46,759 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 00:52:46,780 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b20e5bb0f5558b5d7ccd0a HTTP/1.1" 200 None 2026-03-14 00:52:46,781 - lava_callback - DEBUG - Processing node 69b20e5bb0f5558b5d7ccd0a: baseline-arm64-clabbe 2026-03-14 00:52:46,781 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b20e5bb0f5558b5d7ccd0a 2026-03-14 00:52:46,782 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 00:52:46,794 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b20e5bb0f5558b5d7ccd0a HTTP/1.1" 200 None 2026-03-14 00:52:46,796 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 00:52:46,809 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b2061ab0f5558b5d7cc5f2 HTTP/1.1" 200 None 2026-03-14 00:52:46,810 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 00:52:46,831 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b20e5bb0f5558b5d7ccd0a HTTP/1.1" 200 None 2026-03-14 00:52:46,833 - lava_callback - ERROR - Error processing callback for node 69b20e5bb0f5558b5d7ccd0a: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' 2026-03-14 00:52:47,426 - lava_callback - INFO - Received callback for node 69b20e5cb0f5558b5d7ccd0d INFO: 172.21.0.1:39662 - "POST /node/69b20e5cb0f5558b5d7ccd0d HTTP/1.0" 202 Accepted 2026-03-14 00:52:47,432 - lava_callback - INFO - Starting async job submit for node 69b20e5cb0f5558b5d7ccd0d 2026-03-14 00:52:47,433 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 00:52:47,447 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b20e5cb0f5558b5d7ccd0d HTTP/1.1" 200 None 2026-03-14 00:52:47,448 - lava_callback - DEBUG - Processing node 69b20e5cb0f5558b5d7ccd0d: baseline-arm64-clabbe 2026-03-14 00:52:47,448 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b20e5cb0f5558b5d7ccd0d 2026-03-14 00:52:47,449 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 00:52:47,466 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b20e5cb0f5558b5d7ccd0d HTTP/1.1" 200 None 2026-03-14 00:52:47,467 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 00:52:47,482 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b2061ab0f5558b5d7cc5f2 HTTP/1.1" 200 None 2026-03-14 00:52:47,483 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 00:52:47,504 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b20e5cb0f5558b5d7ccd0d HTTP/1.1" 200 None 2026-03-14 00:52:47,505 - lava_callback - ERROR - Error processing callback for node 69b20e5cb0f5558b5d7ccd0d: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:51910 - "GET / HTTP/1.0" 200 OK 2026-03-14 00:53:06,067 - lava_callback - INFO - Received callback for node 69b20e5db0f5558b5d7ccd10 INFO: 172.21.0.1:46114 - "POST /node/69b20e5db0f5558b5d7ccd10 HTTP/1.0" 202 Accepted 2026-03-14 00:53:06,073 - lava_callback - INFO - Starting async job submit for node 69b20e5db0f5558b5d7ccd10 2026-03-14 00:53:06,073 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 00:53:06,088 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b20e5db0f5558b5d7ccd10 HTTP/1.1" 200 None 2026-03-14 00:53:06,089 - lava_callback - DEBUG - Processing node 69b20e5db0f5558b5d7ccd10: baseline-arm64-clabbe 2026-03-14 00:53:06,089 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b20e5db0f5558b5d7ccd10 2026-03-14 00:53:06,090 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 00:53:06,104 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b20e5db0f5558b5d7ccd10 HTTP/1.1" 200 None 2026-03-14 00:53:06,105 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 00:53:06,118 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b2061ab0f5558b5d7cc5f2 HTTP/1.1" 200 None 2026-03-14 00:53:06,120 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 00:53:06,155 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b20e5db0f5558b5d7ccd10 HTTP/1.1" 200 None 2026-03-14 00:53:06,160 - lava_callback - ERROR - Error processing callback for node 69b20e5db0f5558b5d7ccd10: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:46118 - "GET / HTTP/1.0" 200 OK 2026-03-14 00:53:06,721 - lava_callback - INFO - Received callback for node 69b20e5fb0f5558b5d7ccd19 INFO: 172.21.0.1:46120 - "POST /node/69b20e5fb0f5558b5d7ccd19 HTTP/1.0" 202 Accepted 2026-03-14 00:53:06,726 - lava_callback - INFO - Starting async job submit for node 69b20e5fb0f5558b5d7ccd19 2026-03-14 00:53:06,727 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 00:53:06,742 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b20e5fb0f5558b5d7ccd19 HTTP/1.1" 200 None 2026-03-14 00:53:06,743 - lava_callback - DEBUG - Processing node 69b20e5fb0f5558b5d7ccd19: baseline-arm64-clabbe 2026-03-14 00:53:06,743 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b20e5fb0f5558b5d7ccd19 2026-03-14 00:53:06,744 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 00:53:06,757 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b20e5fb0f5558b5d7ccd19 HTTP/1.1" 200 None 2026-03-14 00:53:06,758 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 00:53:06,773 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b2061ab0f5558b5d7cc5f2 HTTP/1.1" 200 None 2026-03-14 00:53:06,774 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 00:53:06,799 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b20e5fb0f5558b5d7ccd19 HTTP/1.1" 200 None 2026-03-14 00:53:06,810 - lava_callback - ERROR - Error processing callback for node 69b20e5fb0f5558b5d7ccd19: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' 2026-03-14 00:53:07,377 - lava_callback - INFO - Received callback for node 69b20e5fb0f5558b5d7ccd16 INFO: 172.21.0.1:46126 - "POST /node/69b20e5fb0f5558b5d7ccd16 HTTP/1.0" 202 Accepted 2026-03-14 00:53:07,383 - lava_callback - INFO - Starting async job submit for node 69b20e5fb0f5558b5d7ccd16 2026-03-14 00:53:07,383 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 00:53:07,398 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b20e5fb0f5558b5d7ccd16 HTTP/1.1" 200 None 2026-03-14 00:53:07,399 - lava_callback - DEBUG - Processing node 69b20e5fb0f5558b5d7ccd16: baseline-arm64-clabbe 2026-03-14 00:53:07,399 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b20e5fb0f5558b5d7ccd16 2026-03-14 00:53:07,399 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 00:53:07,412 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b20e5fb0f5558b5d7ccd16 HTTP/1.1" 200 None 2026-03-14 00:53:07,414 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 00:53:07,427 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b2061ab0f5558b5d7cc5f2 HTTP/1.1" 200 None 2026-03-14 00:53:07,428 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 00:53:07,458 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b20e5fb0f5558b5d7ccd16 HTTP/1.1" 200 None 2026-03-14 00:53:07,466 - lava_callback - ERROR - Error processing callback for node 69b20e5fb0f5558b5d7ccd16: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:59330 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:59344 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55192 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49020 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49036 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59102 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46352 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37474 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44560 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:44574 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44844 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34522 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34526 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52952 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60704 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33198 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58588 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:58590 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41344 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45130 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45146 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41170 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48404 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47274 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44862 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:44874 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59664 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51360 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51364 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49338 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44962 - "GET / HTTP/1.0" 200 OK 2026-03-14 00:57:05,325 - lava_callback - INFO - Received callback for node 69b20f52b0f5558b5d7ccf0d INFO: 172.21.0.1:44384 - "POST /node/69b20f52b0f5558b5d7ccf0d HTTP/1.0" 202 Accepted 2026-03-14 00:57:05,332 - lava_callback - INFO - Starting async job submit for node 69b20f52b0f5558b5d7ccf0d 2026-03-14 00:57:05,333 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 00:57:05,350 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b20f52b0f5558b5d7ccf0d HTTP/1.1" 200 None 2026-03-14 00:57:05,351 - lava_callback - DEBUG - Processing node 69b20f52b0f5558b5d7ccf0d: baseline-arm-baylibre 2026-03-14 00:57:05,351 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b20f52b0f5558b5d7ccf0d 2026-03-14 00:57:05,352 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 00:57:05,365 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b20f52b0f5558b5d7ccf0d HTTP/1.1" 200 None 2026-03-14 00:57:05,367 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 00:57:05,380 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aeba33feb96b28aa34a775 HTTP/1.1" 200 None 2026-03-14 00:57:05,382 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 00:57:05,402 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b20f52b0f5558b5d7ccf0d HTTP/1.1" 200 None 2026-03-14 00:57:05,408 - lava_callback - ERROR - Error processing callback for node 69b20f52b0f5558b5d7ccf0d: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:44394 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44206 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:44214 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48466 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49500 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49504 - "GET / HTTP/1.0" 200 OK 2026-03-14 00:57:45,279 - lava_callback - INFO - Received callback for node 69b20f78b0f5558b5d7ccf23 INFO: 172.21.0.1:48080 - "POST /node/69b20f78b0f5558b5d7ccf23 HTTP/1.0" 202 Accepted 2026-03-14 00:57:45,284 - lava_callback - INFO - Starting async job submit for node 69b20f78b0f5558b5d7ccf23 2026-03-14 00:57:45,285 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 00:57:45,299 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b20f78b0f5558b5d7ccf23 HTTP/1.1" 200 None 2026-03-14 00:57:45,300 - lava_callback - DEBUG - Processing node 69b20f78b0f5558b5d7ccf23: baseline-arm-baylibre 2026-03-14 00:57:45,300 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b20f78b0f5558b5d7ccf23 2026-03-14 00:57:45,301 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 00:57:45,328 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b20f78b0f5558b5d7ccf23 HTTP/1.1" 200 None 2026-03-14 00:57:45,329 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 00:57:45,345 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aeba33feb96b28aa34a775 HTTP/1.1" 200 None 2026-03-14 00:57:45,347 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 00:57:45,376 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b20f78b0f5558b5d7ccf23 HTTP/1.1" 200 None 2026-03-14 00:57:45,377 - lava_callback - ERROR - Error processing callback for node 69b20f78b0f5558b5d7ccf23: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:48084 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41088 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34270 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:32776 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:32780 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56688 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54292 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54298 - "GET / HTTP/1.0" 200 OK 2026-03-14 00:58:45,378 - lava_callback - INFO - Received callback for node 69b20fc1b0f5558b5d7ccf41 INFO: 172.21.0.1:41450 - "POST /node/69b20fc1b0f5558b5d7ccf41 HTTP/1.0" 202 Accepted 2026-03-14 00:58:45,384 - lava_callback - INFO - Starting async job submit for node 69b20fc1b0f5558b5d7ccf41 2026-03-14 00:58:45,384 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 00:58:45,418 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b20fc1b0f5558b5d7ccf41 HTTP/1.1" 200 None 2026-03-14 00:58:45,419 - lava_callback - DEBUG - Processing node 69b20fc1b0f5558b5d7ccf41: baseline-arm-baylibre 2026-03-14 00:58:45,419 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b20fc1b0f5558b5d7ccf41 2026-03-14 00:58:45,420 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 00:58:45,433 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b20fc1b0f5558b5d7ccf41 HTTP/1.1" 200 None 2026-03-14 00:58:45,435 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 00:58:45,449 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aeba33feb96b28aa34a775 HTTP/1.1" 200 None 2026-03-14 00:58:45,450 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 00:58:45,471 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b20fc1b0f5558b5d7ccf41 HTTP/1.1" 200 None 2026-03-14 00:58:45,476 - lava_callback - ERROR - Error processing callback for node 69b20fc1b0f5558b5d7ccf41: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:41460 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36036 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:32894 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35310 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:35322 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34784 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50776 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50790 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55658 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36618 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57786 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42112 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:42126 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43544 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57132 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57146 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50182 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57642 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48552 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33258 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:33268 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46690 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45636 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45642 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35076 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45470 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46724 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60646 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:60650 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45470 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41360 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41364 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52544 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33550 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48750 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56376 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:56386 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48726 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45916 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45924 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40462 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50004 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36974 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33726 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:33736 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39758 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40214 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40224 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59146 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58748 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37870 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40182 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:40194 - "GET / HTTP/1.0" 200 OK 2026-03-14 01:05:25,763 - lava_callback - INFO - Received callback for node 69b21143b0f5558b5d7ccfd3 INFO: 172.21.0.1:52940 - "POST /node/69b21143b0f5558b5d7ccfd3 HTTP/1.0" 202 Accepted 2026-03-14 01:05:25,769 - lava_callback - INFO - Starting async job submit for node 69b21143b0f5558b5d7ccfd3 2026-03-14 01:05:25,769 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 01:05:25,783 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b21143b0f5558b5d7ccfd3 HTTP/1.1" 200 None 2026-03-14 01:05:25,784 - lava_callback - DEBUG - Processing node 69b21143b0f5558b5d7ccfd3: baseline-arm-baylibre 2026-03-14 01:05:25,784 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b21143b0f5558b5d7ccfd3 2026-03-14 01:05:25,785 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 01:05:25,798 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b21143b0f5558b5d7ccfd3 HTTP/1.1" 200 None 2026-03-14 01:05:25,800 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 01:05:25,813 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aeba33feb96b28aa34a775 HTTP/1.1" 200 None 2026-03-14 01:05:25,814 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 01:05:25,835 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b21143b0f5558b5d7ccfd3 HTTP/1.1" 200 None 2026-03-14 01:05:25,843 - lava_callback - ERROR - Error processing callback for node 69b21143b0f5558b5d7ccfd3: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:52954 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35966 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35980 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51314 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49190 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42320 - "GET / HTTP/1.0" 200 OK 2026-03-14 01:06:06,635 - lava_callback - INFO - Received callback for node 69b21169b0f5558b5d7ccfe9 INFO: 172.21.0.1:42324 - "POST /node/69b21169b0f5558b5d7ccfe9 HTTP/1.0" 202 Accepted 2026-03-14 01:06:06,642 - lava_callback - INFO - Starting async job submit for node 69b21169b0f5558b5d7ccfe9 2026-03-14 01:06:06,643 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 01:06:06,658 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b21169b0f5558b5d7ccfe9 HTTP/1.1" 200 None 2026-03-14 01:06:06,659 - lava_callback - DEBUG - Processing node 69b21169b0f5558b5d7ccfe9: baseline-arm-clabbe 2026-03-14 01:06:06,659 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b21169b0f5558b5d7ccfe9 2026-03-14 01:06:06,659 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 01:06:06,673 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b21169b0f5558b5d7ccfe9 HTTP/1.1" 200 None 2026-03-14 01:06:06,674 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 01:06:06,688 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aeba33feb96b28aa34a775 HTTP/1.1" 200 None 2026-03-14 01:06:06,690 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 01:06:06,711 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b21169b0f5558b5d7ccfe9 HTTP/1.1" 200 None 2026-03-14 01:06:06,720 - lava_callback - ERROR - Error processing callback for node 69b21169b0f5558b5d7ccfe9: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:60808 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:60810 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46744 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49162 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49170 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41654 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40964 - "GET / HTTP/1.0" 200 OK 2026-03-14 01:07:05,877 - lava_callback - INFO - Received callback for node 69b211aeb0f5558b5d7cd004 INFO: 172.21.0.1:34750 - "POST /node/69b211aeb0f5558b5d7cd004 HTTP/1.0" 202 Accepted 2026-03-14 01:07:05,883 - lava_callback - INFO - Starting async job submit for node 69b211aeb0f5558b5d7cd004 2026-03-14 01:07:05,884 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 01:07:05,898 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b211aeb0f5558b5d7cd004 HTTP/1.1" 200 None 2026-03-14 01:07:05,899 - lava_callback - DEBUG - Processing node 69b211aeb0f5558b5d7cd004: baseline-arm-baylibre 2026-03-14 01:07:05,899 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b211aeb0f5558b5d7cd004 2026-03-14 01:07:05,900 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 01:07:05,923 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b211aeb0f5558b5d7cd004 HTTP/1.1" 200 None 2026-03-14 01:07:05,925 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 01:07:05,941 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aeba33feb96b28aa34a775 HTTP/1.1" 200 None 2026-03-14 01:07:05,942 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 01:07:05,962 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b211aeb0f5558b5d7cd004 HTTP/1.1" 200 None 2026-03-14 01:07:05,968 - lava_callback - ERROR - Error processing callback for node 69b211aeb0f5558b5d7cd004: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:34760 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51550 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:51562 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57644 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38450 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38454 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55330 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36314 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54022 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36340 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:36342 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33420 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37666 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37668 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42940 - "GET / HTTP/1.0" 200 OK 2026-03-14 01:08:46,772 - lava_callback - INFO - Received callback for node 69b2121ab0f5558b5d7cd034 INFO: 172.21.0.1:42950 - "POST /node/69b2121ab0f5558b5d7cd034 HTTP/1.0" 202 Accepted 2026-03-14 01:08:46,777 - lava_callback - INFO - Starting async job submit for node 69b2121ab0f5558b5d7cd034 2026-03-14 01:08:46,778 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 01:08:46,793 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b2121ab0f5558b5d7cd034 HTTP/1.1" 200 None 2026-03-14 01:08:46,794 - lava_callback - DEBUG - Processing node 69b2121ab0f5558b5d7cd034: baseline-arm-clabbe 2026-03-14 01:08:46,794 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b2121ab0f5558b5d7cd034 2026-03-14 01:08:46,795 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 01:08:46,809 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b2121ab0f5558b5d7cd034 HTTP/1.1" 200 None 2026-03-14 01:08:46,810 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 01:08:46,823 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aeba33feb96b28aa34a775 HTTP/1.1" 200 None 2026-03-14 01:08:46,825 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 01:08:46,845 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b2121ab0f5558b5d7cd034 HTTP/1.1" 200 None 2026-03-14 01:08:46,847 - lava_callback - ERROR - Error processing callback for node 69b2121ab0f5558b5d7cd034: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:49162 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52646 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53670 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:53678 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37748 - "GET / HTTP/1.0" 200 OK 2026-03-14 01:09:26,754 - lava_callback - INFO - Received callback for node 69b2123fb0f5558b5d7cd03f INFO: 172.21.0.1:37756 - "POST /node/69b2123fb0f5558b5d7cd03f HTTP/1.0" 202 Accepted 2026-03-14 01:09:26,759 - lava_callback - INFO - Starting async job submit for node 69b2123fb0f5558b5d7cd03f 2026-03-14 01:09:26,760 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 01:09:26,783 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b2123fb0f5558b5d7cd03f HTTP/1.1" 200 None 2026-03-14 01:09:26,784 - lava_callback - DEBUG - Processing node 69b2123fb0f5558b5d7cd03f: baseline-arm-clabbe 2026-03-14 01:09:26,784 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b2123fb0f5558b5d7cd03f 2026-03-14 01:09:26,784 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 01:09:26,798 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b2123fb0f5558b5d7cd03f HTTP/1.1" 200 None 2026-03-14 01:09:26,799 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 01:09:26,812 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aeba33feb96b28aa34a775 HTTP/1.1" 200 None 2026-03-14 01:09:26,814 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 01:09:26,834 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b2123fb0f5558b5d7cd03f HTTP/1.1" 200 None 2026-03-14 01:09:26,836 - lava_callback - ERROR - Error processing callback for node 69b2123fb0f5558b5d7cd03f: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:54660 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54668 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41862 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46594 - "GET / HTTP/1.0" 200 OK 2026-03-14 01:10:06,067 - lava_callback - INFO - Received callback for node 69b21268b0f5558b5d7cd04d INFO: 172.21.0.1:56122 - "POST /node/69b21268b0f5558b5d7cd04d HTTP/1.0" 202 Accepted 2026-03-14 01:10:06,072 - lava_callback - INFO - Starting async job submit for node 69b21268b0f5558b5d7cd04d 2026-03-14 01:10:06,073 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 01:10:06,090 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b21268b0f5558b5d7cd04d HTTP/1.1" 200 None 2026-03-14 01:10:06,090 - lava_callback - DEBUG - Processing node 69b21268b0f5558b5d7cd04d: baseline-arm64-baylibre 2026-03-14 01:10:06,091 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b21268b0f5558b5d7cd04d 2026-03-14 01:10:06,091 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 01:10:06,104 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b21268b0f5558b5d7cd04d HTTP/1.1" 200 None 2026-03-14 01:10:06,106 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 01:10:06,122 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69af6340275c8d3b79399dc3 HTTP/1.1" 200 None 2026-03-14 01:10:06,124 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 01:10:06,145 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b21268b0f5558b5d7cd04d HTTP/1.1" 200 None 2026-03-14 01:10:06,147 - lava_callback - ERROR - Error processing callback for node 69b21268b0f5558b5d7cd04d: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:56124 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54724 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:54738 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53656 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44536 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44548 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34304 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55402 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60102 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49674 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:49686 - "GET / HTTP/1.0" 200 OK 2026-03-14 01:11:26,138 - lava_callback - INFO - Received callback for node 69b212bab0f5558b5d7cd065 INFO: 172.21.0.1:60126 - "POST /node/69b212bab0f5558b5d7cd065 HTTP/1.0" 202 Accepted 2026-03-14 01:11:26,143 - lava_callback - INFO - Starting async job submit for node 69b212bab0f5558b5d7cd065 2026-03-14 01:11:26,144 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 01:11:26,161 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b212bab0f5558b5d7cd065 HTTP/1.1" 200 None 2026-03-14 01:11:26,162 - lava_callback - DEBUG - Processing node 69b212bab0f5558b5d7cd065: baseline-arm64-baylibre 2026-03-14 01:11:26,162 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b212bab0f5558b5d7cd065 2026-03-14 01:11:26,163 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 01:11:26,182 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b212bab0f5558b5d7cd065 HTTP/1.1" 200 None 2026-03-14 01:11:26,183 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 01:11:26,197 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69af6340275c8d3b79399dc3 HTTP/1.1" 200 None 2026-03-14 01:11:26,199 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 01:11:26,219 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b212bab0f5558b5d7cd065 HTTP/1.1" 200 None 2026-03-14 01:11:26,225 - lava_callback - ERROR - Error processing callback for node 69b212bab0f5558b5d7cd065: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:60132 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60312 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60322 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37126 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42702 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60352 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57420 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:57426 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42550 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52998 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53014 - "GET / HTTP/1.0" 200 OK 2026-03-14 01:12:46,136 - lava_callback - INFO - Received callback for node 69b21308b0f5558b5d7cd079 INFO: 172.21.0.1:55844 - "POST /node/69b21308b0f5558b5d7cd079 HTTP/1.0" 202 Accepted 2026-03-14 01:12:46,141 - lava_callback - INFO - Starting async job submit for node 69b21308b0f5558b5d7cd079 2026-03-14 01:12:46,142 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 01:12:46,157 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b21308b0f5558b5d7cd079 HTTP/1.1" 200 None 2026-03-14 01:12:46,158 - lava_callback - DEBUG - Processing node 69b21308b0f5558b5d7cd079: baseline-arm64-baylibre 2026-03-14 01:12:46,158 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b21308b0f5558b5d7cd079 2026-03-14 01:12:46,159 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 01:12:46,177 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b21308b0f5558b5d7cd079 HTTP/1.1" 200 None 2026-03-14 01:12:46,179 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 01:12:46,192 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69af6340275c8d3b79399dc3 HTTP/1.1" 200 None 2026-03-14 01:12:46,194 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 01:12:46,219 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b21308b0f5558b5d7cd079 HTTP/1.1" 200 None 2026-03-14 01:12:46,221 - lava_callback - ERROR - Error processing callback for node 69b21308b0f5558b5d7cd079: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:55846 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46042 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36858 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52608 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:52618 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53032 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34524 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34526 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54088 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52246 - "GET / HTTP/1.0" 200 OK 2026-03-14 01:14:06,285 - lava_callback - INFO - Received callback for node 69b21357b0f5558b5d7cd08d INFO: 172.21.0.1:52218 - "POST /node/69b21357b0f5558b5d7cd08d HTTP/1.0" 202 Accepted 2026-03-14 01:14:06,291 - lava_callback - INFO - Starting async job submit for node 69b21357b0f5558b5d7cd08d 2026-03-14 01:14:06,292 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 01:14:06,306 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b21357b0f5558b5d7cd08d HTTP/1.1" 200 None 2026-03-14 01:14:06,307 - lava_callback - DEBUG - Processing node 69b21357b0f5558b5d7cd08d: baseline-arm64-baylibre 2026-03-14 01:14:06,308 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b21357b0f5558b5d7cd08d 2026-03-14 01:14:06,308 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 01:14:06,321 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b21357b0f5558b5d7cd08d HTTP/1.1" 200 None 2026-03-14 01:14:06,323 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 01:14:06,342 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69af6340275c8d3b79399dc3 HTTP/1.1" 200 None 2026-03-14 01:14:06,344 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 01:14:06,364 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b21357b0f5558b5d7cd08d HTTP/1.1" 200 None 2026-03-14 01:14:06,371 - lava_callback - ERROR - Error processing callback for node 69b21357b0f5558b5d7cd08d: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:52234 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56308 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:56316 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56384 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44968 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44980 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37784 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36684 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57272 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47248 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:47258 - "GET / HTTP/1.0" 200 OK 2026-03-14 01:15:26,348 - lava_callback - INFO - Received callback for node 69b213a6b0f5558b5d7cd09a INFO: 172.21.0.1:38618 - "POST /node/69b213a6b0f5558b5d7cd09a HTTP/1.0" 202 Accepted 2026-03-14 01:15:26,356 - lava_callback - INFO - Starting async job submit for node 69b213a6b0f5558b5d7cd09a 2026-03-14 01:15:26,357 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 01:15:26,372 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b213a6b0f5558b5d7cd09a HTTP/1.1" 200 None 2026-03-14 01:15:26,373 - lava_callback - DEBUG - Processing node 69b213a6b0f5558b5d7cd09a: baseline-arm64-baylibre 2026-03-14 01:15:26,373 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b213a6b0f5558b5d7cd09a 2026-03-14 01:15:26,374 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 01:15:26,387 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b213a6b0f5558b5d7cd09a HTTP/1.1" 200 None 2026-03-14 01:15:26,389 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 01:15:26,402 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69af6340275c8d3b79399dc3 HTTP/1.1" 200 None 2026-03-14 01:15:26,404 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 01:15:26,450 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b213a6b0f5558b5d7cd09a HTTP/1.1" 200 None 2026-03-14 01:15:26,452 - lava_callback - ERROR - Error processing callback for node 69b213a6b0f5558b5d7cd09a: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:38634 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44610 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44622 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41948 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46306 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36388 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53102 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:53112 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52044 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41062 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41076 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36074 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40800 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52934 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41332 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:41334 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46606 - "GET / HTTP/1.0" 200 OK 2026-03-14 01:17:27,145 - lava_callback - INFO - Received callback for node 69b2141db0f5558b5d7cd0b2 INFO: 172.21.0.1:46616 - "POST /node/69b2141db0f5558b5d7cd0b2 HTTP/1.0" 202 Accepted 2026-03-14 01:17:27,151 - lava_callback - INFO - Starting async job submit for node 69b2141db0f5558b5d7cd0b2 2026-03-14 01:17:27,152 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 01:17:27,197 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b2141db0f5558b5d7cd0b2 HTTP/1.1" 200 None 2026-03-14 01:17:27,198 - lava_callback - DEBUG - Processing node 69b2141db0f5558b5d7cd0b2: baseline-arm64-clabbe 2026-03-14 01:17:27,198 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b2141db0f5558b5d7cd0b2 2026-03-14 01:17:27,198 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 01:17:27,212 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b2141db0f5558b5d7cd0b2 HTTP/1.1" 200 None 2026-03-14 01:17:27,214 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 01:17:27,227 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69af6340275c8d3b79399dc3 HTTP/1.1" 200 None 2026-03-14 01:17:27,228 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 01:17:27,254 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b2141db0f5558b5d7cd0b2 HTTP/1.1" 200 None 2026-03-14 01:17:27,263 - lava_callback - ERROR - Error processing callback for node 69b2141db0f5558b5d7cd0b2: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:58982 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58992 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33008 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42016 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38910 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57004 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:57006 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48288 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56004 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56016 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57598 - "GET / HTTP/1.0" 200 OK 2026-03-14 01:18:47,196 - lava_callback - INFO - Received callback for node 69b2146cb0f5558b5d7cd0c2 INFO: 172.21.0.1:57608 - "POST /node/69b2146cb0f5558b5d7cd0c2 HTTP/1.0" 202 Accepted 2026-03-14 01:18:47,202 - lava_callback - INFO - Starting async job submit for node 69b2146cb0f5558b5d7cd0c2 2026-03-14 01:18:47,202 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 01:18:47,217 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b2146cb0f5558b5d7cd0c2 HTTP/1.1" 200 None 2026-03-14 01:18:47,217 - lava_callback - DEBUG - Processing node 69b2146cb0f5558b5d7cd0c2: baseline-arm64-clabbe 2026-03-14 01:18:47,218 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b2146cb0f5558b5d7cd0c2 2026-03-14 01:18:47,218 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 01:18:47,231 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b2146cb0f5558b5d7cd0c2 HTTP/1.1" 200 None 2026-03-14 01:18:47,232 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 01:18:47,245 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69af6340275c8d3b79399dc3 HTTP/1.1" 200 None 2026-03-14 01:18:47,247 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 01:18:47,267 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b2146cb0f5558b5d7cd0c2 HTTP/1.1" 200 None 2026-03-14 01:18:47,274 - lava_callback - ERROR - Error processing callback for node 69b2146cb0f5558b5d7cd0c2: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:36178 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47436 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60502 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:60514 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43840 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35502 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35514 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58824 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42364 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35372 - "GET / HTTP/1.0" 200 OK 2026-03-14 01:20:07,310 - lava_callback - INFO - Received callback for node 69b214bcb0f5558b5d7cd101 INFO: 172.21.0.1:35382 - "POST /node/69b214bcb0f5558b5d7cd101 HTTP/1.0" 202 Accepted 2026-03-14 01:20:07,315 - lava_callback - INFO - Starting async job submit for node 69b214bcb0f5558b5d7cd101 2026-03-14 01:20:07,316 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 01:20:07,331 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b214bcb0f5558b5d7cd101 HTTP/1.1" 200 None 2026-03-14 01:20:07,332 - lava_callback - DEBUG - Processing node 69b214bcb0f5558b5d7cd101: baseline-arm64-clabbe 2026-03-14 01:20:07,332 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b214bcb0f5558b5d7cd101 2026-03-14 01:20:07,333 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 01:20:07,347 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b214bcb0f5558b5d7cd101 HTTP/1.1" 200 None 2026-03-14 01:20:07,349 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 01:20:07,366 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69af6340275c8d3b79399dc3 HTTP/1.1" 200 None 2026-03-14 01:20:07,368 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 01:20:07,390 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b214bcb0f5558b5d7cd101 HTTP/1.1" 200 None 2026-03-14 01:20:07,392 - lava_callback - ERROR - Error processing callback for node 69b214bcb0f5558b5d7cd101: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:42426 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:42434 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33974 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40722 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40730 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35188 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37174 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33630 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35928 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:35930 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41132 - "GET / HTTP/1.0" 200 OK 2026-03-14 01:21:27,276 - lava_callback - INFO - Received callback for node 69b2150cb0f5558b5d7cd111 INFO: 172.21.0.1:41148 - "POST /node/69b2150cb0f5558b5d7cd111 HTTP/1.0" 202 Accepted 2026-03-14 01:21:27,281 - lava_callback - INFO - Starting async job submit for node 69b2150cb0f5558b5d7cd111 2026-03-14 01:21:27,282 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 01:21:27,327 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b2150cb0f5558b5d7cd111 HTTP/1.1" 200 None 2026-03-14 01:21:27,328 - lava_callback - DEBUG - Processing node 69b2150cb0f5558b5d7cd111: baseline-arm64-clabbe 2026-03-14 01:21:27,328 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b2150cb0f5558b5d7cd111 2026-03-14 01:21:27,329 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 01:21:27,343 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b2150cb0f5558b5d7cd111 HTTP/1.1" 200 None 2026-03-14 01:21:27,344 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 01:21:27,359 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69af6340275c8d3b79399dc3 HTTP/1.1" 200 None 2026-03-14 01:21:27,361 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 01:21:27,393 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b2150cb0f5558b5d7cd111 HTTP/1.1" 200 None 2026-03-14 01:21:27,394 - lava_callback - ERROR - Error processing callback for node 69b2150cb0f5558b5d7cd111: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:57984 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58000 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52448 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46342 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59974 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57930 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:57944 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46914 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41366 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41380 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:32908 - "GET / HTTP/1.0" 200 OK 2026-03-14 01:22:47,328 - lava_callback - INFO - Received callback for node 69b2155ab0f5558b5d7cd119 INFO: 172.21.0.1:32910 - "POST /node/69b2155ab0f5558b5d7cd119 HTTP/1.0" 202 Accepted 2026-03-14 01:22:47,333 - lava_callback - INFO - Starting async job submit for node 69b2155ab0f5558b5d7cd119 2026-03-14 01:22:47,334 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 01:22:47,353 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b2155ab0f5558b5d7cd119 HTTP/1.1" 200 None 2026-03-14 01:22:47,354 - lava_callback - DEBUG - Processing node 69b2155ab0f5558b5d7cd119: baseline-arm64-clabbe 2026-03-14 01:22:47,354 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b2155ab0f5558b5d7cd119 2026-03-14 01:22:47,355 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 01:22:47,368 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b2155ab0f5558b5d7cd119 HTTP/1.1" 200 None 2026-03-14 01:22:47,369 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 01:22:47,382 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69af6340275c8d3b79399dc3 HTTP/1.1" 200 None 2026-03-14 01:22:47,383 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 01:22:47,403 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b2155ab0f5558b5d7cd119 HTTP/1.1" 200 None 2026-03-14 01:22:47,405 - lava_callback - ERROR - Error processing callback for node 69b2155ab0f5558b5d7cd119: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:36914 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35624 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57866 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:57876 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44388 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33386 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33396 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59832 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51508 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57308 - "GET / HTTP/1.0" 200 OK 2026-03-14 01:24:07,430 - lava_callback - INFO - Received callback for node 69b215a8b0f5558b5d7cd12e INFO: 172.21.0.1:57324 - "POST /node/69b215a8b0f5558b5d7cd12e HTTP/1.0" 202 Accepted 2026-03-14 01:24:07,436 - lava_callback - INFO - Starting async job submit for node 69b215a8b0f5558b5d7cd12e 2026-03-14 01:24:07,436 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 01:24:07,451 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b215a8b0f5558b5d7cd12e HTTP/1.1" 200 None 2026-03-14 01:24:07,452 - lava_callback - DEBUG - Processing node 69b215a8b0f5558b5d7cd12e: baseline-arm64-clabbe 2026-03-14 01:24:07,452 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b215a8b0f5558b5d7cd12e 2026-03-14 01:24:07,453 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 01:24:07,466 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b215a8b0f5558b5d7cd12e HTTP/1.1" 200 None 2026-03-14 01:24:07,468 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 01:24:07,481 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69af6340275c8d3b79399dc3 HTTP/1.1" 200 None 2026-03-14 01:24:07,482 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 01:24:07,508 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b215a8b0f5558b5d7cd12e HTTP/1.1" 200 None 2026-03-14 01:24:07,514 - lava_callback - ERROR - Error processing callback for node 69b215a8b0f5558b5d7cd12e: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:54666 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:54682 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34008 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50142 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50152 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51210 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58492 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54188 - "GET / HTTP/1.0" 200 OK 2026-03-14 01:25:07,531 - lava_callback - INFO - Received callback for node 69b215e7b0f5558b5d7cd134 INFO: 172.21.0.1:54200 - "POST /node/69b215e7b0f5558b5d7cd134 HTTP/1.0" 202 Accepted 2026-03-14 01:25:07,537 - lava_callback - INFO - Starting async job submit for node 69b215e7b0f5558b5d7cd134 2026-03-14 01:25:07,537 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 01:25:07,557 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b215e7b0f5558b5d7cd134 HTTP/1.1" 200 None 2026-03-14 01:25:07,558 - lava_callback - DEBUG - Processing node 69b215e7b0f5558b5d7cd134: baseline-arm-clabbe 2026-03-14 01:25:07,558 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b215e7b0f5558b5d7cd134 2026-03-14 01:25:07,558 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 01:25:07,573 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b215e7b0f5558b5d7cd134 HTTP/1.1" 200 None 2026-03-14 01:25:07,574 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 01:25:07,589 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aeba33feb96b28aa34a775 HTTP/1.1" 200 None 2026-03-14 01:25:07,591 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 01:25:07,611 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b215e7b0f5558b5d7cd134 HTTP/1.1" 200 None 2026-03-14 01:25:07,617 - lava_callback - ERROR - Error processing callback for node 69b215e7b0f5558b5d7cd134: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:58732 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:58748 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42940 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52456 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52458 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53284 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37304 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46414 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46328 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:46332 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56320 - "GET / HTTP/1.0" 200 OK 2026-03-14 01:26:27,505 - lava_callback - INFO - Received callback for node 69b2162db0f5558b5d7cd14c INFO: 172.21.0.1:56334 - "POST /node/69b2162db0f5558b5d7cd14c HTTP/1.0" 202 Accepted 2026-03-14 01:26:27,511 - lava_callback - INFO - Starting async job submit for node 69b2162db0f5558b5d7cd14c 2026-03-14 01:26:27,511 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 01:26:27,526 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b2162db0f5558b5d7cd14c HTTP/1.1" 200 None 2026-03-14 01:26:27,527 - lava_callback - DEBUG - Processing node 69b2162db0f5558b5d7cd14c: baseline-arm-clabbe 2026-03-14 01:26:27,527 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b2162db0f5558b5d7cd14c 2026-03-14 01:26:27,528 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 01:26:27,541 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b2162db0f5558b5d7cd14c HTTP/1.1" 200 None 2026-03-14 01:26:27,542 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 01:26:27,555 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aeba33feb96b28aa34a775 HTTP/1.1" 200 None 2026-03-14 01:26:27,557 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 01:26:27,579 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b2162db0f5558b5d7cd14c HTTP/1.1" 200 None 2026-03-14 01:26:27,580 - lava_callback - ERROR - Error processing callback for node 69b2162db0f5558b5d7cd14c: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:57510 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57524 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57742 - "GET / HTTP/1.0" 200 OK 2026-03-14 01:26:47,503 - lava_callback - INFO - Received callback for node 69b21651b0f5558b5d7cd158 INFO: 172.21.0.1:57746 - "POST /node/69b21651b0f5558b5d7cd158 HTTP/1.0" 202 Accepted 2026-03-14 01:26:47,509 - lava_callback - INFO - Starting async job submit for node 69b21651b0f5558b5d7cd158 2026-03-14 01:26:47,509 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 01:26:47,524 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b21651b0f5558b5d7cd158 HTTP/1.1" 200 None 2026-03-14 01:26:47,525 - lava_callback - DEBUG - Processing node 69b21651b0f5558b5d7cd158: baseline-arm-clabbe 2026-03-14 01:26:47,526 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b21651b0f5558b5d7cd158 2026-03-14 01:26:47,526 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 01:26:47,544 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b21651b0f5558b5d7cd158 HTTP/1.1" 200 None 2026-03-14 01:26:47,546 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 01:26:47,563 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69acc009bcd207e915d76b94 HTTP/1.1" 200 None 2026-03-14 01:26:47,565 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 01:26:47,588 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b21651b0f5558b5d7cd158 HTTP/1.1" 200 None 2026-03-14 01:26:47,593 - lava_callback - ERROR - Error processing callback for node 69b21651b0f5558b5d7cd158: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:59822 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33128 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48112 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:48118 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54620 - "GET / HTTP/1.0" 200 OK 2026-03-14 01:27:27,572 - lava_callback - INFO - Received callback for node 69b21675b0f5558b5d7cd166 INFO: 172.21.0.1:54636 - "POST /node/69b21675b0f5558b5d7cd166 HTTP/1.0" 202 Accepted 2026-03-14 01:27:27,577 - lava_callback - INFO - Starting async job submit for node 69b21675b0f5558b5d7cd166 2026-03-14 01:27:27,578 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 01:27:27,603 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b21675b0f5558b5d7cd166 HTTP/1.1" 200 None 2026-03-14 01:27:27,604 - lava_callback - DEBUG - Processing node 69b21675b0f5558b5d7cd166: baseline-arm-clabbe 2026-03-14 01:27:27,604 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b21675b0f5558b5d7cd166 2026-03-14 01:27:27,605 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 01:27:27,618 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b21675b0f5558b5d7cd166 HTTP/1.1" 200 None 2026-03-14 01:27:27,620 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 01:27:27,633 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69acc009bcd207e915d76b94 HTTP/1.1" 200 None 2026-03-14 01:27:27,634 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 01:27:27,677 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b21675b0f5558b5d7cd166 HTTP/1.1" 200 None 2026-03-14 01:27:27,678 - lava_callback - ERROR - Error processing callback for node 69b21675b0f5558b5d7cd166: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:52508 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52510 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35726 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38912 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50486 - "GET / HTTP/1.0" 200 OK 2026-03-14 01:28:07,553 - lava_callback - INFO - Received callback for node 69b21699b0f5558b5d7cd170 INFO: 172.21.0.1:50490 - "POST /node/69b21699b0f5558b5d7cd170 HTTP/1.0" 202 Accepted 2026-03-14 01:28:07,558 - lava_callback - INFO - Starting async job submit for node 69b21699b0f5558b5d7cd170 2026-03-14 01:28:07,559 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 01:28:07,573 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b21699b0f5558b5d7cd170 HTTP/1.1" 200 None 2026-03-14 01:28:07,574 - lava_callback - DEBUG - Processing node 69b21699b0f5558b5d7cd170: baseline-arm-clabbe 2026-03-14 01:28:07,575 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b21699b0f5558b5d7cd170 2026-03-14 01:28:07,575 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 01:28:07,589 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b21699b0f5558b5d7cd170 HTTP/1.1" 200 None 2026-03-14 01:28:07,590 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 01:28:07,621 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69acc009bcd207e915d76b94 HTTP/1.1" 200 None 2026-03-14 01:28:07,623 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 01:28:07,668 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b21699b0f5558b5d7cd170 HTTP/1.1" 200 None 2026-03-14 01:28:07,669 - lava_callback - ERROR - Error processing callback for node 69b21699b0f5558b5d7cd170: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:60108 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:60110 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34736 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60838 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60842 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57714 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53188 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47736 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57914 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:57918 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46900 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60312 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60328 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60392 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34650 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41294 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59244 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:59246 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56232 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51140 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51142 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40534 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54706 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37228 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54680 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:54684 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36230 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44756 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44762 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51334 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36348 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38834 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49566 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:49580 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35590 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49568 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49570 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33482 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44514 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50654 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50668 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52638 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:52642 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38108 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38114 - "GET /favicon.ico HTTP/1.0" 404 Not Found INFO: 172.21.0.1:46038 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46054 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49700 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49482 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53054 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47206 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:47208 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48494 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46626 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46636 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35804 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45410 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52098 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48844 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:48852 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48934 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50260 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50266 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45924 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41962 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38462 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42136 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:42152 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35768 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52334 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52348 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55340 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42812 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33684 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53436 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:53442 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55732 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35766 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35768 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58554 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58898 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56640 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42852 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:42864 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33154 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50000 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50004 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44114 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60972 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43046 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54758 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:54766 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41564 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38406 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38416 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46306 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54056 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47426 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54808 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:54822 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41352 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51836 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51846 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48036 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47326 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52370 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33676 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:33682 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53854 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58806 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58814 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53788 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54448 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47954 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47790 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:47794 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51228 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57124 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57136 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42196 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39252 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36538 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49596 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:49604 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58110 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50316 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50324 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36324 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55554 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38062 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54370 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:54376 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38270 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50056 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50072 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36148 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49636 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38452 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36790 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:36796 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52780 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36544 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36556 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54018 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58546 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37854 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41320 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:41334 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39978 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:32908 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:32920 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34844 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44558 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37380 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60448 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:60458 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58944 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33446 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33460 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34900 - "GET / HTTP/1.0" 200 OK 2026-03-14 01:47:48,243 - lava_callback - INFO - Received callback for node 69b21b38b0f5558b5d7cd27a INFO: 172.21.0.1:34910 - "POST /node/69b21b38b0f5558b5d7cd27a HTTP/1.0" 202 Accepted 2026-03-14 01:47:48,249 - lava_callback - INFO - Starting async job submit for node 69b21b38b0f5558b5d7cd27a 2026-03-14 01:47:48,250 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 01:47:48,289 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b21b38b0f5558b5d7cd27a HTTP/1.1" 200 None 2026-03-14 01:47:48,290 - lava_callback - DEBUG - Processing node 69b21b38b0f5558b5d7cd27a: baseline-arm64-baylibre 2026-03-14 01:47:48,290 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b21b38b0f5558b5d7cd27a 2026-03-14 01:47:48,291 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 01:47:48,322 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b21b38b0f5558b5d7cd27a HTTP/1.1" 200 None 2026-03-14 01:47:48,324 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 01:47:48,371 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b1960ba26b422765ba3717 HTTP/1.1" 200 None 2026-03-14 01:47:48,372 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 01:47:48,394 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b21b38b0f5558b5d7cd27a HTTP/1.1" 200 None 2026-03-14 01:47:48,402 - lava_callback - ERROR - Error processing callback for node 69b21b38b0f5558b5d7cd27a: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:59102 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54930 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59556 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:59570 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56116 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37250 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37258 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54134 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45898 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49980 - "GET / HTTP/1.0" 200 OK 2026-03-14 01:49:08,160 - lava_callback - INFO - Received callback for node 69b21b86b0f5558b5d7cd28a INFO: 172.21.0.1:49990 - "POST /node/69b21b86b0f5558b5d7cd28a HTTP/1.0" 202 Accepted 2026-03-14 01:49:08,165 - lava_callback - INFO - Starting async job submit for node 69b21b86b0f5558b5d7cd28a 2026-03-14 01:49:08,166 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 01:49:08,189 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b21b86b0f5558b5d7cd28a HTTP/1.1" 200 None 2026-03-14 01:49:08,190 - lava_callback - DEBUG - Processing node 69b21b86b0f5558b5d7cd28a: baseline-arm64-baylibre 2026-03-14 01:49:08,190 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b21b86b0f5558b5d7cd28a 2026-03-14 01:49:08,191 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 01:49:08,205 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b21b86b0f5558b5d7cd28a HTTP/1.1" 200 None 2026-03-14 01:49:08,206 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 01:49:08,222 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b1960ba26b422765ba3717 HTTP/1.1" 200 None 2026-03-14 01:49:08,223 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 01:49:08,254 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b21b86b0f5558b5d7cd28a HTTP/1.1" 200 None 2026-03-14 01:49:08,256 - lava_callback - ERROR - Error processing callback for node 69b21b86b0f5558b5d7cd28a: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:37624 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:37626 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54946 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51102 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51110 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49436 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48410 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46448 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49396 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:49410 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46310 - "GET / HTTP/1.0" 200 OK 2026-03-14 01:50:28,358 - lava_callback - INFO - Received callback for node 69b21bd4b0f5558b5d7cd292 INFO: 172.21.0.1:46312 - "POST /node/69b21bd4b0f5558b5d7cd292 HTTP/1.0" 202 Accepted 2026-03-14 01:50:28,363 - lava_callback - INFO - Starting async job submit for node 69b21bd4b0f5558b5d7cd292 2026-03-14 01:50:28,364 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 01:50:28,379 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b21bd4b0f5558b5d7cd292 HTTP/1.1" 200 None 2026-03-14 01:50:28,380 - lava_callback - DEBUG - Processing node 69b21bd4b0f5558b5d7cd292: baseline-arm64-baylibre 2026-03-14 01:50:28,380 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b21bd4b0f5558b5d7cd292 2026-03-14 01:50:28,381 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 01:50:28,394 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b21bd4b0f5558b5d7cd292 HTTP/1.1" 200 None 2026-03-14 01:50:28,396 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 01:50:28,411 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b1960ba26b422765ba3717 HTTP/1.1" 200 None 2026-03-14 01:50:28,413 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 01:50:28,439 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b21bd4b0f5558b5d7cd292 HTTP/1.1" 200 None 2026-03-14 01:50:28,440 - lava_callback - ERROR - Error processing callback for node 69b21bd4b0f5558b5d7cd292: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:46938 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46942 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48440 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52538 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:32926 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49192 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:49206 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42436 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55168 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55174 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51684 - "GET / HTTP/1.0" 200 OK 2026-03-14 01:51:48,246 - lava_callback - INFO - Received callback for node 69b21c24b0f5558b5d7cd2a2 INFO: 172.21.0.1:51696 - "POST /node/69b21c24b0f5558b5d7cd2a2 HTTP/1.0" 202 Accepted 2026-03-14 01:51:48,251 - lava_callback - INFO - Starting async job submit for node 69b21c24b0f5558b5d7cd2a2 2026-03-14 01:51:48,252 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 01:51:48,267 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b21c24b0f5558b5d7cd2a2 HTTP/1.1" 200 None 2026-03-14 01:51:48,268 - lava_callback - DEBUG - Processing node 69b21c24b0f5558b5d7cd2a2: baseline-arm64-baylibre 2026-03-14 01:51:48,268 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b21c24b0f5558b5d7cd2a2 2026-03-14 01:51:48,269 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 01:51:48,288 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b21c24b0f5558b5d7cd2a2 HTTP/1.1" 200 None 2026-03-14 01:51:48,289 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 01:51:48,302 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b1960ba26b422765ba3717 HTTP/1.1" 200 None 2026-03-14 01:51:48,304 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 01:51:48,327 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b21c24b0f5558b5d7cd2a2 HTTP/1.1" 200 None 2026-03-14 01:51:48,333 - lava_callback - ERROR - Error processing callback for node 69b21c24b0f5558b5d7cd2a2: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:52064 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35094 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49300 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:49312 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37432 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56998 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57010 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34908 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39694 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38618 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46016 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:46026 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33206 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59622 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59632 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53002 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60196 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57584 - "GET / HTTP/1.0" 200 OK 2026-03-14 01:54:08,404 - lava_callback - INFO - Received callback for node 69b21cbeb0f5558b5d7cd2c2 INFO: 172.21.0.1:57590 - "POST /node/69b21cbeb0f5558b5d7cd2c2 HTTP/1.0" 202 Accepted 2026-03-14 01:54:08,410 - lava_callback - INFO - Starting async job submit for node 69b21cbeb0f5558b5d7cd2c2 2026-03-14 01:54:08,410 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 01:54:08,425 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b21cbeb0f5558b5d7cd2c2 HTTP/1.1" 200 None 2026-03-14 01:54:08,426 - lava_callback - DEBUG - Processing node 69b21cbeb0f5558b5d7cd2c2: baseline-arm64-baylibre 2026-03-14 01:54:08,426 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b21cbeb0f5558b5d7cd2c2 2026-03-14 01:54:08,427 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 01:54:08,442 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b21cbeb0f5558b5d7cd2c2 HTTP/1.1" 200 None 2026-03-14 01:54:08,443 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 01:54:08,458 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b1960ba26b422765ba3717 HTTP/1.1" 200 None 2026-03-14 01:54:08,460 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 01:54:08,491 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b21cbeb0f5558b5d7cd2c2 HTTP/1.1" 200 None 2026-03-14 01:54:08,494 - lava_callback - ERROR - Error processing callback for node 69b21cbeb0f5558b5d7cd2c2: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:44612 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:44620 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50736 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42216 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42220 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36198 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36412 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46910 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59854 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:59866 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57254 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48786 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48798 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59948 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49716 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50132 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52768 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:52780 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58078 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52476 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52478 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50174 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56772 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41446 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34878 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:34890 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49010 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60480 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60490 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52146 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33212 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60216 - "GET / HTTP/1.0" 200 OK 2026-03-14 01:58:08,892 - lava_callback - INFO - Received callback for node 69b21dacb0f5558b5d7cd2fd INFO: 172.21.0.1:60228 - "POST /node/69b21dacb0f5558b5d7cd2fd HTTP/1.0" 202 Accepted 2026-03-14 01:58:08,897 - lava_callback - INFO - Starting async job submit for node 69b21dacb0f5558b5d7cd2fd 2026-03-14 01:58:08,898 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 01:58:08,912 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b21dacb0f5558b5d7cd2fd HTTP/1.1" 200 None 2026-03-14 01:58:08,913 - lava_callback - DEBUG - Processing node 69b21dacb0f5558b5d7cd2fd: baseline-arm64-clabbe 2026-03-14 01:58:08,913 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b21dacb0f5558b5d7cd2fd 2026-03-14 01:58:08,914 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 01:58:08,950 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b21dacb0f5558b5d7cd2fd HTTP/1.1" 200 None 2026-03-14 01:58:08,952 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 01:58:08,965 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b1960ba26b422765ba3717 HTTP/1.1" 200 None 2026-03-14 01:58:08,966 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 01:58:09,003 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b21dacb0f5558b5d7cd2fd HTTP/1.1" 200 None 2026-03-14 01:58:09,005 - lava_callback - ERROR - Error processing callback for node 69b21dacb0f5558b5d7cd2fd: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:39134 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:39148 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55174 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33882 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33886 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40884 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50588 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59482 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60386 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:60392 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43888 - "GET / HTTP/1.0" 200 OK 2026-03-14 01:59:28,941 - lava_callback - INFO - Received callback for node 69b21dfbb0f5558b5d7cd31b INFO: 172.21.0.1:43890 - "POST /node/69b21dfbb0f5558b5d7cd31b HTTP/1.0" 202 Accepted 2026-03-14 01:59:28,947 - lava_callback - INFO - Starting async job submit for node 69b21dfbb0f5558b5d7cd31b 2026-03-14 01:59:28,947 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 01:59:28,962 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b21dfbb0f5558b5d7cd31b HTTP/1.1" 200 None 2026-03-14 01:59:28,963 - lava_callback - DEBUG - Processing node 69b21dfbb0f5558b5d7cd31b: baseline-arm64-clabbe 2026-03-14 01:59:28,963 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b21dfbb0f5558b5d7cd31b 2026-03-14 01:59:28,964 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 01:59:28,980 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b21dfbb0f5558b5d7cd31b HTTP/1.1" 200 None 2026-03-14 01:59:28,981 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 01:59:28,995 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b1960ba26b422765ba3717 HTTP/1.1" 200 None 2026-03-14 01:59:28,996 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 01:59:29,020 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b21dfbb0f5558b5d7cd31b HTTP/1.1" 200 None 2026-03-14 01:59:29,022 - lava_callback - ERROR - Error processing callback for node 69b21dfbb0f5558b5d7cd31b: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:40572 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40580 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50298 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57264 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50592 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51686 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:51698 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43946 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58424 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58430 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53482 - "GET / HTTP/1.0" 200 OK 2026-03-14 02:00:49,022 - lava_callback - INFO - Received callback for node 69b21e4bb0f5558b5d7cd327 INFO: 172.21.0.1:53490 - "POST /node/69b21e4bb0f5558b5d7cd327 HTTP/1.0" 202 Accepted 2026-03-14 02:00:49,028 - lava_callback - INFO - Starting async job submit for node 69b21e4bb0f5558b5d7cd327 2026-03-14 02:00:49,028 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 02:00:49,043 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b21e4bb0f5558b5d7cd327 HTTP/1.1" 200 None 2026-03-14 02:00:49,044 - lava_callback - DEBUG - Processing node 69b21e4bb0f5558b5d7cd327: baseline-arm64-clabbe 2026-03-14 02:00:49,044 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b21e4bb0f5558b5d7cd327 2026-03-14 02:00:49,045 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 02:00:49,058 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b21e4bb0f5558b5d7cd327 HTTP/1.1" 200 None 2026-03-14 02:00:49,059 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 02:00:49,074 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b1960ba26b422765ba3717 HTTP/1.1" 200 None 2026-03-14 02:00:49,076 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 02:00:49,102 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b21e4bb0f5558b5d7cd327 HTTP/1.1" 200 None 2026-03-14 02:00:49,104 - lava_callback - ERROR - Error processing callback for node 69b21e4bb0f5558b5d7cd327: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:45698 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40412 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47612 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:47616 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49390 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58984 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58990 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38224 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51454 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40946 - "GET / HTTP/1.0" 200 OK 2026-03-14 02:02:09,045 - lava_callback - INFO - Received callback for node 69b21e9ab0f5558b5d7cd336 INFO: 172.21.0.1:40952 - "POST /node/69b21e9ab0f5558b5d7cd336 HTTP/1.0" 202 Accepted 2026-03-14 02:02:09,050 - lava_callback - INFO - Starting async job submit for node 69b21e9ab0f5558b5d7cd336 2026-03-14 02:02:09,051 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 02:02:09,066 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b21e9ab0f5558b5d7cd336 HTTP/1.1" 200 None 2026-03-14 02:02:09,067 - lava_callback - DEBUG - Processing node 69b21e9ab0f5558b5d7cd336: baseline-arm64-clabbe 2026-03-14 02:02:09,067 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b21e9ab0f5558b5d7cd336 2026-03-14 02:02:09,068 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 02:02:09,081 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b21e9ab0f5558b5d7cd336 HTTP/1.1" 200 None 2026-03-14 02:02:09,082 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 02:02:09,103 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b1960ba26b422765ba3717 HTTP/1.1" 200 None 2026-03-14 02:02:09,109 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 02:02:09,135 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b21e9ab0f5558b5d7cd336 HTTP/1.1" 200 None 2026-03-14 02:02:09,145 - lava_callback - ERROR - Error processing callback for node 69b21e9ab0f5558b5d7cd336: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:41890 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:41900 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59558 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42018 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42032 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37228 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57162 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37518 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34104 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:34110 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39846 - "GET / HTTP/1.0" 200 OK 2026-03-14 02:03:29,124 - lava_callback - INFO - Received callback for node 69b21ee9b0f5558b5d7cd346 INFO: 172.21.0.1:39862 - "POST /node/69b21ee9b0f5558b5d7cd346 HTTP/1.0" 202 Accepted 2026-03-14 02:03:29,129 - lava_callback - INFO - Starting async job submit for node 69b21ee9b0f5558b5d7cd346 2026-03-14 02:03:29,130 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 02:03:29,144 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b21ee9b0f5558b5d7cd346 HTTP/1.1" 200 None 2026-03-14 02:03:29,145 - lava_callback - DEBUG - Processing node 69b21ee9b0f5558b5d7cd346: baseline-arm64-clabbe 2026-03-14 02:03:29,145 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b21ee9b0f5558b5d7cd346 2026-03-14 02:03:29,146 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 02:03:29,160 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b21ee9b0f5558b5d7cd346 HTTP/1.1" 200 None 2026-03-14 02:03:29,161 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 02:03:29,183 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b1960ba26b422765ba3717 HTTP/1.1" 200 None 2026-03-14 02:03:29,184 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 02:03:29,209 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b21ee9b0f5558b5d7cd346 HTTP/1.1" 200 None 2026-03-14 02:03:29,214 - lava_callback - ERROR - Error processing callback for node 69b21ee9b0f5558b5d7cd346: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:46928 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46944 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51576 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59200 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56362 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42876 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:42886 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55060 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33276 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33286 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35052 - "GET / HTTP/1.0" 200 OK 2026-03-14 02:04:49,177 - lava_callback - INFO - Received callback for node 69b21f38b0f5558b5d7cd34f INFO: 172.21.0.1:35066 - "POST /node/69b21f38b0f5558b5d7cd34f HTTP/1.0" 202 Accepted 2026-03-14 02:04:49,183 - lava_callback - INFO - Starting async job submit for node 69b21f38b0f5558b5d7cd34f 2026-03-14 02:04:49,183 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 02:04:49,197 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b21f38b0f5558b5d7cd34f HTTP/1.1" 200 None 2026-03-14 02:04:49,198 - lava_callback - DEBUG - Processing node 69b21f38b0f5558b5d7cd34f: baseline-arm64-clabbe 2026-03-14 02:04:49,198 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b21f38b0f5558b5d7cd34f 2026-03-14 02:04:49,199 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 02:04:49,212 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b21f38b0f5558b5d7cd34f HTTP/1.1" 200 None 2026-03-14 02:04:49,214 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 02:04:49,226 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b1960ba26b422765ba3717 HTTP/1.1" 200 None 2026-03-14 02:04:49,228 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 02:04:49,248 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b21f38b0f5558b5d7cd34f HTTP/1.1" 200 None 2026-03-14 02:04:49,249 - lava_callback - ERROR - Error processing callback for node 69b21f38b0f5558b5d7cd34f: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:50428 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59930 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34666 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:34672 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45588 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35824 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35840 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50926 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39764 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34578 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46924 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:46932 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49256 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38876 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38880 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57136 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34998 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49704 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37634 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:37650 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41684 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44474 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44488 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55042 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56814 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37878 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47860 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:47868 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46454 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59098 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59102 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33900 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41028 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44796 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51754 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:51770 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58698 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60638 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60654 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56418 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43618 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52012 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43160 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:43172 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52100 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47694 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47696 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48278 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34356 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35550 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37516 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:37520 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38724 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52878 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52890 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37472 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44064 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44894 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47184 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:47186 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59214 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34502 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34512 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42548 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46472 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59698 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54002 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:54008 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46480 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42700 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42714 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51430 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59726 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53218 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60488 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:60504 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33294 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40900 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40908 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39788 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55174 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51366 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37004 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:37018 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40202 - "GET / HTTP/1.0" 200 OK 2026-03-14 02:15:29,951 - lava_callback - INFO - Received callback for node 69b221beb0f5558b5d7cd3d1 INFO: 172.21.0.1:44040 - "POST /node/69b221beb0f5558b5d7cd3d1 HTTP/1.0" 202 Accepted 2026-03-14 02:15:29,957 - lava_callback - INFO - Starting async job submit for node 69b221beb0f5558b5d7cd3d1 2026-03-14 02:15:29,958 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 02:15:29,977 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b221beb0f5558b5d7cd3d1 HTTP/1.1" 200 None 2026-03-14 02:15:29,978 - lava_callback - DEBUG - Processing node 69b221beb0f5558b5d7cd3d1: baseline-arm64-baylibre 2026-03-14 02:15:29,978 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b221beb0f5558b5d7cd3d1 2026-03-14 02:15:29,979 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 02:15:29,994 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b221beb0f5558b5d7cd3d1 HTTP/1.1" 200 None 2026-03-14 02:15:29,995 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 02:15:30,032 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aeba41feb96b28aa34a78b HTTP/1.1" 200 None 2026-03-14 02:15:30,033 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 02:15:30,081 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b221beb0f5558b5d7cd3d1 HTTP/1.1" 200 None 2026-03-14 02:15:30,082 - lava_callback - ERROR - Error processing callback for node 69b221beb0f5558b5d7cd3d1: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:44044 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44048 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55454 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44490 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54420 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33140 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:33148 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41144 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46966 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46978 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58234 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44104 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48764 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45006 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:45012 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54976 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42008 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42020 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41908 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54720 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50898 - "GET / HTTP/1.0" 200 OK 2026-03-14 02:18:10,080 - lava_callback - INFO - Received callback for node 69b22257b0f5558b5d7cd3ec INFO: 172.21.0.1:38788 - "POST /node/69b22257b0f5558b5d7cd3ec HTTP/1.0" 202 Accepted 2026-03-14 02:18:10,086 - lava_callback - INFO - Starting async job submit for node 69b22257b0f5558b5d7cd3ec 2026-03-14 02:18:10,087 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 02:18:10,101 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b22257b0f5558b5d7cd3ec HTTP/1.1" 200 None 2026-03-14 02:18:10,102 - lava_callback - DEBUG - Processing node 69b22257b0f5558b5d7cd3ec: baseline-arm64-baylibre 2026-03-14 02:18:10,103 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b22257b0f5558b5d7cd3ec 2026-03-14 02:18:10,103 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 02:18:10,149 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b22257b0f5558b5d7cd3ec HTTP/1.1" 200 None 2026-03-14 02:18:10,151 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 02:18:10,186 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aeba41feb96b28aa34a78b HTTP/1.1" 200 None 2026-03-14 02:18:10,187 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 02:18:10,212 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b22257b0f5558b5d7cd3ec HTTP/1.1" 200 None 2026-03-14 02:18:10,213 - lava_callback - ERROR - Error processing callback for node 69b22257b0f5558b5d7cd3ec: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:38798 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:38800 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52060 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46926 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46938 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34856 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37294 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58320 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36618 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:36632 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56982 - "GET / HTTP/1.0" 200 OK 2026-03-14 02:19:29,925 - lava_callback - INFO - Received callback for node 69b222a5b0f5558b5d7cd401 INFO: 172.21.0.1:48040 - "POST /node/69b222a5b0f5558b5d7cd401 HTTP/1.0" 202 Accepted 2026-03-14 02:19:29,930 - lava_callback - INFO - Starting async job submit for node 69b222a5b0f5558b5d7cd401 2026-03-14 02:19:29,931 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 02:19:29,952 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b222a5b0f5558b5d7cd401 HTTP/1.1" 200 None 2026-03-14 02:19:29,953 - lava_callback - DEBUG - Processing node 69b222a5b0f5558b5d7cd401: baseline-arm64-baylibre 2026-03-14 02:19:29,953 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b222a5b0f5558b5d7cd401 2026-03-14 02:19:29,954 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 02:19:29,975 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b222a5b0f5558b5d7cd401 HTTP/1.1" 200 None 2026-03-14 02:19:29,976 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 02:19:29,989 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aa1d4a8c4d487a0e751161 HTTP/1.1" 200 None 2026-03-14 02:19:29,991 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 02:19:30,033 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b222a5b0f5558b5d7cd401 HTTP/1.1" 200 None 2026-03-14 02:19:30,035 - lava_callback - ERROR - Error processing callback for node 69b222a5b0f5558b5d7cd401: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:48046 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48060 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55030 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43644 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54678 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38720 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:38732 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55048 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34552 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34556 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60918 - "GET / HTTP/1.0" 200 OK 2026-03-14 02:20:49,844 - lava_callback - INFO - Received callback for node 69b222fab0f5558b5d7cd411 INFO: 172.21.0.1:41300 - "POST /node/69b222fab0f5558b5d7cd411 HTTP/1.0" 202 Accepted 2026-03-14 02:20:49,850 - lava_callback - INFO - Starting async job submit for node 69b222fab0f5558b5d7cd411 2026-03-14 02:20:49,850 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 02:20:49,874 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b222fab0f5558b5d7cd411 HTTP/1.1" 200 None 2026-03-14 02:20:49,875 - lava_callback - DEBUG - Processing node 69b222fab0f5558b5d7cd411: baseline-arm64-clabbe 2026-03-14 02:20:49,875 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b222fab0f5558b5d7cd411 2026-03-14 02:20:49,876 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 02:20:49,900 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b222fab0f5558b5d7cd411 HTTP/1.1" 200 None 2026-03-14 02:20:49,902 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 02:20:49,915 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aeba41feb96b28aa34a78b HTTP/1.1" 200 None 2026-03-14 02:20:49,917 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 02:20:49,965 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b222fab0f5558b5d7cd411 HTTP/1.1" 200 None 2026-03-14 02:20:49,971 - lava_callback - ERROR - Error processing callback for node 69b222fab0f5558b5d7cd411: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:41312 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38476 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50108 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:50112 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35428 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38226 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38240 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33708 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58792 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38310 - "GET / HTTP/1.0" 200 OK 2026-03-14 02:22:09,901 - lava_callback - INFO - Received callback for node 69b22348b0f5558b5d7cd42c INFO: 172.21.0.1:32900 - "POST /node/69b22348b0f5558b5d7cd42c HTTP/1.0" 202 Accepted 2026-03-14 02:22:09,907 - lava_callback - INFO - Starting async job submit for node 69b22348b0f5558b5d7cd42c 2026-03-14 02:22:09,908 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 02:22:09,922 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b22348b0f5558b5d7cd42c HTTP/1.1" 200 None 2026-03-14 02:22:09,923 - lava_callback - DEBUG - Processing node 69b22348b0f5558b5d7cd42c: baseline-arm64-clabbe 2026-03-14 02:22:09,923 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b22348b0f5558b5d7cd42c 2026-03-14 02:22:09,924 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 02:22:09,947 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b22348b0f5558b5d7cd42c HTTP/1.1" 200 None 2026-03-14 02:22:09,948 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 02:22:09,964 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aa1d4a8c4d487a0e751161 HTTP/1.1" 200 None 2026-03-14 02:22:09,966 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 02:22:09,987 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b22348b0f5558b5d7cd42c HTTP/1.1" 200 None 2026-03-14 02:22:09,992 - lava_callback - ERROR - Error processing callback for node 69b22348b0f5558b5d7cd42c: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:32908 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:32922 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34950 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41896 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41908 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48876 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50852 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59702 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41374 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:41384 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55336 - "GET / HTTP/1.0" 200 OK 2026-03-14 02:23:29,929 - lava_callback - INFO - Received callback for node 69b22395b0f5558b5d7cd443 INFO: 172.21.0.1:42076 - "POST /node/69b22395b0f5558b5d7cd443 HTTP/1.0" 202 Accepted 2026-03-14 02:23:29,934 - lava_callback - INFO - Starting async job submit for node 69b22395b0f5558b5d7cd443 2026-03-14 02:23:29,935 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 02:23:29,950 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b22395b0f5558b5d7cd443 HTTP/1.1" 200 None 2026-03-14 02:23:29,951 - lava_callback - DEBUG - Processing node 69b22395b0f5558b5d7cd443: baseline-arm64-clabbe 2026-03-14 02:23:29,951 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b22395b0f5558b5d7cd443 2026-03-14 02:23:29,952 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 02:23:29,966 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b22395b0f5558b5d7cd443 HTTP/1.1" 200 None 2026-03-14 02:23:29,967 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 02:23:30,011 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aeba41feb96b28aa34a78b HTTP/1.1" 200 None 2026-03-14 02:23:30,012 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 02:23:30,042 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b22395b0f5558b5d7cd443 HTTP/1.1" 200 None 2026-03-14 02:23:30,044 - lava_callback - ERROR - Error processing callback for node 69b22395b0f5558b5d7cd443: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:42082 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42084 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36644 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51332 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39844 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55070 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:55078 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50504 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39136 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39140 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47894 - "GET / HTTP/1.0" 200 OK 2026-03-14 02:24:49,986 - lava_callback - INFO - Received callback for node 69b223e4b0f5558b5d7cd450 INFO: 172.21.0.1:57072 - "POST /node/69b223e4b0f5558b5d7cd450 HTTP/1.0" 202 Accepted 2026-03-14 02:24:49,991 - lava_callback - INFO - Starting async job submit for node 69b223e4b0f5558b5d7cd450 2026-03-14 02:24:49,992 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 02:24:50,028 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b223e4b0f5558b5d7cd450 HTTP/1.1" 200 None 2026-03-14 02:24:50,029 - lava_callback - DEBUG - Processing node 69b223e4b0f5558b5d7cd450: baseline-arm64-clabbe 2026-03-14 02:24:50,029 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b223e4b0f5558b5d7cd450 2026-03-14 02:24:50,030 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 02:24:50,173 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b223e4b0f5558b5d7cd450 HTTP/1.1" 200 None 2026-03-14 02:24:50,175 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 02:24:50,188 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aeba41feb96b28aa34a78b HTTP/1.1" 200 None 2026-03-14 02:24:50,189 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 02:24:50,209 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b223e4b0f5558b5d7cd450 HTTP/1.1" 200 None 2026-03-14 02:24:50,219 - lava_callback - ERROR - Error processing callback for node 69b223e4b0f5558b5d7cd450: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:57078 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47064 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39614 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:39618 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57418 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55022 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55028 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58634 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52194 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45794 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43718 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:43724 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43400 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60450 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60460 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35348 - "GET / HTTP/1.0" 200 OK 2026-03-14 02:26:50,133 - lava_callback - INFO - Received callback for node 69b22456b0f5558b5d7cd46b INFO: 172.21.0.1:46234 - "POST /node/69b22456b0f5558b5d7cd46b HTTP/1.0" 202 Accepted 2026-03-14 02:26:50,138 - lava_callback - INFO - Starting async job submit for node 69b22456b0f5558b5d7cd46b 2026-03-14 02:26:50,139 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 02:26:50,162 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b22456b0f5558b5d7cd46b HTTP/1.1" 200 None 2026-03-14 02:26:50,163 - lava_callback - DEBUG - Processing node 69b22456b0f5558b5d7cd46b: baseline-arm64-clabbe 2026-03-14 02:26:50,163 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b22456b0f5558b5d7cd46b 2026-03-14 02:26:50,164 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 02:26:50,177 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b22456b0f5558b5d7cd46b HTTP/1.1" 200 None 2026-03-14 02:26:50,179 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 02:26:50,216 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aa1d4a8c4d487a0e751161 HTTP/1.1" 200 None 2026-03-14 02:26:50,217 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 02:26:50,249 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b22456b0f5558b5d7cd46b HTTP/1.1" 200 None 2026-03-14 02:26:50,251 - lava_callback - ERROR - Error processing callback for node 69b22456b0f5558b5d7cd46b: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:46240 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52312 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35074 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:35082 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36934 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34890 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34894 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36530 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54742 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52462 - "GET / HTTP/1.0" 200 OK 2026-03-14 02:28:10,152 - lava_callback - INFO - Received callback for node 69b224a4b0f5558b5d7cd47a INFO: 172.21.0.1:60334 - "POST /node/69b224a4b0f5558b5d7cd47a HTTP/1.0" 202 Accepted 2026-03-14 02:28:10,157 - lava_callback - INFO - Starting async job submit for node 69b224a4b0f5558b5d7cd47a 2026-03-14 02:28:10,158 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 02:28:10,172 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b224a4b0f5558b5d7cd47a HTTP/1.1" 200 None 2026-03-14 02:28:10,173 - lava_callback - DEBUG - Processing node 69b224a4b0f5558b5d7cd47a: baseline-arm64-clabbe 2026-03-14 02:28:10,174 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b224a4b0f5558b5d7cd47a 2026-03-14 02:28:10,174 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 02:28:10,187 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b224a4b0f5558b5d7cd47a HTTP/1.1" 200 None 2026-03-14 02:28:10,189 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 02:28:10,202 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aeba41feb96b28aa34a78b HTTP/1.1" 200 None 2026-03-14 02:28:10,204 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 02:28:10,225 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b224a4b0f5558b5d7cd47a HTTP/1.1" 200 None 2026-03-14 02:28:10,230 - lava_callback - ERROR - Error processing callback for node 69b224a4b0f5558b5d7cd47a: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:60342 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:60350 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43950 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42390 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42392 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57870 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43446 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60474 - "GET / HTTP/1.0" 200 OK 2026-03-14 02:29:10,166 - lava_callback - INFO - Received callback for node 69b224f2b0f5558b5d7cd482 INFO: 172.21.0.1:44432 - "POST /node/69b224f2b0f5558b5d7cd482 HTTP/1.0" 202 Accepted 2026-03-14 02:29:10,172 - lava_callback - INFO - Starting async job submit for node 69b224f2b0f5558b5d7cd482 2026-03-14 02:29:10,173 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 02:29:10,191 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b224f2b0f5558b5d7cd482 HTTP/1.1" 200 None 2026-03-14 02:29:10,192 - lava_callback - DEBUG - Processing node 69b224f2b0f5558b5d7cd482: baseline-arm64-clabbe 2026-03-14 02:29:10,192 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b224f2b0f5558b5d7cd482 2026-03-14 02:29:10,193 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 02:29:10,205 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b224f2b0f5558b5d7cd482 HTTP/1.1" 200 None 2026-03-14 02:29:10,206 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 02:29:10,228 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aeba41feb96b28aa34a78b HTTP/1.1" 200 None 2026-03-14 02:29:10,229 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 02:29:10,275 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b224f2b0f5558b5d7cd482 HTTP/1.1" 200 None 2026-03-14 02:29:10,282 - lava_callback - ERROR - Error processing callback for node 69b224f2b0f5558b5d7cd482: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:44434 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:44448 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45080 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39712 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39716 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55974 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48086 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40276 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45386 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:45388 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34282 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54352 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54356 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53606 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33794 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51518 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57018 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:57024 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59506 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36848 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36852 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43140 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52072 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54882 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54482 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:54498 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46710 - "GET / HTTP/1.0" 200 OK 2026-03-14 02:32:30,308 - lava_callback - INFO - Received callback for node 69b225b2b0f5558b5d7cd4a9 INFO: 172.21.0.1:59986 - "POST /node/69b225b2b0f5558b5d7cd4a9 HTTP/1.0" 202 Accepted 2026-03-14 02:32:30,314 - lava_callback - INFO - Starting async job submit for node 69b225b2b0f5558b5d7cd4a9 2026-03-14 02:32:30,315 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 02:32:30,331 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b225b2b0f5558b5d7cd4a9 HTTP/1.1" 200 None 2026-03-14 02:32:30,332 - lava_callback - DEBUG - Processing node 69b225b2b0f5558b5d7cd4a9: baseline-arm64-clabbe 2026-03-14 02:32:30,332 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b225b2b0f5558b5d7cd4a9 2026-03-14 02:32:30,333 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 02:32:30,346 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b225b2b0f5558b5d7cd4a9 HTTP/1.1" 200 None 2026-03-14 02:32:30,348 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 02:32:30,368 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aeba41feb96b28aa34a78b HTTP/1.1" 200 None 2026-03-14 02:32:30,369 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 02:32:30,390 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b225b2b0f5558b5d7cd4a9 HTTP/1.1" 200 None 2026-03-14 02:32:30,391 - lava_callback - ERROR - Error processing callback for node 69b225b2b0f5558b5d7cd4a9: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:60000 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60002 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60422 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57068 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38150 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55848 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:55858 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44124 - "GET / HTTP/1.0" 200 OK 2026-03-14 02:33:30,884 - lava_callback - INFO - Received callback for node 69b225edb0f5558b5d7cd4af INFO: 172.21.0.1:51666 - "POST /node/69b225edb0f5558b5d7cd4af HTTP/1.0" 202 Accepted 2026-03-14 02:33:30,890 - lava_callback - INFO - Starting async job submit for node 69b225edb0f5558b5d7cd4af 2026-03-14 02:33:30,890 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 02:33:30,914 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b225edb0f5558b5d7cd4af HTTP/1.1" 200 None 2026-03-14 02:33:30,915 - lava_callback - DEBUG - Processing node 69b225edb0f5558b5d7cd4af: baseline-arm-baylibre 2026-03-14 02:33:30,915 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b225edb0f5558b5d7cd4af 2026-03-14 02:33:30,915 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 02:33:30,928 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b225edb0f5558b5d7cd4af HTTP/1.1" 200 None 2026-03-14 02:33:30,930 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 02:33:30,975 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aeba33feb96b28aa34a775 HTTP/1.1" 200 None 2026-03-14 02:33:30,976 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 02:33:30,997 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b225edb0f5558b5d7cd4af HTTP/1.1" 200 None 2026-03-14 02:33:31,007 - lava_callback - ERROR - Error processing callback for node 69b225edb0f5558b5d7cd4af: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:51672 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51676 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53408 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35472 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47750 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34680 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:34690 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58598 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52890 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52900 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42206 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34682 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51890 - "GET / HTTP/1.0" 200 OK 2026-03-14 02:35:10,724 - lava_callback - INFO - Received callback for node 69b22658b0f5558b5d7cd4cd INFO: 172.21.0.1:60270 - "POST /node/69b22658b0f5558b5d7cd4cd HTTP/1.0" 202 Accepted 2026-03-14 02:35:10,730 - lava_callback - INFO - Starting async job submit for node 69b22658b0f5558b5d7cd4cd 2026-03-14 02:35:10,730 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 02:35:10,766 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b22658b0f5558b5d7cd4cd HTTP/1.1" 200 None 2026-03-14 02:35:10,766 - lava_callback - DEBUG - Processing node 69b22658b0f5558b5d7cd4cd: baseline-arm-baylibre 2026-03-14 02:35:10,767 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b22658b0f5558b5d7cd4cd 2026-03-14 02:35:10,767 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 02:35:10,782 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b22658b0f5558b5d7cd4cd HTTP/1.1" 200 None 2026-03-14 02:35:10,783 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 02:35:10,797 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aeba33feb96b28aa34a775 HTTP/1.1" 200 None 2026-03-14 02:35:10,798 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 02:35:10,854 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b22658b0f5558b5d7cd4cd HTTP/1.1" 200 None 2026-03-14 02:35:10,855 - lava_callback - ERROR - Error processing callback for node 69b22658b0f5558b5d7cd4cd: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:60284 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:60298 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38194 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56988 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56994 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58280 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42822 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54462 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51422 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:51424 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38164 - "GET / HTTP/1.0" 200 OK 2026-03-14 02:36:30,507 - lava_callback - INFO - Received callback for node 69b226a2b0f5558b5d7cd4eb INFO: 172.21.0.1:52708 - "POST /node/69b226a2b0f5558b5d7cd4eb HTTP/1.0" 202 Accepted 2026-03-14 02:36:30,513 - lava_callback - INFO - Starting async job submit for node 69b226a2b0f5558b5d7cd4eb 2026-03-14 02:36:30,513 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 02:36:30,528 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b226a2b0f5558b5d7cd4eb HTTP/1.1" 200 None 2026-03-14 02:36:30,529 - lava_callback - DEBUG - Processing node 69b226a2b0f5558b5d7cd4eb: baseline-arm-clabbe 2026-03-14 02:36:30,529 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b226a2b0f5558b5d7cd4eb 2026-03-14 02:36:30,530 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 02:36:30,552 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b226a2b0f5558b5d7cd4eb HTTP/1.1" 200 None 2026-03-14 02:36:30,554 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 02:36:30,576 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aeba33feb96b28aa34a775 HTTP/1.1" 200 None 2026-03-14 02:36:30,577 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 02:36:30,597 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b226a2b0f5558b5d7cd4eb HTTP/1.1" 200 None 2026-03-14 02:36:30,602 - lava_callback - ERROR - Error processing callback for node 69b226a2b0f5558b5d7cd4eb: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:52722 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52728 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56006 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38422 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49978 - "GET / HTTP/1.0" 200 OK 2026-03-14 02:37:10,499 - lava_callback - INFO - Received callback for node 69b226c7b0f5558b5d7cd4f4 INFO: 172.21.0.1:41692 - "POST /node/69b226c7b0f5558b5d7cd4f4 HTTP/1.0" 202 Accepted 2026-03-14 02:37:10,505 - lava_callback - INFO - Starting async job submit for node 69b226c7b0f5558b5d7cd4f4 2026-03-14 02:37:10,506 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 02:37:10,519 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b226c7b0f5558b5d7cd4f4 HTTP/1.1" 200 None 2026-03-14 02:37:10,520 - lava_callback - DEBUG - Processing node 69b226c7b0f5558b5d7cd4f4: baseline-arm-clabbe 2026-03-14 02:37:10,520 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b226c7b0f5558b5d7cd4f4 2026-03-14 02:37:10,521 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 02:37:10,538 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b226c7b0f5558b5d7cd4f4 HTTP/1.1" 200 None 2026-03-14 02:37:10,539 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 02:37:10,554 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aeba33feb96b28aa34a775 HTTP/1.1" 200 None 2026-03-14 02:37:10,556 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 02:37:10,592 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b226c7b0f5558b5d7cd4f4 HTTP/1.1" 200 None 2026-03-14 02:37:10,594 - lava_callback - ERROR - Error processing callback for node 69b226c7b0f5558b5d7cd4f4: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:41702 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:41712 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43230 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34100 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34102 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45190 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42930 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41530 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38674 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:38684 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52600 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44798 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44802 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55844 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53894 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53254 - "GET / HTTP/1.0" 200 OK 2026-03-14 02:39:10,632 - lava_callback - INFO - Received callback for node 69b22739b0f5558b5d7cd50d INFO: 172.21.0.1:35032 - "POST /node/69b22739b0f5558b5d7cd50d HTTP/1.0" 202 Accepted 2026-03-14 02:39:10,638 - lava_callback - INFO - Starting async job submit for node 69b22739b0f5558b5d7cd50d 2026-03-14 02:39:10,639 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 02:39:10,662 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b22739b0f5558b5d7cd50d HTTP/1.1" 200 None 2026-03-14 02:39:10,663 - lava_callback - DEBUG - Processing node 69b22739b0f5558b5d7cd50d: baseline-arm-clabbe 2026-03-14 02:39:10,663 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b22739b0f5558b5d7cd50d 2026-03-14 02:39:10,664 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 02:39:10,679 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b22739b0f5558b5d7cd50d HTTP/1.1" 200 None 2026-03-14 02:39:10,680 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 02:39:10,696 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aeba33feb96b28aa34a775 HTTP/1.1" 200 None 2026-03-14 02:39:10,698 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 02:39:10,728 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b22739b0f5558b5d7cd50d HTTP/1.1" 200 None 2026-03-14 02:39:10,729 - lava_callback - ERROR - Error processing callback for node 69b22739b0f5558b5d7cd50d: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:35048 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:35050 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58548 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40050 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40066 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59666 - "GET / HTTP/1.0" 200 OK 2026-03-14 02:39:51,175 - lava_callback - INFO - Received callback for node 69b22763b0f5558b5d7cd519 INFO: 172.21.0.1:54246 - "POST /node/69b22763b0f5558b5d7cd519 HTTP/1.0" 202 Accepted 2026-03-14 02:39:51,181 - lava_callback - INFO - Starting async job submit for node 69b22763b0f5558b5d7cd519 2026-03-14 02:39:51,182 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 02:39:51,205 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b22763b0f5558b5d7cd519 HTTP/1.1" 200 None 2026-03-14 02:39:51,206 - lava_callback - DEBUG - Processing node 69b22763b0f5558b5d7cd519: baseline-arm64-baylibre 2026-03-14 02:39:51,206 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b22763b0f5558b5d7cd519 2026-03-14 02:39:51,207 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 02:39:51,221 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b22763b0f5558b5d7cd519 HTTP/1.1" 200 None 2026-03-14 02:39:51,222 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 02:39:51,235 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69acc01dbcd207e915d76ba7 HTTP/1.1" 200 None 2026-03-14 02:39:51,237 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 02:39:51,258 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b22763b0f5558b5d7cd519 HTTP/1.1" 200 None 2026-03-14 02:39:51,259 - lava_callback - ERROR - Error processing callback for node 69b22763b0f5558b5d7cd519: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:54262 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57630 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53232 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:53234 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55838 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56208 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56210 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60114 - "GET / HTTP/1.0" 200 OK 2026-03-14 02:40:50,700 - lava_callback - INFO - Received callback for node 69b227abb0f5558b5d7cd520 INFO: 172.21.0.1:49516 - "POST /node/69b227abb0f5558b5d7cd520 HTTP/1.0" 202 Accepted 2026-03-14 02:40:50,706 - lava_callback - INFO - Starting async job submit for node 69b227abb0f5558b5d7cd520 2026-03-14 02:40:50,707 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 02:40:50,720 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b227abb0f5558b5d7cd520 HTTP/1.1" 200 None 2026-03-14 02:40:50,721 - lava_callback - DEBUG - Processing node 69b227abb0f5558b5d7cd520: baseline-arm-clabbe 2026-03-14 02:40:50,722 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b227abb0f5558b5d7cd520 2026-03-14 02:40:50,722 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 02:40:50,738 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b227abb0f5558b5d7cd520 HTTP/1.1" 200 None 2026-03-14 02:40:50,740 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 02:40:50,753 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aeba33feb96b28aa34a775 HTTP/1.1" 200 None 2026-03-14 02:40:50,754 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 02:40:50,783 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b227abb0f5558b5d7cd520 HTTP/1.1" 200 None 2026-03-14 02:40:50,784 - lava_callback - ERROR - Error processing callback for node 69b227abb0f5558b5d7cd520: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:49524 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36640 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38346 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:38350 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57400 - "GET / HTTP/1.0" 200 OK 2026-03-14 02:41:30,707 - lava_callback - INFO - Received callback for node 69b227ceb0f5558b5d7cd534 INFO: 172.21.0.1:60746 - "POST /node/69b227ceb0f5558b5d7cd534 HTTP/1.0" 202 Accepted 2026-03-14 02:41:30,712 - lava_callback - INFO - Starting async job submit for node 69b227ceb0f5558b5d7cd534 2026-03-14 02:41:30,713 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 02:41:30,727 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b227ceb0f5558b5d7cd534 HTTP/1.1" 200 None 2026-03-14 02:41:30,728 - lava_callback - DEBUG - Processing node 69b227ceb0f5558b5d7cd534: baseline-arm-clabbe 2026-03-14 02:41:30,729 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b227ceb0f5558b5d7cd534 2026-03-14 02:41:30,729 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 02:41:30,742 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b227ceb0f5558b5d7cd534 HTTP/1.1" 200 None 2026-03-14 02:41:30,744 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 02:41:30,757 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aeba33feb96b28aa34a775 HTTP/1.1" 200 None 2026-03-14 02:41:30,759 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 02:41:30,780 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b227ceb0f5558b5d7cd534 HTTP/1.1" 200 None 2026-03-14 02:41:30,789 - lava_callback - ERROR - Error processing callback for node 69b227ceb0f5558b5d7cd534: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:60748 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60764 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43240 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48158 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58672 - "GET / HTTP/1.0" 200 OK 2026-03-14 02:42:11,063 - lava_callback - INFO - Received callback for node 69b227f8b0f5558b5d7cd53e INFO: 172.21.0.1:45004 - "POST /node/69b227f8b0f5558b5d7cd53e HTTP/1.0" 202 Accepted 2026-03-14 02:42:11,069 - lava_callback - INFO - Starting async job submit for node 69b227f8b0f5558b5d7cd53e 2026-03-14 02:42:11,070 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 02:42:11,091 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b227f8b0f5558b5d7cd53e HTTP/1.1" 200 None 2026-03-14 02:42:11,092 - lava_callback - DEBUG - Processing node 69b227f8b0f5558b5d7cd53e: baseline-arm64-baylibre 2026-03-14 02:42:11,092 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b227f8b0f5558b5d7cd53e 2026-03-14 02:42:11,092 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 02:42:11,113 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b227f8b0f5558b5d7cd53e HTTP/1.1" 200 None 2026-03-14 02:42:11,115 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 02:42:11,133 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69acc01dbcd207e915d76ba7 HTTP/1.1" 200 None 2026-03-14 02:42:11,134 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 02:42:11,155 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b227f8b0f5558b5d7cd53e HTTP/1.1" 200 None 2026-03-14 02:42:11,161 - lava_callback - ERROR - Error processing callback for node 69b227f8b0f5558b5d7cd53e: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:45014 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:45028 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47186 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39992 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39994 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44632 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40022 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48592 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40514 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:40526 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47546 - "GET / HTTP/1.0" 200 OK 2026-03-14 02:43:31,151 - lava_callback - INFO - Received callback for node 69b22846b0f5558b5d7cd552 INFO: 172.21.0.1:46702 - "POST /node/69b22846b0f5558b5d7cd552 HTTP/1.0" 202 Accepted 2026-03-14 02:43:31,157 - lava_callback - INFO - Starting async job submit for node 69b22846b0f5558b5d7cd552 2026-03-14 02:43:31,158 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 02:43:31,176 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b22846b0f5558b5d7cd552 HTTP/1.1" 200 None 2026-03-14 02:43:31,177 - lava_callback - DEBUG - Processing node 69b22846b0f5558b5d7cd552: baseline-arm64-baylibre 2026-03-14 02:43:31,177 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b22846b0f5558b5d7cd552 2026-03-14 02:43:31,178 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 02:43:31,192 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b22846b0f5558b5d7cd552 HTTP/1.1" 200 None 2026-03-14 02:43:31,194 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 02:43:31,208 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69acc01dbcd207e915d76ba7 HTTP/1.1" 200 None 2026-03-14 02:43:31,209 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 02:43:31,230 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b22846b0f5558b5d7cd552 HTTP/1.1" 200 None 2026-03-14 02:43:31,236 - lava_callback - ERROR - Error processing callback for node 69b22846b0f5558b5d7cd552: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:46712 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46726 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:32792 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38996 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36416 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34084 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:34096 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53278 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45792 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45802 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34330 - "GET / HTTP/1.0" 200 OK 2026-03-14 02:44:51,213 - lava_callback - INFO - Received callback for node 69b22893b0f5558b5d7cd55a INFO: 172.21.0.1:52504 - "POST /node/69b22893b0f5558b5d7cd55a HTTP/1.0" 202 Accepted 2026-03-14 02:44:51,218 - lava_callback - INFO - Starting async job submit for node 69b22893b0f5558b5d7cd55a 2026-03-14 02:44:51,219 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 02:44:51,233 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b22893b0f5558b5d7cd55a HTTP/1.1" 200 None 2026-03-14 02:44:51,234 - lava_callback - DEBUG - Processing node 69b22893b0f5558b5d7cd55a: baseline-arm64-baylibre 2026-03-14 02:44:51,234 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b22893b0f5558b5d7cd55a 2026-03-14 02:44:51,235 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 02:44:51,256 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b22893b0f5558b5d7cd55a HTTP/1.1" 200 None 2026-03-14 02:44:51,258 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 02:44:51,271 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69acc01dbcd207e915d76ba7 HTTP/1.1" 200 None 2026-03-14 02:44:51,273 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 02:44:51,294 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b22893b0f5558b5d7cd55a HTTP/1.1" 200 None 2026-03-14 02:44:51,296 - lava_callback - ERROR - Error processing callback for node 69b22893b0f5558b5d7cd55a: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:52512 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47460 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46104 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:46106 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35858 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48848 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48862 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42912 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44670 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49210 - "GET / HTTP/1.0" 200 OK 2026-03-14 02:46:10,865 - lava_callback - INFO - Received callback for node 69b228e7b0f5558b5d7cd569 INFO: 172.21.0.1:33688 - "POST /node/69b228e7b0f5558b5d7cd569 HTTP/1.0" 202 Accepted 2026-03-14 02:46:10,870 - lava_callback - INFO - Starting async job submit for node 69b228e7b0f5558b5d7cd569 2026-03-14 02:46:10,871 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 02:46:10,887 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b228e7b0f5558b5d7cd569 HTTP/1.1" 200 None 2026-03-14 02:46:10,888 - lava_callback - DEBUG - Processing node 69b228e7b0f5558b5d7cd569: baseline-arm64-clabbe 2026-03-14 02:46:10,889 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b228e7b0f5558b5d7cd569 2026-03-14 02:46:10,889 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 02:46:10,911 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b228e7b0f5558b5d7cd569 HTTP/1.1" 200 None 2026-03-14 02:46:10,913 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 02:46:10,926 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69acc01dbcd207e915d76ba7 HTTP/1.1" 200 None 2026-03-14 02:46:10,928 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 02:46:10,976 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b228e7b0f5558b5d7cd569 HTTP/1.1" 200 None 2026-03-14 02:46:10,983 - lava_callback - ERROR - Error processing callback for node 69b228e7b0f5558b5d7cd569: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:33704 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:33708 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55584 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57022 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57038 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41384 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48504 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34044 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57314 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:57320 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42954 - "GET / HTTP/1.0" 200 OK 2026-03-14 02:47:30,922 - lava_callback - INFO - Received callback for node 69b22934b0f5558b5d7cd572 INFO: 172.21.0.1:46778 - "POST /node/69b22934b0f5558b5d7cd572 HTTP/1.0" 202 Accepted 2026-03-14 02:47:30,927 - lava_callback - INFO - Starting async job submit for node 69b22934b0f5558b5d7cd572 2026-03-14 02:47:30,928 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 02:47:30,954 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b22934b0f5558b5d7cd572 HTTP/1.1" 200 None 2026-03-14 02:47:30,955 - lava_callback - DEBUG - Processing node 69b22934b0f5558b5d7cd572: baseline-arm64-clabbe 2026-03-14 02:47:30,955 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b22934b0f5558b5d7cd572 2026-03-14 02:47:30,956 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 02:47:30,969 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b22934b0f5558b5d7cd572 HTTP/1.1" 200 None 2026-03-14 02:47:30,971 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 02:47:30,984 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69acc01dbcd207e915d76ba7 HTTP/1.1" 200 None 2026-03-14 02:47:30,985 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 02:47:31,008 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b22934b0f5558b5d7cd572 HTTP/1.1" 200 None 2026-03-14 02:47:31,016 - lava_callback - ERROR - Error processing callback for node 69b22934b0f5558b5d7cd572: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:46794 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46802 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60402 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39954 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43308 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:32830 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:32834 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52676 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34430 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34446 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37870 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56860 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44626 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50976 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:50988 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47668 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59248 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59258 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60022 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50116 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55904 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42746 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:42760 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39552 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42238 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42244 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52466 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52906 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47012 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37912 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:37920 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37242 - "GET / HTTP/1.0" 200 OK 2026-03-14 02:51:31,119 - lava_callback - INFO - Received callback for node 69b22a22b0f5558b5d7cd5e1 INFO: 172.21.0.1:57414 - "POST /node/69b22a22b0f5558b5d7cd5e1 HTTP/1.0" 202 Accepted 2026-03-14 02:51:31,124 - lava_callback - INFO - Starting async job submit for node 69b22a22b0f5558b5d7cd5e1 2026-03-14 02:51:31,125 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 02:51:31,141 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b22a22b0f5558b5d7cd5e1 HTTP/1.1" 200 None 2026-03-14 02:51:31,142 - lava_callback - DEBUG - Processing node 69b22a22b0f5558b5d7cd5e1: baseline-arm-clabbe 2026-03-14 02:51:31,142 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b22a22b0f5558b5d7cd5e1 2026-03-14 02:51:31,143 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 02:51:31,157 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b22a22b0f5558b5d7cd5e1 HTTP/1.1" 200 None 2026-03-14 02:51:31,158 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 02:51:31,171 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b12591a870a1dc3343ba82 HTTP/1.1" 200 None 2026-03-14 02:51:31,172 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 02:51:31,213 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b22a22b0f5558b5d7cd5e1 HTTP/1.1" 200 None 2026-03-14 02:51:31,215 - lava_callback - ERROR - Error processing callback for node 69b22a22b0f5558b5d7cd5e1: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:57430 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57432 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38802 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37206 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57900 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60314 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:60326 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60658 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59696 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59708 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37432 - "GET / HTTP/1.0" 200 OK 2026-03-14 02:52:51,758 - lava_callback - INFO - Received callback for node 69b22a72b0f5558b5d7cd605 INFO: 172.21.0.1:43008 - "POST /node/69b22a72b0f5558b5d7cd605 HTTP/1.0" 202 Accepted 2026-03-14 02:52:51,764 - lava_callback - INFO - Starting async job submit for node 69b22a72b0f5558b5d7cd605 2026-03-14 02:52:51,764 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 02:52:51,779 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b22a72b0f5558b5d7cd605 HTTP/1.1" 200 None 2026-03-14 02:52:51,780 - lava_callback - DEBUG - Processing node 69b22a72b0f5558b5d7cd605: baseline-arm64-baylibre 2026-03-14 02:52:51,780 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b22a72b0f5558b5d7cd605 2026-03-14 02:52:51,781 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 02:52:51,798 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b22a72b0f5558b5d7cd605 HTTP/1.1" 200 None 2026-03-14 02:52:51,799 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 02:52:51,812 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aeba41feb96b28aa34a78b HTTP/1.1" 200 None 2026-03-14 02:52:51,814 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 02:52:51,834 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b22a72b0f5558b5d7cd605 HTTP/1.1" 200 None 2026-03-14 02:52:51,835 - lava_callback - ERROR - Error processing callback for node 69b22a72b0f5558b5d7cd605: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:43020 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34308 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42920 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:42926 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60288 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41978 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41980 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44252 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37162 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58924 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56332 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:56348 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55620 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43780 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43792 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60158 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33782 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40402 - "GET / HTTP/1.0" 200 OK 2026-03-14 02:55:11,250 - lava_callback - INFO - Received callback for node 69b22b04b0f5558b5d7cd61d INFO: 172.21.0.1:48858 - "POST /node/69b22b04b0f5558b5d7cd61d HTTP/1.0" 202 Accepted 2026-03-14 02:55:11,255 - lava_callback - INFO - Starting async job submit for node 69b22b04b0f5558b5d7cd61d 2026-03-14 02:55:11,256 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 02:55:11,271 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b22b04b0f5558b5d7cd61d HTTP/1.1" 200 None 2026-03-14 02:55:11,271 - lava_callback - DEBUG - Processing node 69b22b04b0f5558b5d7cd61d: baseline-arm-clabbe 2026-03-14 02:55:11,272 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b22b04b0f5558b5d7cd61d 2026-03-14 02:55:11,272 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 02:55:11,286 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b22b04b0f5558b5d7cd61d HTTP/1.1" 200 None 2026-03-14 02:55:11,287 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 02:55:11,303 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b12591a870a1dc3343ba82 HTTP/1.1" 200 None 2026-03-14 02:55:11,305 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 02:55:11,331 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b22b04b0f5558b5d7cd61d HTTP/1.1" 200 None 2026-03-14 02:55:11,332 - lava_callback - ERROR - Error processing callback for node 69b22b04b0f5558b5d7cd61d: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:48874 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:48888 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46424 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41602 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41616 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40154 - "GET / HTTP/1.0" 200 OK 2026-03-14 02:55:51,290 - lava_callback - INFO - Received callback for node 69b22b27b0f5558b5d7cd62d INFO: 172.21.0.1:58044 - "POST /node/69b22b27b0f5558b5d7cd62d HTTP/1.0" 202 Accepted 2026-03-14 02:55:51,296 - lava_callback - INFO - Starting async job submit for node 69b22b27b0f5558b5d7cd62d 2026-03-14 02:55:51,296 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 02:55:51,311 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b22b27b0f5558b5d7cd62d HTTP/1.1" 200 None 2026-03-14 02:55:51,312 - lava_callback - DEBUG - Processing node 69b22b27b0f5558b5d7cd62d: baseline-arm-clabbe 2026-03-14 02:55:51,312 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b22b27b0f5558b5d7cd62d 2026-03-14 02:55:51,313 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 02:55:51,362 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b22b27b0f5558b5d7cd62d HTTP/1.1" 200 None 2026-03-14 02:55:51,363 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 02:55:51,423 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b12591a870a1dc3343ba82 HTTP/1.1" 200 None 2026-03-14 02:55:51,424 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 02:55:51,475 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b22b27b0f5558b5d7cd62d HTTP/1.1" 200 None 2026-03-14 02:55:51,482 - lava_callback - ERROR - Error processing callback for node 69b22b27b0f5558b5d7cd62d: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:58054 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35242 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55524 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:55530 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33822 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48320 - "GET / HTTP/1.0" 200 OK 2026-03-14 02:56:32,034 - lava_callback - INFO - Received callback for node 69b22b52b0f5558b5d7cd63f INFO: 172.21.0.1:48326 - "POST /node/69b22b52b0f5558b5d7cd63f HTTP/1.0" 202 Accepted 2026-03-14 02:56:32,040 - lava_callback - INFO - Starting async job submit for node 69b22b52b0f5558b5d7cd63f 2026-03-14 02:56:32,041 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 02:56:32,055 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b22b52b0f5558b5d7cd63f HTTP/1.1" 200 None 2026-03-14 02:56:32,056 - lava_callback - DEBUG - Processing node 69b22b52b0f5558b5d7cd63f: baseline-arm64-baylibre 2026-03-14 02:56:32,056 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b22b52b0f5558b5d7cd63f 2026-03-14 02:56:32,057 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 02:56:32,077 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b22b52b0f5558b5d7cd63f HTTP/1.1" 200 None 2026-03-14 02:56:32,078 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 02:56:32,104 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aeba41feb96b28aa34a78b HTTP/1.1" 200 None 2026-03-14 02:56:32,105 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 02:56:32,127 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b22b52b0f5558b5d7cd63f HTTP/1.1" 200 None 2026-03-14 02:56:32,128 - lava_callback - ERROR - Error processing callback for node 69b22b52b0f5558b5d7cd63f: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:48328 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52982 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59768 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48142 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41424 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:41428 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45320 - "GET / HTTP/1.0" 200 OK 2026-03-14 02:57:31,397 - lava_callback - INFO - Received callback for node 69b22b97b0f5558b5d7cd648 INFO: 172.21.0.1:49338 - "POST /node/69b22b97b0f5558b5d7cd648 HTTP/1.0" 202 Accepted 2026-03-14 02:57:31,402 - lava_callback - INFO - Starting async job submit for node 69b22b97b0f5558b5d7cd648 2026-03-14 02:57:31,403 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 02:57:31,421 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b22b97b0f5558b5d7cd648 HTTP/1.1" 200 None 2026-03-14 02:57:31,422 - lava_callback - DEBUG - Processing node 69b22b97b0f5558b5d7cd648: baseline-arm-clabbe 2026-03-14 02:57:31,422 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b22b97b0f5558b5d7cd648 2026-03-14 02:57:31,422 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 02:57:31,436 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b22b97b0f5558b5d7cd648 HTTP/1.1" 200 None 2026-03-14 02:57:31,438 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 02:57:31,451 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b12591a870a1dc3343ba82 HTTP/1.1" 200 None 2026-03-14 02:57:31,452 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 02:57:31,474 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b22b97b0f5558b5d7cd648 HTTP/1.1" 200 None 2026-03-14 02:57:31,475 - lava_callback - ERROR - Error processing callback for node 69b22b97b0f5558b5d7cd648: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:49350 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49362 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37396 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50052 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41750 - "GET / HTTP/1.0" 200 OK 2026-03-14 02:58:11,398 - lava_callback - INFO - Received callback for node 69b22bbbb0f5558b5d7cd656 INFO: 172.21.0.1:54288 - "POST /node/69b22bbbb0f5558b5d7cd656 HTTP/1.0" 202 Accepted 2026-03-14 02:58:11,404 - lava_callback - INFO - Starting async job submit for node 69b22bbbb0f5558b5d7cd656 2026-03-14 02:58:11,405 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 02:58:11,423 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b22bbbb0f5558b5d7cd656 HTTP/1.1" 200 None 2026-03-14 02:58:11,423 - lava_callback - DEBUG - Processing node 69b22bbbb0f5558b5d7cd656: baseline-arm-clabbe 2026-03-14 02:58:11,424 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b22bbbb0f5558b5d7cd656 2026-03-14 02:58:11,424 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 02:58:11,443 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b22bbbb0f5558b5d7cd656 HTTP/1.1" 200 None 2026-03-14 02:58:11,444 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 02:58:11,458 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b12591a870a1dc3343ba82 HTTP/1.1" 200 None 2026-03-14 02:58:11,459 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 02:58:11,480 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b22bbbb0f5558b5d7cd656 HTTP/1.1" 200 None 2026-03-14 02:58:11,485 - lava_callback - ERROR - Error processing callback for node 69b22bbbb0f5558b5d7cd656: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:54300 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:54302 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45636 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54708 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54720 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60326 - "GET / HTTP/1.0" 200 OK 2026-03-14 02:58:52,116 - lava_callback - INFO - Received callback for node 69b22be4b0f5558b5d7cd667 INFO: 172.21.0.1:47464 - "POST /node/69b22be4b0f5558b5d7cd667 HTTP/1.0" 202 Accepted 2026-03-14 02:58:52,124 - lava_callback - INFO - Starting async job submit for node 69b22be4b0f5558b5d7cd667 2026-03-14 02:58:52,125 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 02:58:52,141 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b22be4b0f5558b5d7cd667 HTTP/1.1" 200 None 2026-03-14 02:58:52,142 - lava_callback - DEBUG - Processing node 69b22be4b0f5558b5d7cd667: baseline-arm64-baylibre 2026-03-14 02:58:52,142 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b22be4b0f5558b5d7cd667 2026-03-14 02:58:52,143 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 02:58:52,155 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b22be4b0f5558b5d7cd667 HTTP/1.1" 200 None 2026-03-14 02:58:52,157 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 02:58:52,170 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aeba41feb96b28aa34a78b HTTP/1.1" 200 None 2026-03-14 02:58:52,172 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 02:58:52,192 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b22be4b0f5558b5d7cd667 HTTP/1.1" 200 None 2026-03-14 02:58:52,204 - lava_callback - ERROR - Error processing callback for node 69b22be4b0f5558b5d7cd667: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:47476 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44742 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46356 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:46372 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42096 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56886 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56900 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34608 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51320 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48298 - "GET / HTTP/1.0" 200 OK 2026-03-14 03:00:12,052 - lava_callback - INFO - Received callback for node 69b22c32b0f5558b5d7cd671 INFO: 172.21.0.1:41708 - "POST /node/69b22c32b0f5558b5d7cd671 HTTP/1.0" 202 Accepted 2026-03-14 03:00:12,058 - lava_callback - INFO - Starting async job submit for node 69b22c32b0f5558b5d7cd671 2026-03-14 03:00:12,059 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 03:00:12,096 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b22c32b0f5558b5d7cd671 HTTP/1.1" 200 None 2026-03-14 03:00:12,097 - lava_callback - DEBUG - Processing node 69b22c32b0f5558b5d7cd671: baseline-arm64-baylibre 2026-03-14 03:00:12,097 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b22c32b0f5558b5d7cd671 2026-03-14 03:00:12,098 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 03:00:12,111 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b22c32b0f5558b5d7cd671 HTTP/1.1" 200 None 2026-03-14 03:00:12,112 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 03:00:12,125 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aeba41feb96b28aa34a78b HTTP/1.1" 200 None 2026-03-14 03:00:12,127 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 03:00:12,147 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b22c32b0f5558b5d7cd671 HTTP/1.1" 200 None 2026-03-14 03:00:12,148 - lava_callback - ERROR - Error processing callback for node 69b22c32b0f5558b5d7cd671: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:41724 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:41736 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50904 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53500 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53508 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55708 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44336 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53060 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55770 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:55786 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51150 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59388 - "GET / HTTP/1.0" 200 OK 2026-03-14 03:01:32,143 - lava_callback - INFO - Received callback for node 69b22c83b0f5558b5d7cd67e INFO: 172.21.0.1:59394 - "POST /node/69b22c83b0f5558b5d7cd67e HTTP/1.0" 202 Accepted 2026-03-14 03:01:32,149 - lava_callback - INFO - Starting async job submit for node 69b22c83b0f5558b5d7cd67e 2026-03-14 03:01:32,149 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 03:01:32,164 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b22c83b0f5558b5d7cd67e HTTP/1.1" 200 None 2026-03-14 03:01:32,165 - lava_callback - DEBUG - Processing node 69b22c83b0f5558b5d7cd67e: baseline-arm64-baylibre 2026-03-14 03:01:32,165 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b22c83b0f5558b5d7cd67e 2026-03-14 03:01:32,165 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 03:01:32,181 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b22c83b0f5558b5d7cd67e HTTP/1.1" 200 None 2026-03-14 03:01:32,183 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 03:01:32,214 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aeba41feb96b28aa34a78b HTTP/1.1" 200 None 2026-03-14 03:01:32,216 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 03:01:32,243 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b22c83b0f5558b5d7cd67e HTTP/1.1" 200 None 2026-03-14 03:01:32,244 - lava_callback - ERROR - Error processing callback for node 69b22c83b0f5558b5d7cd67e: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:59408 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50104 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35734 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50316 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39944 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:39958 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48564 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46292 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46306 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45654 - "GET / HTTP/1.0" 200 OK 2026-03-14 03:02:52,244 - lava_callback - INFO - Received callback for node 69b22cd0b0f5558b5d7cd68e INFO: 172.21.0.1:35032 - "POST /node/69b22cd0b0f5558b5d7cd68e HTTP/1.0" 202 Accepted 2026-03-14 03:02:52,250 - lava_callback - INFO - Starting async job submit for node 69b22cd0b0f5558b5d7cd68e 2026-03-14 03:02:52,251 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 03:02:52,307 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b22cd0b0f5558b5d7cd68e HTTP/1.1" 200 None 2026-03-14 03:02:52,308 - lava_callback - DEBUG - Processing node 69b22cd0b0f5558b5d7cd68e: baseline-arm64-baylibre 2026-03-14 03:02:52,308 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b22cd0b0f5558b5d7cd68e 2026-03-14 03:02:52,309 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 03:02:52,322 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b22cd0b0f5558b5d7cd68e HTTP/1.1" 200 None 2026-03-14 03:02:52,324 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 03:02:52,351 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aeba41feb96b28aa34a78b HTTP/1.1" 200 None 2026-03-14 03:02:52,352 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 03:02:52,411 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b22cd0b0f5558b5d7cd68e HTTP/1.1" 200 None 2026-03-14 03:02:52,412 - lava_callback - ERROR - Error processing callback for node 69b22cd0b0f5558b5d7cd68e: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:35042 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51528 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42584 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:42596 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39228 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49208 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49210 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51070 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47598 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59404 - "GET / HTTP/1.0" 200 OK 2026-03-14 03:04:11,621 - lava_callback - INFO - Received callback for node 69b22d28b0f5558b5d7cd6a1 INFO: 172.21.0.1:33216 - "POST /node/69b22d28b0f5558b5d7cd6a1 HTTP/1.0" 202 Accepted 2026-03-14 03:04:11,627 - lava_callback - INFO - Starting async job submit for node 69b22d28b0f5558b5d7cd6a1 2026-03-14 03:04:11,628 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 03:04:11,642 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b22d28b0f5558b5d7cd6a1 HTTP/1.1" 200 None 2026-03-14 03:04:11,642 - lava_callback - DEBUG - Processing node 69b22d28b0f5558b5d7cd6a1: baseline-arm64-clabbe 2026-03-14 03:04:11,643 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b22d28b0f5558b5d7cd6a1 2026-03-14 03:04:11,643 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 03:04:11,660 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b22d28b0f5558b5d7cd6a1 HTTP/1.1" 200 None 2026-03-14 03:04:11,661 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 03:04:11,674 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aeba41feb96b28aa34a78b HTTP/1.1" 200 None 2026-03-14 03:04:11,675 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 03:04:11,701 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b22d28b0f5558b5d7cd6a1 HTTP/1.1" 200 None 2026-03-14 03:04:11,707 - lava_callback - ERROR - Error processing callback for node 69b22d28b0f5558b5d7cd6a1: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:33226 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:33238 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36194 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40776 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40790 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35006 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58216 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38858 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54534 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:54540 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58986 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57570 - "GET / HTTP/1.0" 200 OK 2026-03-14 03:05:31,733 - lava_callback - INFO - Received callback for node 69b22d79b0f5558b5d7cd6b7 INFO: 172.21.0.1:57586 - "POST /node/69b22d79b0f5558b5d7cd6b7 HTTP/1.0" 202 Accepted 2026-03-14 03:05:31,738 - lava_callback - INFO - Starting async job submit for node 69b22d79b0f5558b5d7cd6b7 2026-03-14 03:05:31,739 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 03:05:31,772 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b22d79b0f5558b5d7cd6b7 HTTP/1.1" 200 None 2026-03-14 03:05:31,772 - lava_callback - DEBUG - Processing node 69b22d79b0f5558b5d7cd6b7: baseline-arm64-clabbe 2026-03-14 03:05:31,773 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b22d79b0f5558b5d7cd6b7 2026-03-14 03:05:31,773 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 03:05:31,787 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b22d79b0f5558b5d7cd6b7 HTTP/1.1" 200 None 2026-03-14 03:05:31,788 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 03:05:31,802 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aeba41feb96b28aa34a78b HTTP/1.1" 200 None 2026-03-14 03:05:31,803 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 03:05:31,825 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b22d79b0f5558b5d7cd6b7 HTTP/1.1" 200 None 2026-03-14 03:05:31,837 - lava_callback - ERROR - Error processing callback for node 69b22d79b0f5558b5d7cd6b7: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:57602 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55984 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59538 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33154 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59808 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:59812 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53544 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55462 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55476 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57918 - "GET / HTTP/1.0" 200 OK 2026-03-14 03:06:51,905 - lava_callback - INFO - Received callback for node 69b22dc8b0f5558b5d7cd6ce INFO: 172.21.0.1:39950 - "POST /node/69b22dc8b0f5558b5d7cd6ce HTTP/1.0" 202 Accepted 2026-03-14 03:06:51,911 - lava_callback - INFO - Starting async job submit for node 69b22dc8b0f5558b5d7cd6ce 2026-03-14 03:06:51,912 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 03:06:51,934 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b22dc8b0f5558b5d7cd6ce HTTP/1.1" 200 None 2026-03-14 03:06:51,934 - lava_callback - DEBUG - Processing node 69b22dc8b0f5558b5d7cd6ce: baseline-arm64-clabbe 2026-03-14 03:06:51,935 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b22dc8b0f5558b5d7cd6ce 2026-03-14 03:06:51,935 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 03:06:51,949 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b22dc8b0f5558b5d7cd6ce HTTP/1.1" 200 None 2026-03-14 03:06:51,950 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 03:06:51,965 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aeba41feb96b28aa34a78b HTTP/1.1" 200 None 2026-03-14 03:06:51,967 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 03:06:51,992 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b22dc8b0f5558b5d7cd6ce HTTP/1.1" 200 None 2026-03-14 03:06:52,003 - lava_callback - ERROR - Error processing callback for node 69b22dc8b0f5558b5d7cd6ce: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:39966 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50764 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47468 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:47482 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41438 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59782 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59792 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44992 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53308 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42120 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46236 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:46252 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53080 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41600 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41608 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58398 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45874 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33570 - "GET / HTTP/1.0" 200 OK 2026-03-14 03:09:11,843 - lava_callback - INFO - Received callback for node 69b22e41b0f5558b5d7cd6e0 INFO: 172.21.0.1:43678 - "POST /node/69b22e41b0f5558b5d7cd6e0 HTTP/1.0" 202 Accepted 2026-03-14 03:09:11,848 - lava_callback - INFO - Starting async job submit for node 69b22e41b0f5558b5d7cd6e0 2026-03-14 03:09:11,849 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 03:09:11,863 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b22e41b0f5558b5d7cd6e0 HTTP/1.1" 200 None 2026-03-14 03:09:11,864 - lava_callback - DEBUG - Processing node 69b22e41b0f5558b5d7cd6e0: baseline-arm64-clabbe 2026-03-14 03:09:11,864 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b22e41b0f5558b5d7cd6e0 2026-03-14 03:09:11,865 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 03:09:11,878 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b22e41b0f5558b5d7cd6e0 HTTP/1.1" 200 None 2026-03-14 03:09:11,880 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 03:09:11,892 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aeba41feb96b28aa34a78b HTTP/1.1" 200 None 2026-03-14 03:09:11,893 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 03:09:11,915 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b22e41b0f5558b5d7cd6e0 HTTP/1.1" 200 None 2026-03-14 03:09:11,921 - lava_callback - ERROR - Error processing callback for node 69b22e41b0f5558b5d7cd6e0: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:43682 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:43688 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51212 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51378 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51394 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45236 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39420 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56580 - "GET / HTTP/1.0" 200 OK 2026-03-14 03:10:11,880 - lava_callback - INFO - Received callback for node 69b22e8db0f5558b5d7cd6e9 INFO: 172.21.0.1:50960 - "POST /node/69b22e8db0f5558b5d7cd6e9 HTTP/1.0" 202 Accepted 2026-03-14 03:10:11,886 - lava_callback - INFO - Starting async job submit for node 69b22e8db0f5558b5d7cd6e9 2026-03-14 03:10:11,887 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 03:10:11,916 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b22e8db0f5558b5d7cd6e9 HTTP/1.1" 200 None 2026-03-14 03:10:11,917 - lava_callback - DEBUG - Processing node 69b22e8db0f5558b5d7cd6e9: baseline-arm64-clabbe 2026-03-14 03:10:11,917 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b22e8db0f5558b5d7cd6e9 2026-03-14 03:10:11,917 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 03:10:11,950 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b22e8db0f5558b5d7cd6e9 HTTP/1.1" 200 None 2026-03-14 03:10:11,951 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 03:10:11,993 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aeba41feb96b28aa34a78b HTTP/1.1" 200 None 2026-03-14 03:10:11,994 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 03:10:12,027 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b22e8db0f5558b5d7cd6e9 HTTP/1.1" 200 None 2026-03-14 03:10:12,028 - lava_callback - ERROR - Error processing callback for node 69b22e8db0f5558b5d7cd6e9: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:50966 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:50978 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50720 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36070 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36076 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58518 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35962 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46934 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48726 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:48742 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40916 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35698 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35702 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59620 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39480 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33302 - "GET / HTTP/1.0" 200 OK 2026-03-14 03:12:11,992 - lava_callback - INFO - Received callback for node 69b22ef6b0f5558b5d7cd707 INFO: 172.21.0.1:54310 - "POST /node/69b22ef6b0f5558b5d7cd707 HTTP/1.0" 202 Accepted 2026-03-14 03:12:11,997 - lava_callback - INFO - Starting async job submit for node 69b22ef6b0f5558b5d7cd707 2026-03-14 03:12:11,998 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 03:12:12,014 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b22ef6b0f5558b5d7cd707 HTTP/1.1" 200 None 2026-03-14 03:12:12,015 - lava_callback - DEBUG - Processing node 69b22ef6b0f5558b5d7cd707: baseline-arm64-clabbe 2026-03-14 03:12:12,015 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b22ef6b0f5558b5d7cd707 2026-03-14 03:12:12,016 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 03:12:12,029 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b22ef6b0f5558b5d7cd707 HTTP/1.1" 200 None 2026-03-14 03:12:12,030 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 03:12:12,069 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aeba41feb96b28aa34a78b HTTP/1.1" 200 None 2026-03-14 03:12:12,071 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 03:12:12,092 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b22ef6b0f5558b5d7cd707 HTTP/1.1" 200 None 2026-03-14 03:12:12,096 - lava_callback - ERROR - Error processing callback for node 69b22ef6b0f5558b5d7cd707: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:54316 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:54324 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37788 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55006 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55016 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46766 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58986 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54730 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49302 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:49306 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56012 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36344 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36354 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53906 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39404 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55862 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57784 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:57800 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50278 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43688 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43690 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46982 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42558 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54070 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54840 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:54846 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54794 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59020 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59036 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60106 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56576 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50712 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54806 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:54820 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46170 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59130 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59144 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37332 - "GET / HTTP/1.0" 200 OK 2026-03-14 03:16:53,186 - lava_callback - INFO - Received callback for node 69b23018b0f5558b5d7cd722 INFO: 172.21.0.1:52170 - "POST /node/69b23018b0f5558b5d7cd722 HTTP/1.0" 202 Accepted 2026-03-14 03:16:53,192 - lava_callback - INFO - Starting async job submit for node 69b23018b0f5558b5d7cd722 2026-03-14 03:16:53,193 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 03:16:53,229 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b23018b0f5558b5d7cd722 HTTP/1.1" 200 None 2026-03-14 03:16:53,230 - lava_callback - DEBUG - Processing node 69b23018b0f5558b5d7cd722: baseline-arm-baylibre 2026-03-14 03:16:53,230 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b23018b0f5558b5d7cd722 2026-03-14 03:16:53,231 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 03:16:53,284 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b23018b0f5558b5d7cd722 HTTP/1.1" 200 None 2026-03-14 03:16:53,286 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 03:16:53,299 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aeba33feb96b28aa34a775 HTTP/1.1" 200 None 2026-03-14 03:16:53,300 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 03:16:53,321 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b23018b0f5558b5d7cd722 HTTP/1.1" 200 None 2026-03-14 03:16:53,322 - lava_callback - ERROR - Error processing callback for node 69b23018b0f5558b5d7cd722: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:52184 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53900 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49518 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:49528 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35960 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33710 - "GET / HTTP/1.0" 200 OK 2026-03-14 03:17:32,983 - lava_callback - INFO - Received callback for node 69b2303fb0f5558b5d7cd731 INFO: 172.21.0.1:33712 - "POST /node/69b2303fb0f5558b5d7cd731 HTTP/1.0" 202 Accepted 2026-03-14 03:17:32,989 - lava_callback - INFO - Starting async job submit for node 69b2303fb0f5558b5d7cd731 2026-03-14 03:17:32,990 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 03:17:33,004 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b2303fb0f5558b5d7cd731 HTTP/1.1" 200 None 2026-03-14 03:17:33,005 - lava_callback - DEBUG - Processing node 69b2303fb0f5558b5d7cd731: baseline-arm-baylibre 2026-03-14 03:17:33,005 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b2303fb0f5558b5d7cd731 2026-03-14 03:17:33,006 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 03:17:33,019 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b2303fb0f5558b5d7cd731 HTTP/1.1" 200 None 2026-03-14 03:17:33,020 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 03:17:33,035 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aeba33feb96b28aa34a775 HTTP/1.1" 200 None 2026-03-14 03:17:33,037 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 03:17:33,059 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b2303fb0f5558b5d7cd731 HTTP/1.1" 200 None 2026-03-14 03:17:33,060 - lava_callback - ERROR - Error processing callback for node 69b2303fb0f5558b5d7cd731: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:33718 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60480 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36166 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48624 - "GET / HTTP/1.0" 200 OK 2026-03-14 03:18:13,122 - lava_callback - INFO - Received callback for node 69b23068b0f5558b5d7cd740 INFO: 172.21.0.1:52258 - "POST /node/69b23068b0f5558b5d7cd740 HTTP/1.0" 202 Accepted 2026-03-14 03:18:13,128 - lava_callback - INFO - Starting async job submit for node 69b23068b0f5558b5d7cd740 2026-03-14 03:18:13,129 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 03:18:13,148 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b23068b0f5558b5d7cd740 HTTP/1.1" 200 None 2026-03-14 03:18:13,149 - lava_callback - DEBUG - Processing node 69b23068b0f5558b5d7cd740: baseline-arm-baylibre 2026-03-14 03:18:13,149 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b23068b0f5558b5d7cd740 2026-03-14 03:18:13,149 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 03:18:13,162 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b23068b0f5558b5d7cd740 HTTP/1.1" 200 None 2026-03-14 03:18:13,163 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 03:18:13,176 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aeba33feb96b28aa34a775 HTTP/1.1" 200 None 2026-03-14 03:18:13,178 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 03:18:13,206 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b23068b0f5558b5d7cd740 HTTP/1.1" 200 None 2026-03-14 03:18:13,212 - lava_callback - ERROR - Error processing callback for node 69b23068b0f5558b5d7cd740: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:52262 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:52276 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57806 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56740 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56750 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41894 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41048 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46250 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42306 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:42308 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34228 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39870 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39874 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49232 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55790 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34878 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53344 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:53348 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56032 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57702 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57714 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46506 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35136 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50228 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52596 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:52598 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39654 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58930 - "GET / HTTP/1.0" 200 OK 2026-03-14 03:21:33,218 - lava_callback - INFO - Received callback for node 69b23131b0f5558b5d7cd75d INFO: 172.21.0.1:58936 - "POST /node/69b23131b0f5558b5d7cd75d HTTP/1.0" 202 Accepted 2026-03-14 03:21:33,223 - lava_callback - INFO - Starting async job submit for node 69b23131b0f5558b5d7cd75d 2026-03-14 03:21:33,224 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 03:21:33,238 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b23131b0f5558b5d7cd75d HTTP/1.1" 200 None 2026-03-14 03:21:33,239 - lava_callback - DEBUG - Processing node 69b23131b0f5558b5d7cd75d: baseline-arm-baylibre 2026-03-14 03:21:33,239 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b23131b0f5558b5d7cd75d 2026-03-14 03:21:33,240 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 03:21:33,266 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b23131b0f5558b5d7cd75d HTTP/1.1" 200 None 2026-03-14 03:21:33,268 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 03:21:33,280 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aeba33feb96b28aa34a775 HTTP/1.1" 200 None 2026-03-14 03:21:33,282 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 03:21:33,309 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b23131b0f5558b5d7cd75d HTTP/1.1" 200 None 2026-03-14 03:21:33,311 - lava_callback - ERROR - Error processing callback for node 69b23131b0f5558b5d7cd75d: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:58948 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42144 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44704 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59944 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55728 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:55744 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33348 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49808 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49822 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40470 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40284 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60280 - "GET / HTTP/1.0" 200 OK 2026-03-14 03:23:13,366 - lava_callback - INFO - Received callback for node 69b23196b0f5558b5d7cd770 INFO: 172.21.0.1:34086 - "POST /node/69b23196b0f5558b5d7cd770 HTTP/1.0" 202 Accepted 2026-03-14 03:23:13,371 - lava_callback - INFO - Starting async job submit for node 69b23196b0f5558b5d7cd770 2026-03-14 03:23:13,372 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 03:23:13,400 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b23196b0f5558b5d7cd770 HTTP/1.1" 200 None 2026-03-14 03:23:13,400 - lava_callback - DEBUG - Processing node 69b23196b0f5558b5d7cd770: baseline-arm-baylibre 2026-03-14 03:23:13,401 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b23196b0f5558b5d7cd770 2026-03-14 03:23:13,401 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 03:23:13,414 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b23196b0f5558b5d7cd770 HTTP/1.1" 200 None 2026-03-14 03:23:13,416 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 03:23:13,429 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aeba33feb96b28aa34a775 HTTP/1.1" 200 None 2026-03-14 03:23:13,430 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 03:23:13,471 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b23196b0f5558b5d7cd770 HTTP/1.1" 200 None 2026-03-14 03:23:13,472 - lava_callback - ERROR - Error processing callback for node 69b23196b0f5558b5d7cd770: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:34094 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:34104 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51652 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43002 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43012 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57604 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33664 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34252 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57310 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:57320 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38238 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39578 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39588 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49080 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41776 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39654 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60366 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:60372 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52296 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43790 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43796 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41484 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59188 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49860 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40444 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:40452 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56892 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45330 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45340 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44430 - "GET / HTTP/1.0" 200 OK 2026-03-14 03:26:52,593 - lava_callback - INFO - Received callback for node 69b2326eb0f5558b5d7cd784 INFO: 172.21.0.1:52146 - "POST /node/69b2326eb0f5558b5d7cd784 HTTP/1.0" 202 Accepted 2026-03-14 03:26:52,598 - lava_callback - INFO - Starting async job submit for node 69b2326eb0f5558b5d7cd784 2026-03-14 03:26:52,599 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 03:26:52,614 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b2326eb0f5558b5d7cd784 HTTP/1.1" 200 None 2026-03-14 03:26:52,614 - lava_callback - DEBUG - Processing node 69b2326eb0f5558b5d7cd784: baseline-arm-clabbe 2026-03-14 03:26:52,615 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b2326eb0f5558b5d7cd784 2026-03-14 03:26:52,615 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 03:26:52,635 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b2326eb0f5558b5d7cd784 HTTP/1.1" 200 None 2026-03-14 03:26:52,636 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 03:26:52,649 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aeba33feb96b28aa34a775 HTTP/1.1" 200 None 2026-03-14 03:26:52,651 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 03:26:52,697 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b2326eb0f5558b5d7cd784 HTTP/1.1" 200 None 2026-03-14 03:26:52,698 - lava_callback - ERROR - Error processing callback for node 69b2326eb0f5558b5d7cd784: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:52152 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50392 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33686 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:33690 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55176 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49962 - "GET / HTTP/1.0" 200 OK 2026-03-14 03:27:32,568 - lava_callback - INFO - Received callback for node 69b23295b0f5558b5d7cd79c INFO: 172.21.0.1:49972 - "POST /node/69b23295b0f5558b5d7cd79c HTTP/1.0" 202 Accepted 2026-03-14 03:27:32,573 - lava_callback - INFO - Starting async job submit for node 69b23295b0f5558b5d7cd79c 2026-03-14 03:27:32,574 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 03:27:32,588 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b23295b0f5558b5d7cd79c HTTP/1.1" 200 None 2026-03-14 03:27:32,589 - lava_callback - DEBUG - Processing node 69b23295b0f5558b5d7cd79c: baseline-arm-clabbe 2026-03-14 03:27:32,589 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b23295b0f5558b5d7cd79c 2026-03-14 03:27:32,590 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 03:27:32,612 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b23295b0f5558b5d7cd79c HTTP/1.1" 200 None 2026-03-14 03:27:32,613 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 03:27:32,634 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aeba33feb96b28aa34a775 HTTP/1.1" 200 None 2026-03-14 03:27:32,635 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 03:27:32,656 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b23295b0f5558b5d7cd79c HTTP/1.1" 200 None 2026-03-14 03:27:32,658 - lava_callback - ERROR - Error processing callback for node 69b23295b0f5558b5d7cd79c: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:49978 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47622 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38516 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55756 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55766 - "GET / HTTP/1.0" 200 OK 2026-03-14 03:28:12,630 - lava_callback - INFO - Received callback for node 69b232bdb0f5558b5d7cd7a5 INFO: 172.21.0.1:33292 - "POST /node/69b232bdb0f5558b5d7cd7a5 HTTP/1.0" 202 Accepted 2026-03-14 03:28:12,635 - lava_callback - INFO - Starting async job submit for node 69b232bdb0f5558b5d7cd7a5 2026-03-14 03:28:12,636 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 03:28:12,651 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b232bdb0f5558b5d7cd7a5 HTTP/1.1" 200 None 2026-03-14 03:28:12,651 - lava_callback - DEBUG - Processing node 69b232bdb0f5558b5d7cd7a5: baseline-arm-clabbe 2026-03-14 03:28:12,652 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b232bdb0f5558b5d7cd7a5 2026-03-14 03:28:12,652 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 03:28:12,665 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b232bdb0f5558b5d7cd7a5 HTTP/1.1" 200 None 2026-03-14 03:28:12,667 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 03:28:12,680 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aeba33feb96b28aa34a775 HTTP/1.1" 200 None 2026-03-14 03:28:12,681 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 03:28:12,702 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b232bdb0f5558b5d7cd7a5 HTTP/1.1" 200 None 2026-03-14 03:28:12,703 - lava_callback - ERROR - Error processing callback for node 69b232bdb0f5558b5d7cd7a5: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:33302 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:33306 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40950 - "GET /favicon.ico HTTP/1.0" 404 Not Found INFO: 172.21.0.1:40956 - "GET /robots.txt HTTP/1.0" 404 Not Found INFO: 172.21.0.1:40970 - "GET /sitemap.xml HTTP/1.0" 404 Not Found INFO: 172.21.0.1:40978 - "GET /config.json HTTP/1.0" 404 Not Found INFO: 172.21.0.1:40986 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44192 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44194 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44436 - "GET / HTTP/1.0" 200 OK 2026-03-14 03:28:52,646 - lava_callback - INFO - Received callback for node 69b232e5b0f5558b5d7cd7b7 INFO: 172.21.0.1:50878 - "POST /node/69b232e5b0f5558b5d7cd7b7 HTTP/1.0" 202 Accepted 2026-03-14 03:28:52,651 - lava_callback - INFO - Starting async job submit for node 69b232e5b0f5558b5d7cd7b7 2026-03-14 03:28:52,652 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 03:28:52,669 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b232e5b0f5558b5d7cd7b7 HTTP/1.1" 200 None 2026-03-14 03:28:52,670 - lava_callback - DEBUG - Processing node 69b232e5b0f5558b5d7cd7b7: baseline-arm-clabbe 2026-03-14 03:28:52,670 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b232e5b0f5558b5d7cd7b7 2026-03-14 03:28:52,671 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 03:28:52,684 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b232e5b0f5558b5d7cd7b7 HTTP/1.1" 200 None 2026-03-14 03:28:52,686 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 03:28:52,702 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aeba33feb96b28aa34a775 HTTP/1.1" 200 None 2026-03-14 03:28:52,704 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 03:28:52,725 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b232e5b0f5558b5d7cd7b7 HTTP/1.1" 200 None 2026-03-14 03:28:52,726 - lava_callback - ERROR - Error processing callback for node 69b232e5b0f5558b5d7cd7b7: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:50894 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36418 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42480 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:42486 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39014 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58674 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58688 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46456 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42738 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50662 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34096 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:34108 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58284 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39052 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39062 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53334 - "GET / HTTP/1.0" 200 OK 2026-03-14 03:30:52,826 - lava_callback - INFO - Received callback for node 69b2335eb0f5558b5d7cd7cb INFO: 172.21.0.1:44654 - "POST /node/69b2335eb0f5558b5d7cd7cb HTTP/1.0" 202 Accepted 2026-03-14 03:30:52,832 - lava_callback - INFO - Starting async job submit for node 69b2335eb0f5558b5d7cd7cb 2026-03-14 03:30:52,833 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 03:30:52,848 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b2335eb0f5558b5d7cd7cb HTTP/1.1" 200 None 2026-03-14 03:30:52,849 - lava_callback - DEBUG - Processing node 69b2335eb0f5558b5d7cd7cb: baseline-arm-clabbe 2026-03-14 03:30:52,849 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b2335eb0f5558b5d7cd7cb 2026-03-14 03:30:52,850 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 03:30:53,052 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b2335eb0f5558b5d7cd7cb HTTP/1.1" 200 None 2026-03-14 03:30:53,053 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 03:30:53,067 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aeba33feb96b28aa34a775 HTTP/1.1" 200 None 2026-03-14 03:30:53,069 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 03:30:53,143 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b2335eb0f5558b5d7cd7cb HTTP/1.1" 200 None 2026-03-14 03:30:53,144 - lava_callback - ERROR - Error processing callback for node 69b2335eb0f5558b5d7cd7cb: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:44656 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60322 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46830 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:46842 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34586 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46510 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46522 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52942 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33024 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44620 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35276 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:35282 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56422 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38064 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38070 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53112 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60568 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51222 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41120 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:41136 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36004 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36440 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36450 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49642 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34284 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40392 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38908 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:38916 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52918 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45746 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45752 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40752 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35582 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54726 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55790 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:55792 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41676 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48428 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48440 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37742 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46400 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47352 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60978 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:60980 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58776 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58048 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58058 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60852 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44200 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52468 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48862 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:48864 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52216 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39352 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39366 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55294 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35354 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59124 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50956 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:50962 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35370 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53438 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53440 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60034 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59624 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54576 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36696 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:36710 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33814 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41834 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41840 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49838 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59380 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52760 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56252 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:56264 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43882 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53152 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53158 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37954 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43690 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43604 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46078 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:46084 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59110 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54918 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54922 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36004 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55316 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36268 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42978 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:42980 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44624 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35088 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35090 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51148 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40894 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53784 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52216 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:52222 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40392 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41074 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41078 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49504 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40582 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48940 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39630 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:39638 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38570 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58220 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58236 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55676 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40746 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41410 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40068 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:40084 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54858 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49510 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49520 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50834 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47760 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35642 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47126 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:47132 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37386 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59736 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59746 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42628 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:32886 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50766 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49480 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:49488 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39938 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53856 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53860 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47194 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49632 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46120 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52160 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:52168 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37880 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40772 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40780 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55448 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39696 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51882 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60296 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:60302 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33786 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54790 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54800 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53208 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42914 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39980 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53920 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:53922 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57850 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57218 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57224 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35912 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52968 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42836 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37286 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:37288 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54994 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48268 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48284 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55868 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38158 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47876 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42838 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:42846 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46952 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52748 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52756 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39224 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59468 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58602 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43118 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:43132 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36424 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56008 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56022 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35772 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43018 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54390 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33884 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:33898 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41384 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58554 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58556 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56872 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49920 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55966 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52998 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:53010 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60294 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50564 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50578 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49480 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35076 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38204 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50308 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:50316 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54514 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48840 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48854 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40448 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45868 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56490 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33348 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:33356 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59066 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34672 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34678 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34686 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49778 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36754 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47592 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38802 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:38808 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36906 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36914 - "GET /sitemap.xml HTTP/1.0" 404 Not Found INFO: 172.21.0.1:35788 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35800 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36992 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48668 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53220 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41386 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:41400 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59636 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37828 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37832 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37248 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41614 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33022 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42324 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:42330 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38062 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52402 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52410 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37742 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60872 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47854 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52378 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:52394 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60448 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37580 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37584 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50882 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56162 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55214 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59478 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:59480 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40566 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51224 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51234 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36750 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56078 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43052 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37440 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:37454 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54994 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42406 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42408 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47950 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42852 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45304 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57948 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:57950 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49598 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48626 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48630 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36814 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45218 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47902 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52390 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:52398 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46114 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49716 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49724 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40758 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54738 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50544 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43822 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:43824 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41628 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45188 - "GET / HTTP/1.0" 200 OK 2026-03-14 04:06:35,754 - lava_callback - INFO - Received callback for node 69b23bb8b0f5558b5d7cd83e INFO: 172.21.0.1:45204 - "POST /node/69b23bb8b0f5558b5d7cd83e HTTP/1.0" 202 Accepted 2026-03-14 04:06:35,759 - lava_callback - INFO - Starting async job submit for node 69b23bb8b0f5558b5d7cd83e 2026-03-14 04:06:35,760 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 04:06:35,775 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b23bb8b0f5558b5d7cd83e HTTP/1.1" 200 None 2026-03-14 04:06:35,776 - lava_callback - DEBUG - Processing node 69b23bb8b0f5558b5d7cd83e: baseline-arm64-baylibre 2026-03-14 04:06:35,776 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b23bb8b0f5558b5d7cd83e 2026-03-14 04:06:35,777 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 04:06:35,791 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b23bb8b0f5558b5d7cd83e HTTP/1.1" 200 None 2026-03-14 04:06:35,793 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 04:06:35,814 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aeba41feb96b28aa34a78b HTTP/1.1" 200 None 2026-03-14 04:06:35,815 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 04:06:35,857 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b23bb8b0f5558b5d7cd83e HTTP/1.1" 200 None 2026-03-14 04:06:35,864 - lava_callback - ERROR - Error processing callback for node 69b23bb8b0f5558b5d7cd83e: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:45220 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55006 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37236 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47556 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49302 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:49312 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50476 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34064 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34076 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57628 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33534 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59744 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33186 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:33194 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38414 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44102 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44104 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49424 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47106 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54166 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52422 - "GET /api/metrics HTTP/1.0" 200 OK 2026-03-14 04:09:15,900 - lava_callback - INFO - Received callback for node 69b23c5db0f5558b5d7cd85b INFO: 172.21.0.1:52436 - "POST /node/69b23c5db0f5558b5d7cd85b HTTP/1.0" 202 Accepted 2026-03-14 04:09:15,905 - lava_callback - INFO - Starting async job submit for node 69b23c5db0f5558b5d7cd85b 2026-03-14 04:09:15,906 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 04:09:15,921 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b23c5db0f5558b5d7cd85b HTTP/1.1" 200 None 2026-03-14 04:09:15,922 - lava_callback - DEBUG - Processing node 69b23c5db0f5558b5d7cd85b: baseline-arm64-baylibre 2026-03-14 04:09:15,922 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b23c5db0f5558b5d7cd85b 2026-03-14 04:09:15,923 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 04:09:15,947 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b23c5db0f5558b5d7cd85b HTTP/1.1" 200 None 2026-03-14 04:09:15,948 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 04:09:15,962 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aeba41feb96b28aa34a78b HTTP/1.1" 200 None 2026-03-14 04:09:15,963 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 04:09:15,989 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b23c5db0f5558b5d7cd85b HTTP/1.1" 200 None 2026-03-14 04:09:15,991 - lava_callback - ERROR - Error processing callback for node 69b23c5db0f5558b5d7cd85b: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:52452 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53390 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40968 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40982 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46220 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37168 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50240 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42148 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:42164 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58178 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58270 - "GET / HTTP/1.0" 200 OK 2026-03-14 04:10:35,972 - lava_callback - INFO - Received callback for node 69b23cadb0f5558b5d7cd86c INFO: 172.21.0.1:58278 - "POST /node/69b23cadb0f5558b5d7cd86c HTTP/1.0" 202 Accepted 2026-03-14 04:10:35,977 - lava_callback - INFO - Starting async job submit for node 69b23cadb0f5558b5d7cd86c 2026-03-14 04:10:35,978 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 04:10:36,002 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b23cadb0f5558b5d7cd86c HTTP/1.1" 200 None 2026-03-14 04:10:36,004 - lava_callback - DEBUG - Processing node 69b23cadb0f5558b5d7cd86c: baseline-arm64-baylibre 2026-03-14 04:10:36,004 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b23cadb0f5558b5d7cd86c 2026-03-14 04:10:36,004 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 04:10:36,018 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b23cadb0f5558b5d7cd86c HTTP/1.1" 200 None 2026-03-14 04:10:36,020 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 04:10:36,049 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b125a3a870a1dc3343ba94 HTTP/1.1" 200 None 2026-03-14 04:10:36,051 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 04:10:36,071 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b23cadb0f5558b5d7cd86c HTTP/1.1" 200 None 2026-03-14 04:10:36,073 - lava_callback - ERROR - Error processing callback for node 69b23cadb0f5558b5d7cd86c: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:58290 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45994 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41506 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54864 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46190 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:46196 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41618 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55726 - "GET / HTTP/1.0" 200 OK 2026-03-14 04:11:35,943 - lava_callback - INFO - Received callback for node 69b23cf6b0f5558b5d7cd87c INFO: 172.21.0.1:55742 - "POST /node/69b23cf6b0f5558b5d7cd87c HTTP/1.0" 202 Accepted 2026-03-14 04:11:35,949 - lava_callback - INFO - Starting async job submit for node 69b23cf6b0f5558b5d7cd87c 2026-03-14 04:11:35,949 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 04:11:35,965 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b23cf6b0f5558b5d7cd87c HTTP/1.1" 200 None 2026-03-14 04:11:35,966 - lava_callback - DEBUG - Processing node 69b23cf6b0f5558b5d7cd87c: baseline-arm64-baylibre 2026-03-14 04:11:35,966 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b23cf6b0f5558b5d7cd87c 2026-03-14 04:11:35,967 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 04:11:35,987 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b23cf6b0f5558b5d7cd87c HTTP/1.1" 200 None 2026-03-14 04:11:35,988 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 04:11:36,006 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aeba41feb96b28aa34a78b HTTP/1.1" 200 None 2026-03-14 04:11:36,007 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 04:11:36,027 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b23cf6b0f5558b5d7cd87c HTTP/1.1" 200 None 2026-03-14 04:11:36,029 - lava_callback - ERROR - Error processing callback for node 69b23cf6b0f5558b5d7cd87c: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:55752 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37206 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43206 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45554 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55478 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:55492 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40950 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55768 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55782 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60836 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44384 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53788 - "GET / HTTP/1.0" 200 OK 2026-03-14 04:13:14,753 - lava_callback - INFO - Received callback for node 69b23d48b0f5558b5d7cd890 INFO: 172.21.0.1:43426 - "POST /node/69b23d48b0f5558b5d7cd890 HTTP/1.0" 202 Accepted 2026-03-14 04:13:14,759 - lava_callback - INFO - Starting async job submit for node 69b23d48b0f5558b5d7cd890 2026-03-14 04:13:14,760 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 04:13:14,774 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b23d48b0f5558b5d7cd890 HTTP/1.1" 200 None 2026-03-14 04:13:14,775 - lava_callback - DEBUG - Processing node 69b23d48b0f5558b5d7cd890: baseline-arm64-clabbe 2026-03-14 04:13:14,775 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b23d48b0f5558b5d7cd890 2026-03-14 04:13:14,775 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 04:13:14,788 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b23d48b0f5558b5d7cd890 HTTP/1.1" 200 None 2026-03-14 04:13:14,790 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 04:13:14,803 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b125a3a870a1dc3343ba94 HTTP/1.1" 200 None 2026-03-14 04:13:14,804 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 04:13:14,824 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b23d48b0f5558b5d7cd890 HTTP/1.1" 200 None 2026-03-14 04:13:14,828 - lava_callback - ERROR - Error processing callback for node 69b23d48b0f5558b5d7cd890: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:43440 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:43454 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37472 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50080 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50086 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33838 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51284 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34850 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50868 - "GET /api/metrics HTTP/1.0" 200 OK 2026-03-14 04:14:16,191 - lava_callback - INFO - Received callback for node 69b23d90b0f5558b5d7cd898 INFO: 172.21.0.1:50882 - "POST /node/69b23d90b0f5558b5d7cd898 HTTP/1.0" 202 Accepted 2026-03-14 04:14:16,197 - lava_callback - INFO - Starting async job submit for node 69b23d90b0f5558b5d7cd898 2026-03-14 04:14:16,197 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 04:14:16,212 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b23d90b0f5558b5d7cd898 HTTP/1.1" 200 None 2026-03-14 04:14:16,213 - lava_callback - DEBUG - Processing node 69b23d90b0f5558b5d7cd898: baseline-arm64-baylibre 2026-03-14 04:14:16,213 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b23d90b0f5558b5d7cd898 2026-03-14 04:14:16,214 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 04:14:16,268 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b23d90b0f5558b5d7cd898 HTTP/1.1" 200 None 2026-03-14 04:14:16,269 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 04:14:16,283 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aeba41feb96b28aa34a78b HTTP/1.1" 200 None 2026-03-14 04:14:16,284 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 04:14:16,313 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b23d90b0f5558b5d7cd898 HTTP/1.1" 200 None 2026-03-14 04:14:16,315 - lava_callback - ERROR - Error processing callback for node 69b23d90b0f5558b5d7cd898: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:50884 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39632 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46266 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46272 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44240 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59878 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43650 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47202 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:47208 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55932 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59090 - "GET / HTTP/1.0" 200 OK 2026-03-14 04:15:34,783 - lava_callback - INFO - Received callback for node 69b23de1b0f5558b5d7cd8ab INFO: 172.21.0.1:59094 - "POST /node/69b23de1b0f5558b5d7cd8ab HTTP/1.0" 202 Accepted 2026-03-14 04:15:34,789 - lava_callback - INFO - Starting async job submit for node 69b23de1b0f5558b5d7cd8ab 2026-03-14 04:15:34,790 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 04:15:34,823 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b23de1b0f5558b5d7cd8ab HTTP/1.1" 200 None 2026-03-14 04:15:34,824 - lava_callback - DEBUG - Processing node 69b23de1b0f5558b5d7cd8ab: baseline-arm64-clabbe 2026-03-14 04:15:34,824 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b23de1b0f5558b5d7cd8ab 2026-03-14 04:15:34,825 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 04:15:34,862 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b23de1b0f5558b5d7cd8ab HTTP/1.1" 200 None 2026-03-14 04:15:34,863 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 04:15:34,885 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b125a3a870a1dc3343ba94 HTTP/1.1" 200 None 2026-03-14 04:15:34,886 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 04:15:34,929 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b23de1b0f5558b5d7cd8ab HTTP/1.1" 200 None 2026-03-14 04:15:34,937 - lava_callback - ERROR - Error processing callback for node 69b23de1b0f5558b5d7cd8ab: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:59108 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48288 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52412 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44508 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55332 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:55346 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54724 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56228 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56230 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36010 - "GET / HTTP/1.0" 200 OK 2026-03-14 04:16:54,826 - lava_callback - INFO - Received callback for node 69b23e2fb0f5558b5d7cd8be INFO: 172.21.0.1:51304 - "POST /node/69b23e2fb0f5558b5d7cd8be HTTP/1.0" 202 Accepted 2026-03-14 04:16:54,832 - lava_callback - INFO - Starting async job submit for node 69b23e2fb0f5558b5d7cd8be 2026-03-14 04:16:54,833 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 04:16:54,879 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b23e2fb0f5558b5d7cd8be HTTP/1.1" 200 None 2026-03-14 04:16:54,880 - lava_callback - DEBUG - Processing node 69b23e2fb0f5558b5d7cd8be: baseline-arm64-clabbe 2026-03-14 04:16:54,880 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b23e2fb0f5558b5d7cd8be 2026-03-14 04:16:54,881 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 04:16:54,912 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b23e2fb0f5558b5d7cd8be HTTP/1.1" 200 None 2026-03-14 04:16:54,914 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 04:16:54,952 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b125a3a870a1dc3343ba94 HTTP/1.1" 200 None 2026-03-14 04:16:54,954 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 04:16:54,987 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b23e2fb0f5558b5d7cd8be HTTP/1.1" 200 None 2026-03-14 04:16:54,988 - lava_callback - ERROR - Error processing callback for node 69b23e2fb0f5558b5d7cd8be: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:51312 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37844 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51408 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:51424 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39272 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57154 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57156 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36976 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47246 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55700 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37496 - "GET /api/metrics HTTP/1.0" 200 OK 2026-03-14 04:18:16,423 - lava_callback - INFO - Received callback for node 69b23e76b0f5558b5d7cd8c7 INFO: 172.21.0.1:37510 - "POST /node/69b23e76b0f5558b5d7cd8c7 HTTP/1.0" 202 Accepted 2026-03-14 04:18:16,429 - lava_callback - INFO - Starting async job submit for node 69b23e76b0f5558b5d7cd8c7 2026-03-14 04:18:16,430 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 04:18:16,444 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b23e76b0f5558b5d7cd8c7 HTTP/1.1" 200 None 2026-03-14 04:18:16,445 - lava_callback - DEBUG - Processing node 69b23e76b0f5558b5d7cd8c7: baseline-arm64-baylibre 2026-03-14 04:18:16,445 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b23e76b0f5558b5d7cd8c7 2026-03-14 04:18:16,446 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 04:18:16,471 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b23e76b0f5558b5d7cd8c7 HTTP/1.1" 200 None 2026-03-14 04:18:16,472 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 INFO: 172.21.0.1:37526 - "GET / HTTP/1.0" 200 OK 2026-03-14 04:18:16,510 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aeba41feb96b28aa34a78b HTTP/1.1" 200 None 2026-03-14 04:18:16,512 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 04:18:16,533 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b23e76b0f5558b5d7cd8c7 HTTP/1.1" 200 None 2026-03-14 04:18:16,534 - lava_callback - ERROR - Error processing callback for node 69b23e76b0f5558b5d7cd8c7: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:53146 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50860 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50868 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41920 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45578 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34266 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36052 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:36062 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47302 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55878 - "GET / HTTP/1.0" 200 OK 2026-03-14 04:19:34,915 - lava_callback - INFO - Received callback for node 69b23ec7b0f5558b5d7cd8db INFO: 172.21.0.1:55882 - "POST /node/69b23ec7b0f5558b5d7cd8db HTTP/1.0" 202 Accepted 2026-03-14 04:19:34,920 - lava_callback - INFO - Starting async job submit for node 69b23ec7b0f5558b5d7cd8db 2026-03-14 04:19:34,921 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 04:19:34,936 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b23ec7b0f5558b5d7cd8db HTTP/1.1" 200 None 2026-03-14 04:19:34,937 - lava_callback - DEBUG - Processing node 69b23ec7b0f5558b5d7cd8db: baseline-arm64-clabbe 2026-03-14 04:19:34,937 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b23ec7b0f5558b5d7cd8db 2026-03-14 04:19:34,938 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 04:19:34,975 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b23ec7b0f5558b5d7cd8db HTTP/1.1" 200 None 2026-03-14 04:19:34,977 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 04:19:34,991 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b125a3a870a1dc3343ba94 HTTP/1.1" 200 None 2026-03-14 04:19:34,993 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 04:19:35,022 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b23ec7b0f5558b5d7cd8db HTTP/1.1" 200 None 2026-03-14 04:19:35,030 - lava_callback - ERROR - Error processing callback for node 69b23ec7b0f5558b5d7cd8db: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:55898 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59176 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49846 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51748 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37274 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:37282 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38336 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40486 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40502 - "GET / HTTP/1.0" 200 OK 2026-03-14 04:20:36,509 - lava_callback - INFO - Received callback for node 69b23f0db0f5558b5d7cd8e2 INFO: 172.21.0.1:40516 - "POST /node/69b23f0db0f5558b5d7cd8e2 HTTP/1.0" 202 Accepted 2026-03-14 04:20:36,514 - lava_callback - INFO - Starting async job submit for node 69b23f0db0f5558b5d7cd8e2 2026-03-14 04:20:36,515 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 04:20:36,548 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b23f0db0f5558b5d7cd8e2 HTTP/1.1" 200 None 2026-03-14 04:20:36,549 - lava_callback - DEBUG - Processing node 69b23f0db0f5558b5d7cd8e2: baseline-arm64-baylibre 2026-03-14 04:20:36,549 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b23f0db0f5558b5d7cd8e2 2026-03-14 04:20:36,550 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 04:20:36,582 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b23f0db0f5558b5d7cd8e2 HTTP/1.1" 200 None 2026-03-14 04:20:36,583 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 04:20:36,605 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aeba41feb96b28aa34a78b HTTP/1.1" 200 None 2026-03-14 04:20:36,606 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 04:20:36,665 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b23f0db0f5558b5d7cd8e2 HTTP/1.1" 200 None 2026-03-14 04:20:36,672 - lava_callback - ERROR - Error processing callback for node 69b23f0db0f5558b5d7cd8e2: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:43176 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53546 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44280 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54788 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:54802 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54318 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47432 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47436 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47438 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57474 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57862 - "GET /favicon.ico HTTP/1.0" 404 Not Found INFO: 172.21.0.1:57864 - "GET /robots.txt HTTP/1.0" 404 Not Found INFO: 172.21.0.1:57876 - "GET /sitemap.xml HTTP/1.0" 404 Not Found 2026-03-14 04:21:55,018 - lava_callback - INFO - Received callback for node 69b23f5eb0f5558b5d7cd8f5 INFO: 172.21.0.1:57890 - "POST /node/69b23f5eb0f5558b5d7cd8f5 HTTP/1.0" 202 Accepted 2026-03-14 04:21:55,023 - lava_callback - INFO - Starting async job submit for node 69b23f5eb0f5558b5d7cd8f5 2026-03-14 04:21:55,024 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 04:21:55,038 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b23f5eb0f5558b5d7cd8f5 HTTP/1.1" 200 None 2026-03-14 04:21:55,039 - lava_callback - DEBUG - Processing node 69b23f5eb0f5558b5d7cd8f5: baseline-arm64-clabbe 2026-03-14 04:21:55,039 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b23f5eb0f5558b5d7cd8f5 2026-03-14 04:21:55,040 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 04:21:55,085 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b23f5eb0f5558b5d7cd8f5 HTTP/1.1" 200 None 2026-03-14 04:21:55,087 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 04:21:55,128 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b125a3a870a1dc3343ba94 HTTP/1.1" 200 None 2026-03-14 04:21:55,130 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 04:21:55,150 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b23f5eb0f5558b5d7cd8f5 HTTP/1.1" 200 None 2026-03-14 04:21:55,151 - lava_callback - ERROR - Error processing callback for node 69b23f5eb0f5558b5d7cd8f5: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:57904 - "GET /config.json HTTP/1.0" 404 Not Found INFO: 172.21.0.1:57912 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59142 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40278 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:40288 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:32768 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43216 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43228 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40628 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36168 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54356 - "GET / HTTP/1.0" 200 OK 2026-03-14 04:23:15,072 - lava_callback - INFO - Received callback for node 69b23fa9b0f5558b5d7cd8fd INFO: 172.21.0.1:37894 - "POST /node/69b23fa9b0f5558b5d7cd8fd HTTP/1.0" 202 Accepted 2026-03-14 04:23:15,078 - lava_callback - INFO - Starting async job submit for node 69b23fa9b0f5558b5d7cd8fd 2026-03-14 04:23:15,079 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 04:23:15,115 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b23fa9b0f5558b5d7cd8fd HTTP/1.1" 200 None 2026-03-14 04:23:15,116 - lava_callback - DEBUG - Processing node 69b23fa9b0f5558b5d7cd8fd: baseline-arm64-clabbe 2026-03-14 04:23:15,116 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b23fa9b0f5558b5d7cd8fd 2026-03-14 04:23:15,117 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 04:23:15,130 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b23fa9b0f5558b5d7cd8fd HTTP/1.1" 200 None 2026-03-14 04:23:15,132 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 04:23:15,161 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aeba41feb96b28aa34a78b HTTP/1.1" 200 None INFO: 172.21.0.1:37898 - "GET /api/metrics HTTP/1.0" 200 OK 2026-03-14 04:23:15,163 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 04:23:15,210 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b23fa9b0f5558b5d7cd8fd HTTP/1.1" 200 None 2026-03-14 04:23:15,212 - lava_callback - ERROR - Error processing callback for node 69b23fa9b0f5558b5d7cd8fd: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:37914 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41874 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55546 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55554 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51772 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40816 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34018 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49998 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:50012 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46508 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47274 - "GET / HTTP/1.0" 200 OK 2026-03-14 04:24:35,133 - lava_callback - INFO - Received callback for node 69b23ff7b0f5558b5d7cd913 INFO: 172.21.0.1:47284 - "POST /node/69b23ff7b0f5558b5d7cd913 HTTP/1.0" 202 Accepted 2026-03-14 04:24:35,139 - lava_callback - INFO - Starting async job submit for node 69b23ff7b0f5558b5d7cd913 2026-03-14 04:24:35,140 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 04:24:35,178 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b23ff7b0f5558b5d7cd913 HTTP/1.1" 200 None 2026-03-14 04:24:35,179 - lava_callback - DEBUG - Processing node 69b23ff7b0f5558b5d7cd913: baseline-arm64-clabbe 2026-03-14 04:24:35,179 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b23ff7b0f5558b5d7cd913 2026-03-14 04:24:35,180 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 04:24:35,224 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b23ff7b0f5558b5d7cd913 HTTP/1.1" 200 None 2026-03-14 04:24:35,226 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 04:24:35,258 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aeba41feb96b28aa34a78b HTTP/1.1" 200 None 2026-03-14 04:24:35,260 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 04:24:35,280 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b23ff7b0f5558b5d7cd913 HTTP/1.1" 200 None 2026-03-14 04:24:35,286 - lava_callback - ERROR - Error processing callback for node 69b23ff7b0f5558b5d7cd913: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:47286 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48694 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42346 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53222 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35942 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:35952 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60922 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44382 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44390 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46572 - "GET / HTTP/1.0" 200 OK 2026-03-14 04:25:55,178 - lava_callback - INFO - Received callback for node 69b24043b0f5558b5d7cd91a INFO: 172.21.0.1:53428 - "POST /node/69b24043b0f5558b5d7cd91a HTTP/1.0" 202 Accepted 2026-03-14 04:25:55,183 - lava_callback - INFO - Starting async job submit for node 69b24043b0f5558b5d7cd91a 2026-03-14 04:25:55,184 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 04:25:55,235 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b24043b0f5558b5d7cd91a HTTP/1.1" 200 None 2026-03-14 04:25:55,236 - lava_callback - DEBUG - Processing node 69b24043b0f5558b5d7cd91a: baseline-arm64-clabbe 2026-03-14 04:25:55,236 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b24043b0f5558b5d7cd91a 2026-03-14 04:25:55,237 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 04:25:55,271 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b24043b0f5558b5d7cd91a HTTP/1.1" 200 None 2026-03-14 04:25:55,272 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 04:25:55,291 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aeba41feb96b28aa34a78b HTTP/1.1" 200 None 2026-03-14 04:25:55,293 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 04:25:55,314 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b24043b0f5558b5d7cd91a HTTP/1.1" 200 None 2026-03-14 04:25:55,315 - lava_callback - ERROR - Error processing callback for node 69b24043b0f5558b5d7cd91a: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:53442 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35420 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48674 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:48686 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46698 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52512 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52514 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45364 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51454 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56056 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43310 - "GET /api/metrics HTTP/1.0" 200 OK 2026-03-14 04:27:15,260 - lava_callback - INFO - Received callback for node 69b2408eb0f5558b5d7cd936 INFO: 172.21.0.1:43320 - "POST /node/69b2408eb0f5558b5d7cd936 HTTP/1.0" 202 Accepted 2026-03-14 04:27:15,265 - lava_callback - INFO - Starting async job submit for node 69b2408eb0f5558b5d7cd936 2026-03-14 04:27:15,266 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 04:27:15,280 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b2408eb0f5558b5d7cd936 HTTP/1.1" 200 None 2026-03-14 04:27:15,281 - lava_callback - DEBUG - Processing node 69b2408eb0f5558b5d7cd936: baseline-arm64-clabbe 2026-03-14 04:27:15,281 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b2408eb0f5558b5d7cd936 2026-03-14 04:27:15,282 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 04:27:15,313 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b2408eb0f5558b5d7cd936 HTTP/1.1" 200 None 2026-03-14 04:27:15,315 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 04:27:15,329 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aeba41feb96b28aa34a78b HTTP/1.1" 200 None 2026-03-14 04:27:15,330 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 04:27:15,386 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b2408eb0f5558b5d7cd936 HTTP/1.1" 200 None 2026-03-14 04:27:15,388 - lava_callback - ERROR - Error processing callback for node 69b2408eb0f5558b5d7cd936: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:43334 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47742 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51036 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51046 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43956 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38406 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60186 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40398 - "GET /api/metrics HTTP/1.0" 200 OK 2026-03-14 04:28:15,331 - lava_callback - INFO - Received callback for node 69b240dab0f5558b5d7cd93d INFO: 172.21.0.1:40414 - "POST /node/69b240dab0f5558b5d7cd93d HTTP/1.0" 202 Accepted 2026-03-14 04:28:15,336 - lava_callback - INFO - Starting async job submit for node 69b240dab0f5558b5d7cd93d 2026-03-14 04:28:15,337 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 04:28:15,376 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b240dab0f5558b5d7cd93d HTTP/1.1" 200 None 2026-03-14 04:28:15,377 - lava_callback - DEBUG - Processing node 69b240dab0f5558b5d7cd93d: baseline-arm64-clabbe 2026-03-14 04:28:15,377 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b240dab0f5558b5d7cd93d 2026-03-14 04:28:15,377 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 04:28:15,411 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b240dab0f5558b5d7cd93d HTTP/1.1" 200 None 2026-03-14 04:28:15,413 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 04:28:15,426 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aeba41feb96b28aa34a78b HTTP/1.1" 200 None 2026-03-14 04:28:15,428 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 04:28:15,450 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b240dab0f5558b5d7cd93d HTTP/1.1" 200 None 2026-03-14 04:28:15,458 - lava_callback - ERROR - Error processing callback for node 69b240dab0f5558b5d7cd93d: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:40422 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59016 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41338 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41354 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58358 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54864 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38700 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58334 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:58344 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43772 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48110 - "GET / HTTP/1.0" 200 OK 2026-03-14 04:29:35,304 - lava_callback - INFO - Received callback for node 69b24125b0f5558b5d7cd956 INFO: 172.21.0.1:48118 - "POST /node/69b24125b0f5558b5d7cd956 HTTP/1.0" 202 Accepted 2026-03-14 04:29:35,310 - lava_callback - INFO - Starting async job submit for node 69b24125b0f5558b5d7cd956 2026-03-14 04:29:35,311 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 04:29:35,328 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b24125b0f5558b5d7cd956 HTTP/1.1" 200 None 2026-03-14 04:29:35,329 - lava_callback - DEBUG - Processing node 69b24125b0f5558b5d7cd956: baseline-arm64-clabbe 2026-03-14 04:29:35,329 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b24125b0f5558b5d7cd956 2026-03-14 04:29:35,330 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 04:29:35,365 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b24125b0f5558b5d7cd956 HTTP/1.1" 200 None 2026-03-14 04:29:35,367 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 04:29:35,401 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aeba41feb96b28aa34a78b HTTP/1.1" 200 None 2026-03-14 04:29:35,402 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 04:29:35,431 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b24125b0f5558b5d7cd956 HTTP/1.1" 200 None 2026-03-14 04:29:35,433 - lava_callback - ERROR - Error processing callback for node 69b24125b0f5558b5d7cd956: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:48122 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40504 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40088 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37776 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39230 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:39236 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48998 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60338 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60344 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41622 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35860 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39270 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60416 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:60422 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40362 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33752 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33768 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35224 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43532 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53310 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57990 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:58004 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34528 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55376 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55378 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33296 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36848 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60356 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:32794 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:32796 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54174 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56328 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56332 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43402 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51258 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50300 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43168 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:43178 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40388 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35524 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35528 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44180 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52162 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43742 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47134 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:47144 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55708 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58878 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58890 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51360 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38988 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57384 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56850 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:56864 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38080 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57042 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57044 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37140 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37462 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43886 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42362 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:42376 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43504 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51898 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51912 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57858 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52354 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48796 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47738 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:47754 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33892 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59372 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59388 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37146 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45036 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36240 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34618 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:34624 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43992 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59318 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59322 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52098 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58654 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55302 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39448 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:39452 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50320 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44352 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44358 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40710 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35906 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52418 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39916 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:39922 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40522 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33428 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33432 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40904 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43164 - "GET / HTTP/1.0" 200 OK 2026-03-14 04:41:58,008 - lava_callback - INFO - Received callback for node 69b2440fb0f5558b5d7cd98d INFO: 172.21.0.1:43180 - "POST /node/69b2440fb0f5558b5d7cd98d HTTP/1.0" 202 Accepted 2026-03-14 04:41:58,013 - lava_callback - INFO - Starting async job submit for node 69b2440fb0f5558b5d7cd98d 2026-03-14 04:41:58,014 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 04:41:58,029 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b2440fb0f5558b5d7cd98d HTTP/1.1" 200 None 2026-03-14 04:41:58,030 - lava_callback - DEBUG - Processing node 69b2440fb0f5558b5d7cd98d: baseline-arm-baylibre 2026-03-14 04:41:58,030 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b2440fb0f5558b5d7cd98d 2026-03-14 04:41:58,030 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 04:41:58,045 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b2440fb0f5558b5d7cd98d HTTP/1.1" 200 None 2026-03-14 04:41:58,047 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 04:41:58,061 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b195f7a26b422765ba3705 HTTP/1.1" 200 None 2026-03-14 04:41:58,062 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 04:41:58,083 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b2440fb0f5558b5d7cd98d HTTP/1.1" 200 None 2026-03-14 04:41:58,084 - lava_callback - ERROR - Error processing callback for node 69b2440fb0f5558b5d7cd98d: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:39916 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39418 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:39422 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40122 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60538 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60552 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40860 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45168 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34666 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36512 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:36516 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44584 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35902 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35904 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46140 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60798 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33030 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56754 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:56758 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52266 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46974 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46986 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56820 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60822 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57412 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39602 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:39616 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41728 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48054 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48066 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42538 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41284 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36992 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39152 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:39162 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57976 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55884 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55898 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46912 - "GET / HTTP/1.0" 200 OK 2026-03-14 04:46:56,074 - lava_callback - INFO - Received callback for node 69b24533b0f5558b5d7cda02 INFO: 172.21.0.1:39054 - "POST /node/69b24533b0f5558b5d7cda02 HTTP/1.0" 202 Accepted 2026-03-14 04:46:56,079 - lava_callback - INFO - Starting async job submit for node 69b24533b0f5558b5d7cda02 2026-03-14 04:46:56,080 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 04:46:56,095 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b24533b0f5558b5d7cda02 HTTP/1.1" 200 None 2026-03-14 04:46:56,096 - lava_callback - DEBUG - Processing node 69b24533b0f5558b5d7cda02: baseline-arm-clabbe 2026-03-14 04:46:56,097 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b24533b0f5558b5d7cda02 2026-03-14 04:46:56,097 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 04:46:56,116 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b24533b0f5558b5d7cda02 HTTP/1.1" 200 None 2026-03-14 04:46:56,118 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 04:46:56,136 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b195f7a26b422765ba3705 HTTP/1.1" 200 None 2026-03-14 04:46:56,137 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 04:46:56,164 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b24533b0f5558b5d7cda02 HTTP/1.1" 200 None 2026-03-14 04:46:56,168 - lava_callback - ERROR - Error processing callback for node 69b24533b0f5558b5d7cda02: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:39064 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60614 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47426 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:47428 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41904 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39250 - "GET / HTTP/1.0" 200 OK 2026-03-14 04:47:36,072 - lava_callback - INFO - Received callback for node 69b24558b0f5558b5d7cda14 INFO: 172.21.0.1:39258 - "POST /node/69b24558b0f5558b5d7cda14 HTTP/1.0" 202 Accepted 2026-03-14 04:47:36,078 - lava_callback - INFO - Starting async job submit for node 69b24558b0f5558b5d7cda14 2026-03-14 04:47:36,078 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 04:47:36,093 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b24558b0f5558b5d7cda14 HTTP/1.1" 200 None 2026-03-14 04:47:36,094 - lava_callback - DEBUG - Processing node 69b24558b0f5558b5d7cda14: baseline-arm-clabbe 2026-03-14 04:47:36,094 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b24558b0f5558b5d7cda14 2026-03-14 04:47:36,095 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 04:47:36,108 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b24558b0f5558b5d7cda14 HTTP/1.1" 200 None 2026-03-14 04:47:36,109 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 04:47:36,123 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b195f7a26b422765ba3705 HTTP/1.1" 200 None 2026-03-14 04:47:36,125 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 04:47:36,153 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b24558b0f5558b5d7cda14 HTTP/1.1" 200 None 2026-03-14 04:47:36,155 - lava_callback - ERROR - Error processing callback for node 69b24558b0f5558b5d7cda14: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:39266 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47238 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59844 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36490 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37312 - "GET /api/metrics HTTP/1.0" 200 OK 2026-03-14 04:48:16,097 - lava_callback - INFO - Received callback for node 69b2457cb0f5558b5d7cda23 INFO: 172.21.0.1:37320 - "POST /node/69b2457cb0f5558b5d7cda23 HTTP/1.0" 202 Accepted 2026-03-14 04:48:16,103 - lava_callback - INFO - Starting async job submit for node 69b2457cb0f5558b5d7cda23 2026-03-14 04:48:16,103 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 04:48:16,118 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b2457cb0f5558b5d7cda23 HTTP/1.1" 200 None 2026-03-14 04:48:16,119 - lava_callback - DEBUG - Processing node 69b2457cb0f5558b5d7cda23: baseline-arm-clabbe 2026-03-14 04:48:16,119 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b2457cb0f5558b5d7cda23 2026-03-14 04:48:16,119 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 04:48:16,135 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b2457cb0f5558b5d7cda23 HTTP/1.1" 200 None 2026-03-14 04:48:16,137 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 04:48:16,151 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b195f7a26b422765ba3705 HTTP/1.1" 200 None 2026-03-14 04:48:16,152 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 04:48:16,178 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b2457cb0f5558b5d7cda23 HTTP/1.1" 200 None 2026-03-14 04:48:16,180 - lava_callback - ERROR - Error processing callback for node 69b2457cb0f5558b5d7cda23: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:37326 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40258 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37782 - "GET / HTTP/1.0" 200 OK 2026-03-14 04:48:36,120 - lava_callback - INFO - Received callback for node 69b245a1b0f5558b5d7cda2f INFO: 172.21.0.1:37786 - "POST /node/69b245a1b0f5558b5d7cda2f HTTP/1.0" 202 Accepted 2026-03-14 04:48:36,125 - lava_callback - INFO - Starting async job submit for node 69b245a1b0f5558b5d7cda2f 2026-03-14 04:48:36,126 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 04:48:36,140 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b245a1b0f5558b5d7cda2f HTTP/1.1" 200 None 2026-03-14 04:48:36,141 - lava_callback - DEBUG - Processing node 69b245a1b0f5558b5d7cda2f: baseline-arm-clabbe 2026-03-14 04:48:36,141 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b245a1b0f5558b5d7cda2f 2026-03-14 04:48:36,141 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 04:48:36,157 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b245a1b0f5558b5d7cda2f HTTP/1.1" 200 None 2026-03-14 04:48:36,159 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 04:48:36,197 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b195f7a26b422765ba3705 HTTP/1.1" 200 None 2026-03-14 04:48:36,199 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 04:48:36,220 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b245a1b0f5558b5d7cda2f HTTP/1.1" 200 None 2026-03-14 04:48:36,224 - lava_callback - ERROR - Error processing callback for node 69b245a1b0f5558b5d7cda2f: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:37798 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43270 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36716 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38010 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45820 - "GET /api/metrics HTTP/1.0" 200 OK 2026-03-14 04:49:16,170 - lava_callback - INFO - Received callback for node 69b245c6b0f5558b5d7cda3f INFO: 172.21.0.1:45832 - "POST /node/69b245c6b0f5558b5d7cda3f HTTP/1.0" 202 Accepted 2026-03-14 04:49:16,175 - lava_callback - INFO - Starting async job submit for node 69b245c6b0f5558b5d7cda3f 2026-03-14 04:49:16,176 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 04:49:16,191 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b245c6b0f5558b5d7cda3f HTTP/1.1" 200 None 2026-03-14 04:49:16,192 - lava_callback - DEBUG - Processing node 69b245c6b0f5558b5d7cda3f: baseline-arm-clabbe 2026-03-14 04:49:16,192 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b245c6b0f5558b5d7cda3f 2026-03-14 04:49:16,193 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 04:49:16,213 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b245c6b0f5558b5d7cda3f HTTP/1.1" 200 None 2026-03-14 04:49:16,214 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 04:49:16,227 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b195f7a26b422765ba3705 HTTP/1.1" 200 None 2026-03-14 04:49:16,229 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 04:49:16,251 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b245c6b0f5558b5d7cda3f HTTP/1.1" 200 None 2026-03-14 04:49:16,252 - lava_callback - ERROR - Error processing callback for node 69b245c6b0f5558b5d7cda3f: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:45840 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42516 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45628 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45634 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42230 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39906 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47586 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35012 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:35016 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37108 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56398 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56402 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41232 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53312 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38414 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55936 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:55952 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52834 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42344 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42348 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33508 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36248 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54924 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43332 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:43340 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38020 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58118 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58124 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44554 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37736 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42942 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37236 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:37242 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54266 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35574 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35582 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54568 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55792 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58262 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55872 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:55880 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58878 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44498 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44500 - "GET / HTTP/1.0" 200 OK 2026-03-14 04:54:38,553 - lava_callback - INFO - Received callback for node 69b24700b0f5558b5d7cda64 INFO: 172.21.0.1:44512 - "POST /node/69b24700b0f5558b5d7cda64 HTTP/1.0" 202 Accepted 2026-03-14 04:54:38,559 - lava_callback - INFO - Starting async job submit for node 69b24700b0f5558b5d7cda64 2026-03-14 04:54:38,560 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 04:54:38,574 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b24700b0f5558b5d7cda64 HTTP/1.1" 200 None 2026-03-14 04:54:38,575 - lava_callback - DEBUG - Processing node 69b24700b0f5558b5d7cda64: baseline-arm-baylibre 2026-03-14 04:54:38,575 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b24700b0f5558b5d7cda64 2026-03-14 04:54:38,575 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 04:54:38,593 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b24700b0f5558b5d7cda64 HTTP/1.1" 200 None 2026-03-14 04:54:38,595 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 04:54:38,615 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aef424ce46d8ec186ab80e HTTP/1.1" 200 None 2026-03-14 04:54:38,616 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 04:54:38,641 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b24700b0f5558b5d7cda64 HTTP/1.1" 200 None 2026-03-14 04:54:38,647 - lava_callback - ERROR - Error processing callback for node 69b24700b0f5558b5d7cda64: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:36866 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59424 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36054 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41584 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:41598 - "GET / HTTP/1.0" 200 OK 2026-03-14 04:55:18,411 - lava_callback - INFO - Received callback for node 69b24725b0f5558b5d7cda74 INFO: 172.21.0.1:41604 - "POST /node/69b24725b0f5558b5d7cda74 HTTP/1.0" 202 Accepted 2026-03-14 04:55:18,417 - lava_callback - INFO - Starting async job submit for node 69b24725b0f5558b5d7cda74 2026-03-14 04:55:18,418 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 04:55:18,433 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b24725b0f5558b5d7cda74 HTTP/1.1" 200 None 2026-03-14 04:55:18,434 - lava_callback - DEBUG - Processing node 69b24725b0f5558b5d7cda74: baseline-arm-baylibre 2026-03-14 04:55:18,434 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b24725b0f5558b5d7cda74 2026-03-14 04:55:18,435 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 04:55:18,448 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b24725b0f5558b5d7cda74 HTTP/1.1" 200 None 2026-03-14 04:55:18,449 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 04:55:18,462 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aef424ce46d8ec186ab80e HTTP/1.1" 200 None 2026-03-14 04:55:18,464 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 04:55:18,484 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b24725b0f5558b5d7cda74 HTTP/1.1" 200 None 2026-03-14 04:55:18,488 - lava_callback - ERROR - Error processing callback for node 69b24725b0f5558b5d7cda74: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:58696 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35456 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35466 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38664 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50748 - "GET / HTTP/1.0" 200 OK 2026-03-14 04:55:58,642 - lava_callback - INFO - Received callback for node 69b24748b0f5558b5d7cda7d INFO: 172.21.0.1:50760 - "POST /node/69b24748b0f5558b5d7cda7d HTTP/1.0" 202 Accepted 2026-03-14 04:55:58,647 - lava_callback - INFO - Starting async job submit for node 69b24748b0f5558b5d7cda7d 2026-03-14 04:55:58,648 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 04:55:58,665 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b24748b0f5558b5d7cda7d HTTP/1.1" 200 None 2026-03-14 04:55:58,666 - lava_callback - DEBUG - Processing node 69b24748b0f5558b5d7cda7d: baseline-arm-baylibre 2026-03-14 04:55:58,667 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b24748b0f5558b5d7cda7d 2026-03-14 04:55:58,667 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 04:55:58,682 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b24748b0f5558b5d7cda7d HTTP/1.1" 200 None 2026-03-14 04:55:58,683 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 04:55:58,699 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aef424ce46d8ec186ab80e HTTP/1.1" 200 None 2026-03-14 04:55:58,701 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 04:55:58,722 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b24748b0f5558b5d7cda7d HTTP/1.1" 200 None 2026-03-14 04:55:58,730 - lava_callback - ERROR - Error processing callback for node 69b24748b0f5558b5d7cda7d: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:43378 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35218 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:35226 - "GET / HTTP/1.0" 200 OK 2026-03-14 04:56:18,482 - lava_callback - INFO - Received callback for node 69b2476cb0f5558b5d7cda8b INFO: 172.21.0.1:35230 - "POST /node/69b2476cb0f5558b5d7cda8b HTTP/1.0" 202 Accepted 2026-03-14 04:56:18,487 - lava_callback - INFO - Starting async job submit for node 69b2476cb0f5558b5d7cda8b 2026-03-14 04:56:18,488 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 04:56:18,507 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b2476cb0f5558b5d7cda8b HTTP/1.1" 200 None 2026-03-14 04:56:18,508 - lava_callback - DEBUG - Processing node 69b2476cb0f5558b5d7cda8b: baseline-arm-baylibre 2026-03-14 04:56:18,509 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b2476cb0f5558b5d7cda8b 2026-03-14 04:56:18,509 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 04:56:18,539 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b2476cb0f5558b5d7cda8b HTTP/1.1" 200 None 2026-03-14 04:56:18,540 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 04:56:18,553 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aef424ce46d8ec186ab80e HTTP/1.1" 200 None 2026-03-14 04:56:18,554 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 04:56:18,580 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b2476cb0f5558b5d7cda8b HTTP/1.1" 200 None 2026-03-14 04:56:18,581 - lava_callback - ERROR - Error processing callback for node 69b2476cb0f5558b5d7cda8b: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:48510 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51440 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51444 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49558 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33874 - "GET / HTTP/1.0" 200 OK 2026-03-14 04:56:58,521 - lava_callback - INFO - Received callback for node 69b24791b0f5558b5d7cda9d INFO: 172.21.0.1:33880 - "POST /node/69b24791b0f5558b5d7cda9d HTTP/1.0" 202 Accepted 2026-03-14 04:56:58,526 - lava_callback - INFO - Starting async job submit for node 69b24791b0f5558b5d7cda9d 2026-03-14 04:56:58,527 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 04:56:58,541 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b24791b0f5558b5d7cda9d HTTP/1.1" 200 None 2026-03-14 04:56:58,542 - lava_callback - DEBUG - Processing node 69b24791b0f5558b5d7cda9d: baseline-arm-baylibre 2026-03-14 04:56:58,542 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b24791b0f5558b5d7cda9d 2026-03-14 04:56:58,543 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 04:56:58,556 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b24791b0f5558b5d7cda9d HTTP/1.1" 200 None 2026-03-14 04:56:58,558 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 04:56:58,627 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aef424ce46d8ec186ab80e HTTP/1.1" 200 None 2026-03-14 04:56:58,628 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 04:56:58,652 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b24791b0f5558b5d7cda9d HTTP/1.1" 200 None 2026-03-14 04:56:58,653 - lava_callback - ERROR - Error processing callback for node 69b24791b0f5558b5d7cda9d: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:47654 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33916 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:33924 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53432 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59418 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59432 - "GET / HTTP/1.0" 200 OK 2026-03-14 04:57:38,641 - lava_callback - INFO - Received callback for node 69b247b5b0f5558b5d7cdaa9 INFO: 172.21.0.1:59442 - "POST /node/69b247b5b0f5558b5d7cdaa9 HTTP/1.0" 202 Accepted 2026-03-14 04:57:38,646 - lava_callback - INFO - Starting async job submit for node 69b247b5b0f5558b5d7cdaa9 2026-03-14 04:57:38,647 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 04:57:38,688 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b247b5b0f5558b5d7cdaa9 HTTP/1.1" 200 None 2026-03-14 04:57:38,689 - lava_callback - DEBUG - Processing node 69b247b5b0f5558b5d7cdaa9: baseline-arm-baylibre 2026-03-14 04:57:38,689 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b247b5b0f5558b5d7cdaa9 2026-03-14 04:57:38,690 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 04:57:38,726 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b247b5b0f5558b5d7cdaa9 HTTP/1.1" 200 None 2026-03-14 04:57:38,728 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 04:57:38,752 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aef424ce46d8ec186ab80e HTTP/1.1" 200 None 2026-03-14 04:57:38,753 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 04:57:38,800 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b247b5b0f5558b5d7cdaa9 HTTP/1.1" 200 None 2026-03-14 04:57:38,802 - lava_callback - ERROR - Error processing callback for node 69b247b5b0f5558b5d7cdaa9: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:50576 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36554 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43130 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44698 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:44702 - "GET / HTTP/1.0" 200 OK 2026-03-14 04:58:18,585 - lava_callback - INFO - Received callback for node 69b247d9b0f5558b5d7cdab8 INFO: 172.21.0.1:44704 - "POST /node/69b247d9b0f5558b5d7cdab8 HTTP/1.0" 202 Accepted 2026-03-14 04:58:18,590 - lava_callback - INFO - Starting async job submit for node 69b247d9b0f5558b5d7cdab8 2026-03-14 04:58:18,591 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 04:58:18,622 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b247d9b0f5558b5d7cdab8 HTTP/1.1" 200 None 2026-03-14 04:58:18,623 - lava_callback - DEBUG - Processing node 69b247d9b0f5558b5d7cdab8: baseline-arm-baylibre 2026-03-14 04:58:18,623 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b247d9b0f5558b5d7cdab8 2026-03-14 04:58:18,624 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 04:58:18,657 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b247d9b0f5558b5d7cdab8 HTTP/1.1" 200 None 2026-03-14 04:58:18,658 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 04:58:18,672 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aef424ce46d8ec186ab80e HTTP/1.1" 200 None 2026-03-14 04:58:18,674 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 04:58:18,741 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b247d9b0f5558b5d7cdab8 HTTP/1.1" 200 None 2026-03-14 04:58:18,742 - lava_callback - ERROR - Error processing callback for node 69b247d9b0f5558b5d7cdab8: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:45276 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51398 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51402 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57560 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52462 - "GET / HTTP/1.0" 200 OK 2026-03-14 04:58:58,661 - lava_callback - INFO - Received callback for node 69b247ffb0f5558b5d7cdac5 INFO: 172.21.0.1:52478 - "POST /node/69b247ffb0f5558b5d7cdac5 HTTP/1.0" 202 Accepted 2026-03-14 04:58:58,667 - lava_callback - INFO - Starting async job submit for node 69b247ffb0f5558b5d7cdac5 2026-03-14 04:58:58,668 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 04:58:58,708 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b247ffb0f5558b5d7cdac5 HTTP/1.1" 200 None 2026-03-14 04:58:58,709 - lava_callback - DEBUG - Processing node 69b247ffb0f5558b5d7cdac5: baseline-arm-baylibre 2026-03-14 04:58:58,709 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b247ffb0f5558b5d7cdac5 2026-03-14 04:58:58,710 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 04:58:58,750 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b247ffb0f5558b5d7cdac5 HTTP/1.1" 200 None 2026-03-14 04:58:58,752 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 04:58:58,766 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aef424ce46d8ec186ab80e HTTP/1.1" 200 None 2026-03-14 04:58:58,767 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 04:58:58,789 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b247ffb0f5558b5d7cdac5 HTTP/1.1" 200 None 2026-03-14 04:58:58,791 - lava_callback - ERROR - Error processing callback for node 69b247ffb0f5558b5d7cdac5: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:52652 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58050 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:58054 - "GET / HTTP/1.0" 200 OK 2026-03-14 04:59:18,661 - lava_callback - INFO - Received callback for node 69b24823b0f5558b5d7cdad2 INFO: 172.21.0.1:58064 - "POST /node/69b24823b0f5558b5d7cdad2 HTTP/1.0" 202 Accepted 2026-03-14 04:59:18,666 - lava_callback - INFO - Starting async job submit for node 69b24823b0f5558b5d7cdad2 2026-03-14 04:59:18,667 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 04:59:18,682 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b24823b0f5558b5d7cdad2 HTTP/1.1" 200 None 2026-03-14 04:59:18,683 - lava_callback - DEBUG - Processing node 69b24823b0f5558b5d7cdad2: baseline-arm-baylibre 2026-03-14 04:59:18,683 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b24823b0f5558b5d7cdad2 2026-03-14 04:59:18,684 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 04:59:18,697 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b24823b0f5558b5d7cdad2 HTTP/1.1" 200 None 2026-03-14 04:59:18,698 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 04:59:18,711 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aef424ce46d8ec186ab80e HTTP/1.1" 200 None 2026-03-14 04:59:18,713 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 04:59:18,751 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b24823b0f5558b5d7cdad2 HTTP/1.1" 200 None 2026-03-14 04:59:18,753 - lava_callback - ERROR - Error processing callback for node 69b24823b0f5558b5d7cdad2: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:42980 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56378 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56380 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38178 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38598 - "GET / HTTP/1.0" 200 OK 2026-03-14 04:59:58,711 - lava_callback - INFO - Received callback for node 69b24845b0f5558b5d7cdae5 INFO: 172.21.0.1:38608 - "POST /node/69b24845b0f5558b5d7cdae5 HTTP/1.0" 202 Accepted 2026-03-14 04:59:58,716 - lava_callback - INFO - Starting async job submit for node 69b24845b0f5558b5d7cdae5 2026-03-14 04:59:58,717 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 04:59:58,734 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b24845b0f5558b5d7cdae5 HTTP/1.1" 200 None 2026-03-14 04:59:58,735 - lava_callback - DEBUG - Processing node 69b24845b0f5558b5d7cdae5: baseline-arm-baylibre 2026-03-14 04:59:58,735 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b24845b0f5558b5d7cdae5 2026-03-14 04:59:58,736 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 04:59:58,755 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b24845b0f5558b5d7cdae5 HTTP/1.1" 200 None 2026-03-14 04:59:58,757 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 04:59:58,771 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aef424ce46d8ec186ab80e HTTP/1.1" 200 None 2026-03-14 04:59:58,772 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 04:59:58,792 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b24845b0f5558b5d7cdae5 HTTP/1.1" 200 None 2026-03-14 04:59:58,797 - lava_callback - ERROR - Error processing callback for node 69b24845b0f5558b5d7cdae5: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:54988 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56590 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:56592 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36914 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45564 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45576 - "GET / HTTP/1.0" 200 OK 2026-03-14 05:00:39,333 - lava_callback - INFO - Received callback for node 69b2486ab0f5558b5d7cdaee INFO: 172.21.0.1:45592 - "POST /node/69b2486ab0f5558b5d7cdaee HTTP/1.0" 202 Accepted 2026-03-14 05:00:39,338 - lava_callback - INFO - Starting async job submit for node 69b2486ab0f5558b5d7cdaee 2026-03-14 05:00:39,339 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 05:00:39,356 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b2486ab0f5558b5d7cdaee HTTP/1.1" 200 None 2026-03-14 05:00:39,357 - lava_callback - DEBUG - Processing node 69b2486ab0f5558b5d7cdaee: baseline-arm-baylibre 2026-03-14 05:00:39,357 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b2486ab0f5558b5d7cdaee 2026-03-14 05:00:39,358 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 05:00:39,403 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b2486ab0f5558b5d7cdaee HTTP/1.1" 200 None 2026-03-14 05:00:39,404 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 05:00:39,417 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aef424ce46d8ec186ab80e HTTP/1.1" 200 None 2026-03-14 05:00:39,419 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 05:00:39,439 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b2486ab0f5558b5d7cdaee HTTP/1.1" 200 None 2026-03-14 05:00:39,442 - lava_callback - ERROR - Error processing callback for node 69b2486ab0f5558b5d7cdaee: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:48082 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59604 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42038 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57596 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:57600 - "GET / HTTP/1.0" 200 OK 2026-03-14 05:01:18,776 - lava_callback - INFO - Received callback for node 69b2488fb0f5558b5d7cdb00 INFO: 172.21.0.1:57614 - "POST /node/69b2488fb0f5558b5d7cdb00 HTTP/1.0" 202 Accepted 2026-03-14 05:01:18,781 - lava_callback - INFO - Starting async job submit for node 69b2488fb0f5558b5d7cdb00 2026-03-14 05:01:18,782 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 05:01:18,801 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b2488fb0f5558b5d7cdb00 HTTP/1.1" 200 None 2026-03-14 05:01:18,802 - lava_callback - DEBUG - Processing node 69b2488fb0f5558b5d7cdb00: baseline-arm-baylibre 2026-03-14 05:01:18,802 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b2488fb0f5558b5d7cdb00 2026-03-14 05:01:18,803 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 05:01:18,827 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b2488fb0f5558b5d7cdb00 HTTP/1.1" 200 None 2026-03-14 05:01:18,828 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 05:01:18,854 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aef424ce46d8ec186ab80e HTTP/1.1" 200 None 2026-03-14 05:01:18,855 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 05:01:18,877 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b2488fb0f5558b5d7cdb00 HTTP/1.1" 200 None 2026-03-14 05:01:18,888 - lava_callback - ERROR - Error processing callback for node 69b2488fb0f5558b5d7cdb00: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:40630 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40992 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41002 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46822 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45164 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38388 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46828 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:46834 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53660 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45070 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45086 - "GET / HTTP/1.0" 200 OK 2026-03-14 05:02:36,852 - lava_callback - INFO - Received callback for node 69b248ddb0f5558b5d7cdb16 INFO: 172.21.0.1:45102 - "POST /node/69b248ddb0f5558b5d7cdb16 HTTP/1.0" 202 Accepted 2026-03-14 05:02:36,857 - lava_callback - INFO - Starting async job submit for node 69b248ddb0f5558b5d7cdb16 2026-03-14 05:02:36,858 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 05:02:36,884 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b248ddb0f5558b5d7cdb16 HTTP/1.1" 200 None 2026-03-14 05:02:36,885 - lava_callback - DEBUG - Processing node 69b248ddb0f5558b5d7cdb16: baseline-arm-clabbe 2026-03-14 05:02:36,885 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b248ddb0f5558b5d7cdb16 2026-03-14 05:02:36,886 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 05:02:36,909 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b248ddb0f5558b5d7cdb16 HTTP/1.1" 200 None 2026-03-14 05:02:36,911 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 05:02:36,924 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aef424ce46d8ec186ab80e HTTP/1.1" 200 None 2026-03-14 05:02:36,925 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 05:02:36,964 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b248ddb0f5558b5d7cdb16 HTTP/1.1" 200 None 2026-03-14 05:02:36,966 - lava_callback - ERROR - Error processing callback for node 69b248ddb0f5558b5d7cdb16: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:34408 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37286 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44284 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53588 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:53590 - "GET / HTTP/1.0" 200 OK 2026-03-14 05:03:16,814 - lava_callback - INFO - Received callback for node 69b24902b0f5558b5d7cdb26 INFO: 172.21.0.1:53598 - "POST /node/69b24902b0f5558b5d7cdb26 HTTP/1.0" 202 Accepted 2026-03-14 05:03:16,820 - lava_callback - INFO - Starting async job submit for node 69b24902b0f5558b5d7cdb26 2026-03-14 05:03:16,821 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 05:03:16,837 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b24902b0f5558b5d7cdb26 HTTP/1.1" 200 None 2026-03-14 05:03:16,838 - lava_callback - DEBUG - Processing node 69b24902b0f5558b5d7cdb26: baseline-arm-clabbe 2026-03-14 05:03:16,838 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b24902b0f5558b5d7cdb26 2026-03-14 05:03:16,839 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 05:03:16,874 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b24902b0f5558b5d7cdb26 HTTP/1.1" 200 None 2026-03-14 05:03:16,875 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 05:03:16,889 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aef424ce46d8ec186ab80e HTTP/1.1" 200 None 2026-03-14 05:03:16,890 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 05:03:16,916 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b24902b0f5558b5d7cdb26 HTTP/1.1" 200 None 2026-03-14 05:03:16,918 - lava_callback - ERROR - Error processing callback for node 69b24902b0f5558b5d7cdb26: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:34732 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56196 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56210 - "GET / HTTP/1.0" 200 OK 2026-03-14 05:03:36,899 - lava_callback - INFO - Received callback for node 69b24926b0f5558b5d7cdb36 INFO: 172.21.0.1:56226 - "POST /node/69b24926b0f5558b5d7cdb36 HTTP/1.0" 202 Accepted 2026-03-14 05:03:36,904 - lava_callback - INFO - Starting async job submit for node 69b24926b0f5558b5d7cdb36 2026-03-14 05:03:36,905 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 05:03:36,940 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b24926b0f5558b5d7cdb36 HTTP/1.1" 200 None 2026-03-14 05:03:36,941 - lava_callback - DEBUG - Processing node 69b24926b0f5558b5d7cdb36: baseline-arm-clabbe 2026-03-14 05:03:36,941 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b24926b0f5558b5d7cdb36 2026-03-14 05:03:36,942 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 05:03:36,978 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b24926b0f5558b5d7cdb36 HTTP/1.1" 200 None 2026-03-14 05:03:36,979 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 05:03:37,015 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aef424ce46d8ec186ab80e HTTP/1.1" 200 None 2026-03-14 05:03:37,017 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 05:03:37,039 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b24926b0f5558b5d7cdb36 HTTP/1.1" 200 None 2026-03-14 05:03:37,041 - lava_callback - ERROR - Error processing callback for node 69b24926b0f5558b5d7cdb36: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:49120 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53200 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54254 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55866 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:55874 - "GET / HTTP/1.0" 200 OK 2026-03-14 05:04:16,847 - lava_callback - INFO - Received callback for node 69b2494bb0f5558b5d7cdb4c INFO: 172.21.0.1:55876 - "POST /node/69b2494bb0f5558b5d7cdb4c HTTP/1.0" 202 Accepted 2026-03-14 05:04:16,853 - lava_callback - INFO - Starting async job submit for node 69b2494bb0f5558b5d7cdb4c 2026-03-14 05:04:16,853 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 05:04:16,870 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b2494bb0f5558b5d7cdb4c HTTP/1.1" 200 None 2026-03-14 05:04:16,871 - lava_callback - DEBUG - Processing node 69b2494bb0f5558b5d7cdb4c: baseline-arm-clabbe 2026-03-14 05:04:16,871 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b2494bb0f5558b5d7cdb4c 2026-03-14 05:04:16,872 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 05:04:16,893 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b2494bb0f5558b5d7cdb4c HTTP/1.1" 200 None 2026-03-14 05:04:16,894 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 05:04:16,932 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aef424ce46d8ec186ab80e HTTP/1.1" 200 None 2026-03-14 05:04:16,934 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 05:04:16,975 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b2494bb0f5558b5d7cdb4c HTTP/1.1" 200 None 2026-03-14 05:04:16,981 - lava_callback - ERROR - Error processing callback for node 69b2494bb0f5558b5d7cdb4c: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:59822 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38220 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38234 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48076 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54748 - "GET / HTTP/1.0" 200 OK 2026-03-14 05:04:56,914 - lava_callback - INFO - Received callback for node 69b24970b0f5558b5d7cdb63 INFO: 172.21.0.1:54754 - "POST /node/69b24970b0f5558b5d7cdb63 HTTP/1.0" 202 Accepted 2026-03-14 05:04:56,919 - lava_callback - INFO - Starting async job submit for node 69b24970b0f5558b5d7cdb63 2026-03-14 05:04:56,920 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 05:04:56,936 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b24970b0f5558b5d7cdb63 HTTP/1.1" 200 None 2026-03-14 05:04:56,937 - lava_callback - DEBUG - Processing node 69b24970b0f5558b5d7cdb63: baseline-arm-clabbe 2026-03-14 05:04:56,937 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b24970b0f5558b5d7cdb63 2026-03-14 05:04:56,938 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 05:04:56,969 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b24970b0f5558b5d7cdb63 HTTP/1.1" 200 None 2026-03-14 05:04:56,970 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 05:04:56,989 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aef424ce46d8ec186ab80e HTTP/1.1" 200 None 2026-03-14 05:04:56,990 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 05:04:57,023 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b24970b0f5558b5d7cdb63 HTTP/1.1" 200 None 2026-03-14 05:04:57,025 - lava_callback - ERROR - Error processing callback for node 69b24970b0f5558b5d7cdb63: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:44664 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37646 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:37662 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59600 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58504 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58508 - "GET / HTTP/1.0" 200 OK 2026-03-14 05:05:36,999 - lava_callback - INFO - Received callback for node 69b24996b0f5558b5d7cdb6a INFO: 172.21.0.1:58520 - "POST /node/69b24996b0f5558b5d7cdb6a HTTP/1.0" 202 Accepted 2026-03-14 05:05:37,004 - lava_callback - INFO - Starting async job submit for node 69b24996b0f5558b5d7cdb6a 2026-03-14 05:05:37,005 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 05:05:37,020 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b24996b0f5558b5d7cdb6a HTTP/1.1" 200 None 2026-03-14 05:05:37,021 - lava_callback - DEBUG - Processing node 69b24996b0f5558b5d7cdb6a: baseline-arm-clabbe 2026-03-14 05:05:37,021 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b24996b0f5558b5d7cdb6a 2026-03-14 05:05:37,022 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 05:05:37,035 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b24996b0f5558b5d7cdb6a HTTP/1.1" 200 None 2026-03-14 05:05:37,036 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 05:05:37,049 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aef424ce46d8ec186ab80e HTTP/1.1" 200 None 2026-03-14 05:05:37,051 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 05:05:37,079 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b24996b0f5558b5d7cdb6a HTTP/1.1" 200 None 2026-03-14 05:05:37,084 - lava_callback - ERROR - Error processing callback for node 69b24996b0f5558b5d7cdb6a: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:39840 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:32976 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56908 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40376 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:40380 - "GET / HTTP/1.0" 200 OK 2026-03-14 05:06:16,983 - lava_callback - INFO - Received callback for node 69b249bcb0f5558b5d7cdb7d INFO: 172.21.0.1:40384 - "POST /node/69b249bcb0f5558b5d7cdb7d HTTP/1.0" 202 Accepted 2026-03-14 05:06:16,988 - lava_callback - INFO - Starting async job submit for node 69b249bcb0f5558b5d7cdb7d 2026-03-14 05:06:16,989 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 05:06:17,004 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b249bcb0f5558b5d7cdb7d HTTP/1.1" 200 None 2026-03-14 05:06:17,005 - lava_callback - DEBUG - Processing node 69b249bcb0f5558b5d7cdb7d: baseline-arm-clabbe 2026-03-14 05:06:17,005 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b249bcb0f5558b5d7cdb7d 2026-03-14 05:06:17,006 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 05:06:17,022 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b249bcb0f5558b5d7cdb7d HTTP/1.1" 200 None 2026-03-14 05:06:17,023 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 05:06:17,058 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aef424ce46d8ec186ab80e HTTP/1.1" 200 None 2026-03-14 05:06:17,059 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 05:06:17,086 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b249bcb0f5558b5d7cdb7d HTTP/1.1" 200 None 2026-03-14 05:06:17,087 - lava_callback - ERROR - Error processing callback for node 69b249bcb0f5558b5d7cdb7d: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:35148 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52396 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52406 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45086 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49880 - "GET / HTTP/1.0" 200 OK 2026-03-14 05:06:57,010 - lava_callback - INFO - Received callback for node 69b249e2b0f5558b5d7cdb8f INFO: 172.21.0.1:49892 - "POST /node/69b249e2b0f5558b5d7cdb8f HTTP/1.0" 202 Accepted 2026-03-14 05:06:57,015 - lava_callback - INFO - Starting async job submit for node 69b249e2b0f5558b5d7cdb8f 2026-03-14 05:06:57,016 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 05:06:57,031 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b249e2b0f5558b5d7cdb8f HTTP/1.1" 200 None 2026-03-14 05:06:57,032 - lava_callback - DEBUG - Processing node 69b249e2b0f5558b5d7cdb8f: baseline-arm-clabbe 2026-03-14 05:06:57,032 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b249e2b0f5558b5d7cdb8f 2026-03-14 05:06:57,033 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 05:06:57,046 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b249e2b0f5558b5d7cdb8f HTTP/1.1" 200 None 2026-03-14 05:06:57,048 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 05:06:57,061 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aef424ce46d8ec186ab80e HTTP/1.1" 200 None 2026-03-14 05:06:57,063 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 05:06:57,085 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b249e2b0f5558b5d7cdb8f HTTP/1.1" 200 None 2026-03-14 05:06:57,087 - lava_callback - ERROR - Error processing callback for node 69b249e2b0f5558b5d7cdb8f: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:45578 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47836 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:47846 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50956 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59708 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59714 - "GET / HTTP/1.0" 200 OK 2026-03-14 05:07:37,075 - lava_callback - INFO - Received callback for node 69b24a09b0f5558b5d7cdba3 INFO: 172.21.0.1:59724 - "POST /node/69b24a09b0f5558b5d7cdba3 HTTP/1.0" 202 Accepted 2026-03-14 05:07:37,081 - lava_callback - INFO - Starting async job submit for node 69b24a09b0f5558b5d7cdba3 2026-03-14 05:07:37,082 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 05:07:37,096 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b24a09b0f5558b5d7cdba3 HTTP/1.1" 200 None 2026-03-14 05:07:37,097 - lava_callback - DEBUG - Processing node 69b24a09b0f5558b5d7cdba3: baseline-arm-clabbe 2026-03-14 05:07:37,097 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b24a09b0f5558b5d7cdba3 2026-03-14 05:07:37,098 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 05:07:37,115 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b24a09b0f5558b5d7cdba3 HTTP/1.1" 200 None 2026-03-14 05:07:37,116 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 05:07:37,131 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aef424ce46d8ec186ab80e HTTP/1.1" 200 None 2026-03-14 05:07:37,133 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 05:07:37,153 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b24a09b0f5558b5d7cdba3 HTTP/1.1" 200 None 2026-03-14 05:07:37,172 - lava_callback - ERROR - Error processing callback for node 69b24a09b0f5558b5d7cdba3: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:45496 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51120 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37228 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49384 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:49396 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43728 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46844 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46850 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:32940 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59532 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39906 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46546 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:46552 - "GET / HTTP/1.0" 200 OK 2026-03-14 05:09:17,140 - lava_callback - INFO - Received callback for node 69b24a79b0f5558b5d7cdbca INFO: 172.21.0.1:46562 - "POST /node/69b24a79b0f5558b5d7cdbca HTTP/1.0" 202 Accepted 2026-03-14 05:09:17,145 - lava_callback - INFO - Starting async job submit for node 69b24a79b0f5558b5d7cdbca 2026-03-14 05:09:17,146 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 05:09:17,181 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b24a79b0f5558b5d7cdbca HTTP/1.1" 200 None 2026-03-14 05:09:17,182 - lava_callback - DEBUG - Processing node 69b24a79b0f5558b5d7cdbca: baseline-arm-clabbe 2026-03-14 05:09:17,182 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b24a79b0f5558b5d7cdbca 2026-03-14 05:09:17,183 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 05:09:17,196 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b24a79b0f5558b5d7cdbca HTTP/1.1" 200 None 2026-03-14 05:09:17,198 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 05:09:17,213 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aef424ce46d8ec186ab80e HTTP/1.1" 200 None 2026-03-14 05:09:17,215 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 05:09:17,242 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b24a79b0f5558b5d7cdbca HTTP/1.1" 200 None 2026-03-14 05:09:17,250 - lava_callback - ERROR - Error processing callback for node 69b24a79b0f5558b5d7cdbca: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:33812 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43742 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43746 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34668 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34018 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40482 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45538 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:45542 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45714 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60242 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60250 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51478 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55116 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49070 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47850 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:47856 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40366 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34826 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34842 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46452 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41274 - "GET / HTTP/1.0" 200 OK 2026-03-14 05:11:57,256 - lava_callback - INFO - Received callback for node 69b24b0ab0f5558b5d7cdc01 INFO: 172.21.0.1:41280 - "POST /node/69b24b0ab0f5558b5d7cdc01 HTTP/1.0" 202 Accepted 2026-03-14 05:11:57,261 - lava_callback - INFO - Starting async job submit for node 69b24b0ab0f5558b5d7cdc01 2026-03-14 05:11:57,262 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 05:11:57,277 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b24b0ab0f5558b5d7cdc01 HTTP/1.1" 200 None 2026-03-14 05:11:57,278 - lava_callback - DEBUG - Processing node 69b24b0ab0f5558b5d7cdc01: baseline-arm-clabbe 2026-03-14 05:11:57,278 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b24b0ab0f5558b5d7cdc01 2026-03-14 05:11:57,279 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 05:11:57,291 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b24b0ab0f5558b5d7cdc01 HTTP/1.1" 200 None 2026-03-14 05:11:57,292 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 05:11:57,306 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aef424ce46d8ec186ab80e HTTP/1.1" 200 None 2026-03-14 05:11:57,307 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 05:11:57,359 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b24b0ab0f5558b5d7cdc01 HTTP/1.1" 200 None 2026-03-14 05:11:57,360 - lava_callback - ERROR - Error processing callback for node 69b24b0ab0f5558b5d7cdc01: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:48616 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40018 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:40026 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37680 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47696 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47702 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:32996 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49622 - "GET / HTTP/1.0" 200 OK 2026-03-14 05:12:57,299 - lava_callback - INFO - Received callback for node 69b24b51b0f5558b5d7cdc1e INFO: 172.21.0.1:49638 - "POST /node/69b24b51b0f5558b5d7cdc1e HTTP/1.0" 202 Accepted 2026-03-14 05:12:57,305 - lava_callback - INFO - Starting async job submit for node 69b24b51b0f5558b5d7cdc1e 2026-03-14 05:12:57,305 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 05:12:57,320 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b24b51b0f5558b5d7cdc1e HTTP/1.1" 200 None 2026-03-14 05:12:57,321 - lava_callback - DEBUG - Processing node 69b24b51b0f5558b5d7cdc1e: baseline-arm-clabbe 2026-03-14 05:12:57,321 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b24b51b0f5558b5d7cdc1e 2026-03-14 05:12:57,322 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 05:12:57,335 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b24b51b0f5558b5d7cdc1e HTTP/1.1" 200 None 2026-03-14 05:12:57,336 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 05:12:57,352 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aef424ce46d8ec186ab80e HTTP/1.1" 200 None 2026-03-14 05:12:57,354 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 05:12:57,374 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b24b51b0f5558b5d7cdc1e HTTP/1.1" 200 None 2026-03-14 05:12:57,380 - lava_callback - ERROR - Error processing callback for node 69b24b51b0f5558b5d7cdc1e: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:38076 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52770 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:52786 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36792 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56594 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56606 - "GET / HTTP/1.0" 200 OK 2026-03-14 05:13:37,280 - lava_callback - INFO - Received callback for node 69b24b76b0f5558b5d7cdc27 INFO: 172.21.0.1:56620 - "POST /node/69b24b76b0f5558b5d7cdc27 HTTP/1.0" 202 Accepted 2026-03-14 05:13:37,286 - lava_callback - INFO - Starting async job submit for node 69b24b76b0f5558b5d7cdc27 2026-03-14 05:13:37,287 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 05:13:37,301 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b24b76b0f5558b5d7cdc27 HTTP/1.1" 200 None 2026-03-14 05:13:37,302 - lava_callback - DEBUG - Processing node 69b24b76b0f5558b5d7cdc27: baseline-arm-clabbe 2026-03-14 05:13:37,302 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b24b76b0f5558b5d7cdc27 2026-03-14 05:13:37,303 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 05:13:37,322 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b24b76b0f5558b5d7cdc27 HTTP/1.1" 200 None 2026-03-14 05:13:37,323 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 05:13:37,336 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aef424ce46d8ec186ab80e HTTP/1.1" 200 None 2026-03-14 05:13:37,338 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 05:13:37,370 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b24b76b0f5558b5d7cdc27 HTTP/1.1" 200 None 2026-03-14 05:13:37,377 - lava_callback - ERROR - Error processing callback for node 69b24b76b0f5558b5d7cdc27: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:58790 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40656 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49148 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43784 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:43786 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43012 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59642 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59646 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39768 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46916 - "GET / HTTP/1.0" 200 OK 2026-03-14 05:14:57,387 - lava_callback - INFO - Received callback for node 69b24bc9b0f5558b5d7cdc43 INFO: 172.21.0.1:46918 - "POST /node/69b24bc9b0f5558b5d7cdc43 HTTP/1.0" 202 Accepted 2026-03-14 05:14:57,393 - lava_callback - INFO - Starting async job submit for node 69b24bc9b0f5558b5d7cdc43 2026-03-14 05:14:57,394 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 05:14:57,414 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b24bc9b0f5558b5d7cdc43 HTTP/1.1" 200 None 2026-03-14 05:14:57,415 - lava_callback - DEBUG - Processing node 69b24bc9b0f5558b5d7cdc43: baseline-arm-clabbe 2026-03-14 05:14:57,415 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b24bc9b0f5558b5d7cdc43 2026-03-14 05:14:57,416 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 05:14:57,429 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b24bc9b0f5558b5d7cdc43 HTTP/1.1" 200 None 2026-03-14 05:14:57,431 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 05:14:57,448 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aef424ce46d8ec186ab80e HTTP/1.1" 200 None 2026-03-14 05:14:57,449 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 05:14:57,496 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b24bc9b0f5558b5d7cdc43 HTTP/1.1" 200 None 2026-03-14 05:14:57,501 - lava_callback - ERROR - Error processing callback for node 69b24bc9b0f5558b5d7cdc43: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:49452 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57406 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:57412 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57436 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47774 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47790 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51618 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47726 - "GET / HTTP/1.0" 200 OK 2026-03-14 05:15:57,406 - lava_callback - INFO - Received callback for node 69b24c05b0f5558b5d7cdc57 INFO: 172.21.0.1:47730 - "POST /node/69b24c05b0f5558b5d7cdc57 HTTP/1.0" 202 Accepted 2026-03-14 05:15:57,411 - lava_callback - INFO - Starting async job submit for node 69b24c05b0f5558b5d7cdc57 2026-03-14 05:15:57,412 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 05:15:57,431 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b24c05b0f5558b5d7cdc57 HTTP/1.1" 200 None 2026-03-14 05:15:57,432 - lava_callback - DEBUG - Processing node 69b24c05b0f5558b5d7cdc57: baseline-arm-clabbe 2026-03-14 05:15:57,432 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b24c05b0f5558b5d7cdc57 2026-03-14 05:15:57,433 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 05:15:57,446 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b24c05b0f5558b5d7cdc57 HTTP/1.1" 200 None 2026-03-14 05:15:57,448 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 05:15:57,460 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aef424ce46d8ec186ab80e HTTP/1.1" 200 None 2026-03-14 05:15:57,462 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 05:15:57,487 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b24c05b0f5558b5d7cdc57 HTTP/1.1" 200 None 2026-03-14 05:15:57,489 - lava_callback - ERROR - Error processing callback for node 69b24c05b0f5558b5d7cdc57: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:53482 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38810 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:38818 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50280 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58256 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58258 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48634 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60846 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42602 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60938 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:60948 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58338 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50204 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50220 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55760 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60602 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55418 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33814 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:33828 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41890 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44492 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44502 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44358 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48924 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33726 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58710 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:58712 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43074 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53296 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53310 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53856 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58996 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50954 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58066 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:58074 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43538 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50386 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50390 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54418 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46246 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33706 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33216 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:33220 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34098 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47090 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47100 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55330 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35196 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43436 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55730 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:55744 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34136 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57166 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57176 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60290 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48726 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53746 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55484 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:55486 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39034 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44384 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44392 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47502 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59034 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60444 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54602 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:54614 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42604 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33372 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33388 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45852 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37722 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50904 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53822 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:53826 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56362 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55368 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55382 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56412 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33694 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39944 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46674 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:46686 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51904 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38016 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38024 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58170 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42582 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46296 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48334 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:48338 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42728 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50430 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50440 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55832 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54080 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40140 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57350 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:57366 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49768 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53562 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53570 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44456 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:32810 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39388 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49252 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:49262 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47468 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35720 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35734 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54496 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37662 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35102 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39480 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:39492 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54476 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46630 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46640 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48304 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49558 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51426 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43288 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:43298 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47022 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53110 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53114 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51270 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53414 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45090 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33900 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:33916 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51230 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51092 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51098 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55436 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54990 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36968 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50304 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:50312 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46422 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42088 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42094 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55702 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50756 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51378 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58306 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:58322 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49634 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43436 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43444 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37122 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56994 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58236 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40578 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:40580 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38638 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37296 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37300 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49714 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36832 - "GET / HTTP/1.0" 200 OK 2026-03-14 05:36:00,847 - lava_callback - INFO - Received callback for node 69b250bdb0f5558b5d7cdc8a INFO: 172.21.0.1:43950 - "POST /node/69b250bdb0f5558b5d7cdc8a HTTP/1.0" 202 Accepted 2026-03-14 05:36:00,852 - lava_callback - INFO - Starting async job submit for node 69b250bdb0f5558b5d7cdc8a 2026-03-14 05:36:00,853 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 05:36:00,891 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b250bdb0f5558b5d7cdc8a HTTP/1.1" 200 None 2026-03-14 05:36:00,892 - lava_callback - DEBUG - Processing node 69b250bdb0f5558b5d7cdc8a: baseline-arm64-baylibre 2026-03-14 05:36:00,892 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b250bdb0f5558b5d7cdc8a 2026-03-14 05:36:00,893 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 05:36:00,925 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b250bdb0f5558b5d7cdc8a HTTP/1.1" 200 None 2026-03-14 05:36:00,926 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 05:36:00,952 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aef431ce46d8ec186ab81d HTTP/1.1" 200 None 2026-03-14 05:36:00,954 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 05:36:00,979 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b250bdb0f5558b5d7cdc8a HTTP/1.1" 200 None 2026-03-14 05:36:00,980 - lava_callback - ERROR - Error processing callback for node 69b250bdb0f5558b5d7cdc8a: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:43962 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56928 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:56942 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56418 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44120 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44122 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53644 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58106 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50142 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40622 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:40634 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48088 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50998 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51002 - "GET / HTTP/1.0" 200 OK 2026-03-14 05:37:40,873 - lava_callback - INFO - Received callback for node 69b25115b0f5558b5d7cdc99 INFO: 172.21.0.1:46952 - "POST /node/69b25115b0f5558b5d7cdc99 HTTP/1.0" 202 Accepted 2026-03-14 05:37:40,879 - lava_callback - INFO - Starting async job submit for node 69b25115b0f5558b5d7cdc99 2026-03-14 05:37:40,880 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 05:37:40,906 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b25115b0f5558b5d7cdc99 HTTP/1.1" 200 None 2026-03-14 05:37:40,907 - lava_callback - DEBUG - Processing node 69b25115b0f5558b5d7cdc99: baseline-arm64-baylibre 2026-03-14 05:37:40,908 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b25115b0f5558b5d7cdc99 2026-03-14 05:37:40,908 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 05:37:40,922 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b25115b0f5558b5d7cdc99 HTTP/1.1" 200 None 2026-03-14 05:37:40,923 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 05:37:40,945 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aef431ce46d8ec186ab81d HTTP/1.1" 200 None 2026-03-14 05:37:40,947 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 05:37:40,977 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b25115b0f5558b5d7cdc99 HTTP/1.1" 200 None 2026-03-14 05:37:40,979 - lava_callback - ERROR - Error processing callback for node 69b25115b0f5558b5d7cdc99: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:46956 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57642 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51136 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44974 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:44990 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38226 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47162 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47174 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48052 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33688 - "GET / HTTP/1.0" 200 OK 2026-03-14 05:39:00,950 - lava_callback - INFO - Received callback for node 69b2516cb0f5558b5d7cdca6 INFO: 172.21.0.1:35230 - "POST /node/69b2516cb0f5558b5d7cdca6 HTTP/1.0" 202 Accepted 2026-03-14 05:39:00,956 - lava_callback - INFO - Starting async job submit for node 69b2516cb0f5558b5d7cdca6 2026-03-14 05:39:00,956 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 05:39:00,980 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b2516cb0f5558b5d7cdca6 HTTP/1.1" 200 None 2026-03-14 05:39:00,981 - lava_callback - DEBUG - Processing node 69b2516cb0f5558b5d7cdca6: baseline-arm64-baylibre 2026-03-14 05:39:00,981 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b2516cb0f5558b5d7cdca6 2026-03-14 05:39:00,982 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 05:39:01,024 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b2516cb0f5558b5d7cdca6 HTTP/1.1" 200 None 2026-03-14 05:39:01,026 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 05:39:01,039 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aef431ce46d8ec186ab81d HTTP/1.1" 200 None 2026-03-14 05:39:01,040 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 05:39:01,085 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b2516cb0f5558b5d7cdca6 HTTP/1.1" 200 None 2026-03-14 05:39:01,086 - lava_callback - ERROR - Error processing callback for node 69b2516cb0f5558b5d7cdca6: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:35234 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53584 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:53600 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46202 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52484 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52500 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53620 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47620 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47450 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41784 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:41798 - "GET / HTTP/1.0" 200 OK 2026-03-14 05:40:20,983 - lava_callback - INFO - Received callback for node 69b251c0b0f5558b5d7cdcb0 INFO: 172.21.0.1:35002 - "POST /node/69b251c0b0f5558b5d7cdcb0 HTTP/1.0" 202 Accepted 2026-03-14 05:40:20,988 - lava_callback - INFO - Starting async job submit for node 69b251c0b0f5558b5d7cdcb0 2026-03-14 05:40:20,989 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 05:40:21,021 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b251c0b0f5558b5d7cdcb0 HTTP/1.1" 200 None 2026-03-14 05:40:21,021 - lava_callback - DEBUG - Processing node 69b251c0b0f5558b5d7cdcb0: baseline-arm64-baylibre 2026-03-14 05:40:21,022 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b251c0b0f5558b5d7cdcb0 2026-03-14 05:40:21,022 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 05:40:21,043 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b251c0b0f5558b5d7cdcb0 HTTP/1.1" 200 None 2026-03-14 05:40:21,045 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 05:40:21,079 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aef431ce46d8ec186ab81d HTTP/1.1" 200 None 2026-03-14 05:40:21,081 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 05:40:21,117 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b251c0b0f5558b5d7cdcb0 HTTP/1.1" 200 None 2026-03-14 05:40:21,118 - lava_callback - ERROR - Error processing callback for node 69b251c0b0f5558b5d7cdcb0: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:35018 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33082 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33086 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46508 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56416 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46808 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35492 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:35502 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45308 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55306 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55318 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50206 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59514 - "GET / HTTP/1.0" 200 OK 2026-03-14 05:42:01,137 - lava_callback - INFO - Received callback for node 69b25217b0f5558b5d7cdcbd INFO: 172.21.0.1:43278 - "POST /node/69b25217b0f5558b5d7cdcbd HTTP/1.0" 202 Accepted 2026-03-14 05:42:01,142 - lava_callback - INFO - Starting async job submit for node 69b25217b0f5558b5d7cdcbd 2026-03-14 05:42:01,143 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 05:42:01,158 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b25217b0f5558b5d7cdcbd HTTP/1.1" 200 None 2026-03-14 05:42:01,159 - lava_callback - DEBUG - Processing node 69b25217b0f5558b5d7cdcbd: baseline-arm64-baylibre 2026-03-14 05:42:01,159 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b25217b0f5558b5d7cdcbd 2026-03-14 05:42:01,160 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 05:42:01,172 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b25217b0f5558b5d7cdcbd HTTP/1.1" 200 None 2026-03-14 05:42:01,173 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 05:42:01,198 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aef431ce46d8ec186ab81d HTTP/1.1" 200 None 2026-03-14 05:42:01,200 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 05:42:01,221 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b25217b0f5558b5d7cdcbd HTTP/1.1" 200 None 2026-03-14 05:42:01,222 - lava_callback - ERROR - Error processing callback for node 69b25217b0f5558b5d7cdcbd: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:43292 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39838 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:39846 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53092 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35718 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35728 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50666 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37312 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37176 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43598 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:43606 - "GET / HTTP/1.0" 200 OK 2026-03-14 05:43:21,152 - lava_callback - INFO - Received callback for node 69b25268b0f5558b5d7cdccb INFO: 172.21.0.1:37714 - "POST /node/69b25268b0f5558b5d7cdccb HTTP/1.0" 202 Accepted 2026-03-14 05:43:21,157 - lava_callback - INFO - Starting async job submit for node 69b25268b0f5558b5d7cdccb 2026-03-14 05:43:21,158 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 05:43:21,191 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b25268b0f5558b5d7cdccb HTTP/1.1" 200 None 2026-03-14 05:43:21,192 - lava_callback - DEBUG - Processing node 69b25268b0f5558b5d7cdccb: baseline-arm64-baylibre 2026-03-14 05:43:21,192 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b25268b0f5558b5d7cdccb 2026-03-14 05:43:21,193 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 05:43:21,218 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b25268b0f5558b5d7cdccb HTTP/1.1" 200 None 2026-03-14 05:43:21,220 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 05:43:21,232 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aef431ce46d8ec186ab81d HTTP/1.1" 200 None 2026-03-14 05:43:21,234 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 05:43:21,262 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b25268b0f5558b5d7cdccb HTTP/1.1" 200 None 2026-03-14 05:43:21,263 - lava_callback - ERROR - Error processing callback for node 69b25268b0f5558b5d7cdccb: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:37726 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37606 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37614 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55090 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51688 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58994 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36128 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:36134 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57276 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44224 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44236 - "GET / HTTP/1.0" 200 OK 2026-03-14 05:44:41,274 - lava_callback - INFO - Received callback for node 69b252b8b0f5558b5d7cdcdb INFO: 172.21.0.1:46270 - "POST /node/69b252b8b0f5558b5d7cdcdb HTTP/1.0" 202 Accepted 2026-03-14 05:44:41,280 - lava_callback - INFO - Starting async job submit for node 69b252b8b0f5558b5d7cdcdb 2026-03-14 05:44:41,280 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 05:44:41,325 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b252b8b0f5558b5d7cdcdb HTTP/1.1" 200 None 2026-03-14 05:44:41,326 - lava_callback - DEBUG - Processing node 69b252b8b0f5558b5d7cdcdb: baseline-arm64-baylibre 2026-03-14 05:44:41,326 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b252b8b0f5558b5d7cdcdb 2026-03-14 05:44:41,327 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 05:44:41,348 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b252b8b0f5558b5d7cdcdb HTTP/1.1" 200 None 2026-03-14 05:44:41,350 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 05:44:41,363 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aef431ce46d8ec186ab81d HTTP/1.1" 200 None 2026-03-14 05:44:41,364 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 05:44:41,384 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b252b8b0f5558b5d7cdcdb HTTP/1.1" 200 None 2026-03-14 05:44:41,385 - lava_callback - ERROR - Error processing callback for node 69b252b8b0f5558b5d7cdcdb: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:46282 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49580 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50290 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35684 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:35700 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49470 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51134 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51150 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38366 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36010 - "GET / HTTP/1.0" 200 OK 2026-03-14 05:46:01,234 - lava_callback - INFO - Received callback for node 69b25309b0f5558b5d7cdce6 INFO: 172.21.0.1:40914 - "POST /node/69b25309b0f5558b5d7cdce6 HTTP/1.0" 202 Accepted 2026-03-14 05:46:01,239 - lava_callback - INFO - Starting async job submit for node 69b25309b0f5558b5d7cdce6 2026-03-14 05:46:01,240 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 05:46:01,278 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b25309b0f5558b5d7cdce6 HTTP/1.1" 200 None 2026-03-14 05:46:01,279 - lava_callback - DEBUG - Processing node 69b25309b0f5558b5d7cdce6: baseline-arm64-baylibre 2026-03-14 05:46:01,279 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b25309b0f5558b5d7cdce6 2026-03-14 05:46:01,280 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 05:46:01,293 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b25309b0f5558b5d7cdce6 HTTP/1.1" 200 None 2026-03-14 05:46:01,294 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 05:46:01,333 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aef431ce46d8ec186ab81d HTTP/1.1" 200 None 2026-03-14 05:46:01,334 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 05:46:01,364 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b25309b0f5558b5d7cdce6 HTTP/1.1" 200 None 2026-03-14 05:46:01,365 - lava_callback - ERROR - Error processing callback for node 69b25309b0f5558b5d7cdce6: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:40930 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55742 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:55750 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38538 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41518 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41526 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59638 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35570 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43032 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33040 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:33052 - "GET / HTTP/1.0" 200 OK 2026-03-14 05:47:21,407 - lava_callback - INFO - Received callback for node 69b25354b0f5558b5d7cdcf5 INFO: 172.21.0.1:49828 - "POST /node/69b25354b0f5558b5d7cdcf5 HTTP/1.0" 202 Accepted 2026-03-14 05:47:21,412 - lava_callback - INFO - Starting async job submit for node 69b25354b0f5558b5d7cdcf5 2026-03-14 05:47:21,413 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 05:47:21,427 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b25354b0f5558b5d7cdcf5 HTTP/1.1" 200 None 2026-03-14 05:47:21,428 - lava_callback - DEBUG - Processing node 69b25354b0f5558b5d7cdcf5: baseline-arm64-baylibre 2026-03-14 05:47:21,429 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b25354b0f5558b5d7cdcf5 2026-03-14 05:47:21,429 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 05:47:21,442 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b25354b0f5558b5d7cdcf5 HTTP/1.1" 200 None 2026-03-14 05:47:21,443 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 05:47:21,474 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aef431ce46d8ec186ab81d HTTP/1.1" 200 None 2026-03-14 05:47:21,476 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 05:47:21,503 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b25354b0f5558b5d7cdcf5 HTTP/1.1" 200 None 2026-03-14 05:47:21,504 - lava_callback - ERROR - Error processing callback for node 69b25354b0f5558b5d7cdcf5: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:49838 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52550 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52558 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46716 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44158 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39770 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36736 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:36744 - "GET / HTTP/1.0" 200 OK 2026-03-14 05:48:21,343 - lava_callback - INFO - Received callback for node 69b253a2b0f5558b5d7cdd02 INFO: 172.21.0.1:44682 - "POST /node/69b253a2b0f5558b5d7cdd02 HTTP/1.0" 202 Accepted 2026-03-14 05:48:21,348 - lava_callback - INFO - Starting async job submit for node 69b253a2b0f5558b5d7cdd02 2026-03-14 05:48:21,349 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 05:48:21,372 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b253a2b0f5558b5d7cdd02 HTTP/1.1" 200 None 2026-03-14 05:48:21,373 - lava_callback - DEBUG - Processing node 69b253a2b0f5558b5d7cdd02: baseline-arm64-baylibre 2026-03-14 05:48:21,373 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b253a2b0f5558b5d7cdd02 2026-03-14 05:48:21,374 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 05:48:21,399 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b253a2b0f5558b5d7cdd02 HTTP/1.1" 200 None 2026-03-14 05:48:21,401 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 05:48:21,442 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aef431ce46d8ec186ab81d HTTP/1.1" 200 None 2026-03-14 05:48:21,443 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 05:48:21,466 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b253a2b0f5558b5d7cdd02 HTTP/1.1" 200 None 2026-03-14 05:48:21,471 - lava_callback - ERROR - Error processing callback for node 69b253a2b0f5558b5d7cdd02: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:44686 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38060 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38068 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38110 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39256 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39812 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46806 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:46816 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39836 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33374 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33384 - "GET / HTTP/1.0" 200 OK 2026-03-14 05:49:41,521 - lava_callback - INFO - Received callback for node 69b253efb0f5558b5d7cdd13 INFO: 172.21.0.1:44088 - "POST /node/69b253efb0f5558b5d7cdd13 HTTP/1.0" 202 Accepted 2026-03-14 05:49:41,526 - lava_callback - INFO - Starting async job submit for node 69b253efb0f5558b5d7cdd13 2026-03-14 05:49:41,527 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 05:49:41,542 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b253efb0f5558b5d7cdd13 HTTP/1.1" 200 None 2026-03-14 05:49:41,543 - lava_callback - DEBUG - Processing node 69b253efb0f5558b5d7cdd13: baseline-arm64-baylibre 2026-03-14 05:49:41,543 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b253efb0f5558b5d7cdd13 2026-03-14 05:49:41,543 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 05:49:41,565 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b253efb0f5558b5d7cdd13 HTTP/1.1" 200 None 2026-03-14 05:49:41,567 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 05:49:41,584 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aef431ce46d8ec186ab81d HTTP/1.1" 200 None 2026-03-14 05:49:41,585 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 05:49:41,610 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b253efb0f5558b5d7cdd13 HTTP/1.1" 200 None 2026-03-14 05:49:41,611 - lava_callback - ERROR - Error processing callback for node 69b253efb0f5558b5d7cdd13: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:44096 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54274 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45948 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41652 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:41660 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51840 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46764 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46776 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43906 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52812 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56702 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44184 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:44198 - "GET / HTTP/1.0" 200 OK 2026-03-14 05:51:18,936 - lava_callback - INFO - Received callback for node 69b25443b0f5558b5d7cdd27 INFO: 172.21.0.1:44210 - "POST /node/69b25443b0f5558b5d7cdd27 HTTP/1.0" 202 Accepted 2026-03-14 05:51:18,941 - lava_callback - INFO - Starting async job submit for node 69b25443b0f5558b5d7cdd27 2026-03-14 05:51:18,942 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 05:51:18,979 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b25443b0f5558b5d7cdd27 HTTP/1.1" 200 None 2026-03-14 05:51:18,979 - lava_callback - DEBUG - Processing node 69b25443b0f5558b5d7cdd27: baseline-arm64-clabbe 2026-03-14 05:51:18,980 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b25443b0f5558b5d7cdd27 2026-03-14 05:51:18,980 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 05:51:19,029 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b25443b0f5558b5d7cdd27 HTTP/1.1" 200 None 2026-03-14 05:51:19,031 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 05:51:19,044 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aef431ce46d8ec186ab81d HTTP/1.1" 200 None 2026-03-14 05:51:19,045 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 05:51:19,067 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b25443b0f5558b5d7cdd27 HTTP/1.1" 200 None 2026-03-14 05:51:19,069 - lava_callback - ERROR - Error processing callback for node 69b25443b0f5558b5d7cdd27: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:58452 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53924 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53928 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40910 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56250 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59590 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42300 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:42306 - "GET / HTTP/1.0" 200 OK 2026-03-14 05:52:18,943 - lava_callback - INFO - Received callback for node 69b25490b0f5558b5d7cdd36 INFO: 172.21.0.1:42318 - "POST /node/69b25490b0f5558b5d7cdd36 HTTP/1.0" 202 Accepted 2026-03-14 05:52:18,949 - lava_callback - INFO - Starting async job submit for node 69b25490b0f5558b5d7cdd36 2026-03-14 05:52:18,950 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 05:52:18,974 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b25490b0f5558b5d7cdd36 HTTP/1.1" 200 None 2026-03-14 05:52:18,975 - lava_callback - DEBUG - Processing node 69b25490b0f5558b5d7cdd36: baseline-arm64-clabbe 2026-03-14 05:52:18,975 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b25490b0f5558b5d7cdd36 2026-03-14 05:52:18,976 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 05:52:18,995 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b25490b0f5558b5d7cdd36 HTTP/1.1" 200 None 2026-03-14 05:52:18,996 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 05:52:19,009 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aef431ce46d8ec186ab81d HTTP/1.1" 200 None 2026-03-14 05:52:19,011 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 05:52:19,031 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b25490b0f5558b5d7cdd36 HTTP/1.1" 200 None 2026-03-14 05:52:19,037 - lava_callback - ERROR - Error processing callback for node 69b25490b0f5558b5d7cdd36: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:56900 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55906 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55922 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56328 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56950 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48744 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38776 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:38786 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55454 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33634 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33646 - "GET / HTTP/1.0" 200 OK 2026-03-14 05:53:41,691 - lava_callback - INFO - Received callback for node 69b254d6b0f5558b5d7cdd4b INFO: 172.21.0.1:39228 - "POST /node/69b254d6b0f5558b5d7cdd4b HTTP/1.0" 202 Accepted 2026-03-14 05:53:41,697 - lava_callback - INFO - Starting async job submit for node 69b254d6b0f5558b5d7cdd4b 2026-03-14 05:53:41,697 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 05:53:41,729 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b254d6b0f5558b5d7cdd4b HTTP/1.1" 200 None 2026-03-14 05:53:41,730 - lava_callback - DEBUG - Processing node 69b254d6b0f5558b5d7cdd4b: baseline-arm64-baylibre 2026-03-14 05:53:41,730 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b254d6b0f5558b5d7cdd4b 2026-03-14 05:53:41,731 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 05:53:41,766 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b254d6b0f5558b5d7cdd4b HTTP/1.1" 200 None 2026-03-14 05:53:41,768 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 05:53:41,798 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aef431ce46d8ec186ab81d HTTP/1.1" 200 None 2026-03-14 05:53:41,799 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 05:53:41,829 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b254d6b0f5558b5d7cdd4b HTTP/1.1" 200 None 2026-03-14 05:53:41,830 - lava_callback - ERROR - Error processing callback for node 69b254d6b0f5558b5d7cdd4b: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:39230 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49252 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44246 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38056 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:38062 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35394 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35650 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35664 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51314 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39736 - "GET / HTTP/1.0" 200 OK 2026-03-14 05:54:59,093 - lava_callback - INFO - Received callback for node 69b25526b0f5558b5d7cdd5a INFO: 172.21.0.1:39746 - "POST /node/69b25526b0f5558b5d7cdd5a HTTP/1.0" 202 Accepted 2026-03-14 05:54:59,098 - lava_callback - INFO - Starting async job submit for node 69b25526b0f5558b5d7cdd5a 2026-03-14 05:54:59,099 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 05:54:59,123 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b25526b0f5558b5d7cdd5a HTTP/1.1" 200 None 2026-03-14 05:54:59,124 - lava_callback - DEBUG - Processing node 69b25526b0f5558b5d7cdd5a: baseline-arm64-clabbe 2026-03-14 05:54:59,124 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b25526b0f5558b5d7cdd5a 2026-03-14 05:54:59,125 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 05:54:59,138 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b25526b0f5558b5d7cdd5a HTTP/1.1" 200 None 2026-03-14 05:54:59,139 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 05:54:59,160 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aef431ce46d8ec186ab81d HTTP/1.1" 200 None 2026-03-14 05:54:59,162 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 05:54:59,182 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b25526b0f5558b5d7cdd5a HTTP/1.1" 200 None 2026-03-14 05:54:59,184 - lava_callback - ERROR - Error processing callback for node 69b25526b0f5558b5d7cdd5a: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:60734 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33500 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:33508 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40112 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47506 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47522 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57518 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39666 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56446 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49046 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:49052 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49084 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50746 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50752 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33102 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35258 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45170 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59822 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:59828 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53246 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46796 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46804 - "GET / HTTP/1.0" 200 OK 2026-03-14 05:57:39,195 - lava_callback - INFO - Received callback for node 69b255bdb0f5558b5d7cdd75 INFO: 172.21.0.1:46812 - "POST /node/69b255bdb0f5558b5d7cdd75 HTTP/1.0" 202 Accepted 2026-03-14 05:57:39,201 - lava_callback - INFO - Starting async job submit for node 69b255bdb0f5558b5d7cdd75 2026-03-14 05:57:39,202 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 05:57:39,225 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b255bdb0f5558b5d7cdd75 HTTP/1.1" 200 None 2026-03-14 05:57:39,226 - lava_callback - DEBUG - Processing node 69b255bdb0f5558b5d7cdd75: baseline-arm64-clabbe 2026-03-14 05:57:39,226 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b255bdb0f5558b5d7cdd75 2026-03-14 05:57:39,227 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 05:57:39,240 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b255bdb0f5558b5d7cdd75 HTTP/1.1" 200 None 2026-03-14 05:57:39,242 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 05:57:39,255 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aef431ce46d8ec186ab81d HTTP/1.1" 200 None 2026-03-14 05:57:39,257 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 05:57:39,296 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b255bdb0f5558b5d7cdd75 HTTP/1.1" 200 None 2026-03-14 05:57:39,298 - lava_callback - ERROR - Error processing callback for node 69b255bdb0f5558b5d7cdd75: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:38322 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57256 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:32854 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59944 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:59946 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47496 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33824 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33832 - "GET / HTTP/1.0" 200 OK 2026-03-14 05:58:39,219 - lava_callback - INFO - Received callback for node 69b25608b0f5558b5d7cdd87 INFO: 172.21.0.1:33834 - "POST /node/69b25608b0f5558b5d7cdd87 HTTP/1.0" 202 Accepted 2026-03-14 05:58:39,225 - lava_callback - INFO - Starting async job submit for node 69b25608b0f5558b5d7cdd87 2026-03-14 05:58:39,225 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 05:58:39,240 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b25608b0f5558b5d7cdd87 HTTP/1.1" 200 None 2026-03-14 05:58:39,241 - lava_callback - DEBUG - Processing node 69b25608b0f5558b5d7cdd87: baseline-arm64-clabbe 2026-03-14 05:58:39,241 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b25608b0f5558b5d7cdd87 2026-03-14 05:58:39,242 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 05:58:39,255 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b25608b0f5558b5d7cdd87 HTTP/1.1" 200 None 2026-03-14 05:58:39,256 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 05:58:39,273 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aef431ce46d8ec186ab81d HTTP/1.1" 200 None 2026-03-14 05:58:39,275 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 05:58:39,301 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b25608b0f5558b5d7cdd87 HTTP/1.1" 200 None 2026-03-14 05:58:39,302 - lava_callback - ERROR - Error processing callback for node 69b25608b0f5558b5d7cdd87: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:45118 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47814 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48174 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52514 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:52516 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39832 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53280 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53284 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43020 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40950 - "GET / HTTP/1.0" 200 OK 2026-03-14 05:59:59,251 - lava_callback - INFO - Received callback for node 69b25652b0f5558b5d7cdd95 INFO: 172.21.0.1:40952 - "POST /node/69b25652b0f5558b5d7cdd95 HTTP/1.0" 202 Accepted 2026-03-14 05:59:59,256 - lava_callback - INFO - Starting async job submit for node 69b25652b0f5558b5d7cdd95 2026-03-14 05:59:59,257 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 05:59:59,287 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b25652b0f5558b5d7cdd95 HTTP/1.1" 200 None 2026-03-14 05:59:59,288 - lava_callback - DEBUG - Processing node 69b25652b0f5558b5d7cdd95: baseline-arm64-clabbe 2026-03-14 05:59:59,288 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b25652b0f5558b5d7cdd95 2026-03-14 05:59:59,288 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 05:59:59,302 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b25652b0f5558b5d7cdd95 HTTP/1.1" 200 None 2026-03-14 05:59:59,303 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 05:59:59,329 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aef431ce46d8ec186ab81d HTTP/1.1" 200 None 2026-03-14 05:59:59,331 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 05:59:59,363 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b25652b0f5558b5d7cdd95 HTTP/1.1" 200 None 2026-03-14 05:59:59,369 - lava_callback - ERROR - Error processing callback for node 69b25652b0f5558b5d7cdd95: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:51110 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38052 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:38068 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44222 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52070 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52074 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33026 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35824 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52472 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42056 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:42064 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:32962 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59916 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59926 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53264 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48406 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39830 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34760 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:34776 - "GET / HTTP/1.0" 200 OK 2026-03-14 06:02:19,384 - lava_callback - INFO - Received callback for node 69b256e5b0f5558b5d7cddb1 INFO: 172.21.0.1:34784 - "POST /node/69b256e5b0f5558b5d7cddb1 HTTP/1.0" 202 Accepted 2026-03-14 06:02:19,389 - lava_callback - INFO - Starting async job submit for node 69b256e5b0f5558b5d7cddb1 2026-03-14 06:02:19,390 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 06:02:19,428 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b256e5b0f5558b5d7cddb1 HTTP/1.1" 200 None 2026-03-14 06:02:19,429 - lava_callback - DEBUG - Processing node 69b256e5b0f5558b5d7cddb1: baseline-arm64-clabbe 2026-03-14 06:02:19,429 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b256e5b0f5558b5d7cddb1 2026-03-14 06:02:19,430 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 06:02:19,443 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b256e5b0f5558b5d7cddb1 HTTP/1.1" 200 None 2026-03-14 06:02:19,445 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 06:02:19,458 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aef431ce46d8ec186ab81d HTTP/1.1" 200 None 2026-03-14 06:02:19,460 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 06:02:19,479 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b256e5b0f5558b5d7cddb1 HTTP/1.1" 200 None 2026-03-14 06:02:19,485 - lava_callback - ERROR - Error processing callback for node 69b256e5b0f5558b5d7cddb1: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:39496 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42918 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42934 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46796 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55352 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45962 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59588 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:59598 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38222 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56072 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56074 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45096 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34030 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57518 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47788 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:47802 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49318 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56364 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56378 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44866 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44812 - "GET / HTTP/1.0" 200 OK 2026-03-14 06:04:59,513 - lava_callback - INFO - Received callback for node 69b25779b0f5558b5d7cddca INFO: 172.21.0.1:44828 - "POST /node/69b25779b0f5558b5d7cddca HTTP/1.0" 202 Accepted 2026-03-14 06:04:59,519 - lava_callback - INFO - Starting async job submit for node 69b25779b0f5558b5d7cddca 2026-03-14 06:04:59,520 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 06:04:59,544 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b25779b0f5558b5d7cddca HTTP/1.1" 200 None 2026-03-14 06:04:59,545 - lava_callback - DEBUG - Processing node 69b25779b0f5558b5d7cddca: baseline-arm64-clabbe 2026-03-14 06:04:59,545 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b25779b0f5558b5d7cddca 2026-03-14 06:04:59,546 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 06:04:59,560 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b25779b0f5558b5d7cddca HTTP/1.1" 200 None 2026-03-14 06:04:59,561 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 06:04:59,574 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aef431ce46d8ec186ab81d HTTP/1.1" 200 None 2026-03-14 06:04:59,576 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 06:04:59,600 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b25779b0f5558b5d7cddca HTTP/1.1" 200 None 2026-03-14 06:04:59,601 - lava_callback - ERROR - Error processing callback for node 69b25779b0f5558b5d7cddca: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:40268 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47842 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:47844 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52068 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45788 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45800 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59762 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56992 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34238 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57428 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:57438 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53230 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42632 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42648 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57618 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48808 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55296 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41220 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:41232 - "GET / HTTP/1.0" 200 OK 2026-03-14 06:07:19,577 - lava_callback - INFO - Received callback for node 69b2580db0f5558b5d7cddea INFO: 172.21.0.1:41248 - "POST /node/69b2580db0f5558b5d7cddea HTTP/1.0" 202 Accepted 2026-03-14 06:07:19,583 - lava_callback - INFO - Starting async job submit for node 69b2580db0f5558b5d7cddea 2026-03-14 06:07:19,583 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 06:07:19,602 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b2580db0f5558b5d7cddea HTTP/1.1" 200 None 2026-03-14 06:07:19,603 - lava_callback - DEBUG - Processing node 69b2580db0f5558b5d7cddea: baseline-arm64-clabbe 2026-03-14 06:07:19,603 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b2580db0f5558b5d7cddea 2026-03-14 06:07:19,603 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 06:07:19,636 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b2580db0f5558b5d7cddea HTTP/1.1" 200 None 2026-03-14 06:07:19,637 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 06:07:19,650 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aef431ce46d8ec186ab81d HTTP/1.1" 200 None 2026-03-14 06:07:19,651 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 06:07:19,680 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b2580db0f5558b5d7cddea HTTP/1.1" 200 None 2026-03-14 06:07:19,682 - lava_callback - ERROR - Error processing callback for node 69b2580db0f5558b5d7cddea: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:36974 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39006 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39022 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56936 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40926 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53144 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35460 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:35462 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57682 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57190 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57192 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37510 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58258 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47812 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47636 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:47646 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46670 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49360 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49370 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40670 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51192 - "GET / HTTP/1.0" 200 OK 2026-03-14 06:09:59,706 - lava_callback - INFO - Received callback for node 69b258a5b0f5558b5d7cde04 INFO: 172.21.0.1:60062 - "POST /node/69b258a5b0f5558b5d7cde04 HTTP/1.0" 202 Accepted 2026-03-14 06:09:59,712 - lava_callback - INFO - Starting async job submit for node 69b258a5b0f5558b5d7cde04 2026-03-14 06:09:59,713 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 06:09:59,727 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b258a5b0f5558b5d7cde04 HTTP/1.1" 200 None 2026-03-14 06:09:59,728 - lava_callback - DEBUG - Processing node 69b258a5b0f5558b5d7cde04: baseline-arm64-clabbe 2026-03-14 06:09:59,728 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b258a5b0f5558b5d7cde04 2026-03-14 06:09:59,729 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 06:09:59,765 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b258a5b0f5558b5d7cde04 HTTP/1.1" 200 None 2026-03-14 06:09:59,767 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 06:09:59,808 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aef431ce46d8ec186ab81d HTTP/1.1" 200 None 2026-03-14 06:09:59,810 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 06:09:59,836 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b258a5b0f5558b5d7cde04 HTTP/1.1" 200 None 2026-03-14 06:09:59,838 - lava_callback - ERROR - Error processing callback for node 69b258a5b0f5558b5d7cde04: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:60070 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40358 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:40362 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40050 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47388 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47398 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35000 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46516 - "GET / HTTP/1.0" 200 OK 2026-03-14 06:11:03,051 - lava_callback - INFO - Received callback for node 69b258ebb0f5558b5d7cde1b INFO: 172.21.0.1:44488 - "POST /node/69b258ebb0f5558b5d7cde1b HTTP/1.0" 202 Accepted 2026-03-14 06:11:03,056 - lava_callback - INFO - Starting async job submit for node 69b258ebb0f5558b5d7cde1b 2026-03-14 06:11:03,057 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 06:11:03,102 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b258ebb0f5558b5d7cde1b HTTP/1.1" 200 None 2026-03-14 06:11:03,103 - lava_callback - DEBUG - Processing node 69b258ebb0f5558b5d7cde1b: baseline-arm64-baylibre 2026-03-14 06:11:03,103 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b258ebb0f5558b5d7cde1b 2026-03-14 06:11:03,104 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 06:11:03,141 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b258ebb0f5558b5d7cde1b HTTP/1.1" 200 None 2026-03-14 06:11:03,143 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 06:11:03,164 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aef431ce46d8ec186ab81d HTTP/1.1" 200 None 2026-03-14 06:11:03,166 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 06:11:03,209 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b258ebb0f5558b5d7cde1b HTTP/1.1" 200 None 2026-03-14 06:11:03,211 - lava_callback - ERROR - Error processing callback for node 69b258ebb0f5558b5d7cde1b: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:44492 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39350 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:39366 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38354 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41496 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41500 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54302 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39630 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39162 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43780 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:43782 - "GET / HTTP/1.0" 200 OK 2026-03-14 06:12:19,811 - lava_callback - INFO - Received callback for node 69b2593bb0f5558b5d7cde23 INFO: 172.21.0.1:42080 - "POST /node/69b2593bb0f5558b5d7cde23 HTTP/1.0" 202 Accepted 2026-03-14 06:12:19,817 - lava_callback - INFO - Starting async job submit for node 69b2593bb0f5558b5d7cde23 2026-03-14 06:12:19,818 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 06:12:19,864 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b2593bb0f5558b5d7cde23 HTTP/1.1" 200 None 2026-03-14 06:12:19,865 - lava_callback - DEBUG - Processing node 69b2593bb0f5558b5d7cde23: baseline-arm64-clabbe 2026-03-14 06:12:19,865 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b2593bb0f5558b5d7cde23 2026-03-14 06:12:19,866 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 06:12:19,903 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b2593bb0f5558b5d7cde23 HTTP/1.1" 200 None 2026-03-14 06:12:19,905 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 06:12:19,940 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aef431ce46d8ec186ab81d HTTP/1.1" 200 None 2026-03-14 06:12:19,941 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 06:12:19,981 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b2593bb0f5558b5d7cde23 HTTP/1.1" 200 None 2026-03-14 06:12:19,983 - lava_callback - ERROR - Error processing callback for node 69b2593bb0f5558b5d7cde23: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:42092 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35024 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35036 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58540 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53000 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48164 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51506 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:51510 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41968 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46584 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46586 - "GET / HTTP/1.0" 200 OK 2026-03-14 06:13:39,856 - lava_callback - INFO - Received callback for node 69b25987b0f5558b5d7cde36 INFO: 172.21.0.1:39098 - "POST /node/69b25987b0f5558b5d7cde36 HTTP/1.0" 202 Accepted 2026-03-14 06:13:39,861 - lava_callback - INFO - Starting async job submit for node 69b25987b0f5558b5d7cde36 2026-03-14 06:13:39,862 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 06:13:39,876 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b25987b0f5558b5d7cde36 HTTP/1.1" 200 None 2026-03-14 06:13:39,877 - lava_callback - DEBUG - Processing node 69b25987b0f5558b5d7cde36: baseline-arm64-clabbe 2026-03-14 06:13:39,877 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b25987b0f5558b5d7cde36 2026-03-14 06:13:39,878 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 06:13:39,891 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b25987b0f5558b5d7cde36 HTTP/1.1" 200 None 2026-03-14 06:13:39,893 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 06:13:39,906 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aef431ce46d8ec186ab81d HTTP/1.1" 200 None 2026-03-14 06:13:39,907 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 06:13:39,927 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b25987b0f5558b5d7cde36 HTTP/1.1" 200 None 2026-03-14 06:13:39,929 - lava_callback - ERROR - Error processing callback for node 69b25987b0f5558b5d7cde36: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:39100 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44082 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38818 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46066 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:46074 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41704 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39664 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39676 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58842 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56524 - "GET / HTTP/1.0" 200 OK 2026-03-14 06:14:59,945 - lava_callback - INFO - Received callback for node 69b259d1b0f5558b5d7cde3e INFO: 172.21.0.1:47286 - "POST /node/69b259d1b0f5558b5d7cde3e HTTP/1.0" 202 Accepted 2026-03-14 06:14:59,950 - lava_callback - INFO - Starting async job submit for node 69b259d1b0f5558b5d7cde3e 2026-03-14 06:14:59,951 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 06:14:59,987 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b259d1b0f5558b5d7cde3e HTTP/1.1" 200 None 2026-03-14 06:14:59,988 - lava_callback - DEBUG - Processing node 69b259d1b0f5558b5d7cde3e: baseline-arm64-clabbe 2026-03-14 06:14:59,988 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b259d1b0f5558b5d7cde3e 2026-03-14 06:14:59,989 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 06:15:00,033 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b259d1b0f5558b5d7cde3e HTTP/1.1" 200 None 2026-03-14 06:15:00,035 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 06:15:00,062 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aef431ce46d8ec186ab81d HTTP/1.1" 200 None 2026-03-14 06:15:00,064 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 06:15:00,085 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b259d1b0f5558b5d7cde3e HTTP/1.1" 200 None 2026-03-14 06:15:00,087 - lava_callback - ERROR - Error processing callback for node 69b259d1b0f5558b5d7cde3e: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:47300 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49086 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:49102 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58072 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35448 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35454 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39076 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:32924 - "GET / HTTP/1.0" 200 OK 2026-03-14 06:15:59,973 - lava_callback - INFO - Received callback for node 69b25a1db0f5558b5d7cde51 INFO: 172.21.0.1:51706 - "POST /node/69b25a1db0f5558b5d7cde51 HTTP/1.0" 202 Accepted 2026-03-14 06:15:59,979 - lava_callback - INFO - Starting async job submit for node 69b25a1db0f5558b5d7cde51 2026-03-14 06:15:59,980 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 06:15:59,994 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b25a1db0f5558b5d7cde51 HTTP/1.1" 200 None 2026-03-14 06:15:59,996 - lava_callback - DEBUG - Processing node 69b25a1db0f5558b5d7cde51: baseline-arm64-clabbe 2026-03-14 06:15:59,996 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b25a1db0f5558b5d7cde51 2026-03-14 06:15:59,997 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 06:16:00,019 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b25a1db0f5558b5d7cde51 HTTP/1.1" 200 None 2026-03-14 06:16:00,021 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 06:16:00,058 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aef431ce46d8ec186ab81d HTTP/1.1" 200 None 2026-03-14 06:16:00,060 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 06:16:00,084 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b25a1db0f5558b5d7cde51 HTTP/1.1" 200 None 2026-03-14 06:16:00,085 - lava_callback - ERROR - Error processing callback for node 69b25a1db0f5558b5d7cde51: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:51714 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51402 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:51406 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57442 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50230 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50234 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37884 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43136 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59618 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35000 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:35012 - "GET / HTTP/1.0" 200 OK 2026-03-14 06:17:20,017 - lava_callback - INFO - Received callback for node 69b25a6cb0f5558b5d7cde58 INFO: 172.21.0.1:40432 - "POST /node/69b25a6cb0f5558b5d7cde58 HTTP/1.0" 202 Accepted 2026-03-14 06:17:20,022 - lava_callback - INFO - Starting async job submit for node 69b25a6cb0f5558b5d7cde58 2026-03-14 06:17:20,023 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 06:17:20,038 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b25a6cb0f5558b5d7cde58 HTTP/1.1" 200 None 2026-03-14 06:17:20,038 - lava_callback - DEBUG - Processing node 69b25a6cb0f5558b5d7cde58: baseline-arm64-clabbe 2026-03-14 06:17:20,039 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b25a6cb0f5558b5d7cde58 2026-03-14 06:17:20,039 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 06:17:20,063 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b25a6cb0f5558b5d7cde58 HTTP/1.1" 200 None 2026-03-14 06:17:20,064 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 06:17:20,078 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aef431ce46d8ec186ab81d HTTP/1.1" 200 None 2026-03-14 06:17:20,080 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 06:17:20,100 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b25a6cb0f5558b5d7cde58 HTTP/1.1" 200 None 2026-03-14 06:17:20,102 - lava_callback - ERROR - Error processing callback for node 69b25a6cb0f5558b5d7cde58: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:40440 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57140 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57156 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47192 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49762 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38868 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34178 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:34192 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58470 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37240 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37254 - "GET / HTTP/1.0" 200 OK 2026-03-14 06:18:40,046 - lava_callback - INFO - Received callback for node 69b25ab8b0f5558b5d7cde6e INFO: 172.21.0.1:46310 - "POST /node/69b25ab8b0f5558b5d7cde6e HTTP/1.0" 202 Accepted 2026-03-14 06:18:40,052 - lava_callback - INFO - Starting async job submit for node 69b25ab8b0f5558b5d7cde6e 2026-03-14 06:18:40,053 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 06:18:40,076 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b25ab8b0f5558b5d7cde6e HTTP/1.1" 200 None 2026-03-14 06:18:40,077 - lava_callback - DEBUG - Processing node 69b25ab8b0f5558b5d7cde6e: baseline-arm64-clabbe 2026-03-14 06:18:40,078 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b25ab8b0f5558b5d7cde6e 2026-03-14 06:18:40,078 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 06:18:40,117 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b25ab8b0f5558b5d7cde6e HTTP/1.1" 200 None 2026-03-14 06:18:40,118 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 06:18:40,132 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aef431ce46d8ec186ab81d HTTP/1.1" 200 None 2026-03-14 06:18:40,133 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 06:18:40,177 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b25ab8b0f5558b5d7cde6e HTTP/1.1" 200 None 2026-03-14 06:18:40,185 - lava_callback - ERROR - Error processing callback for node 69b25ab8b0f5558b5d7cde6e: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:46320 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56246 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58060 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45850 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:45856 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57790 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39168 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39174 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36436 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36630 - "GET / HTTP/1.0" 200 OK 2026-03-14 06:20:00,134 - lava_callback - INFO - Received callback for node 69b25b02b0f5558b5d7cde78 INFO: 172.21.0.1:33258 - "POST /node/69b25b02b0f5558b5d7cde78 HTTP/1.0" 202 Accepted 2026-03-14 06:20:00,140 - lava_callback - INFO - Starting async job submit for node 69b25b02b0f5558b5d7cde78 2026-03-14 06:20:00,141 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 06:20:00,177 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b25b02b0f5558b5d7cde78 HTTP/1.1" 200 None 2026-03-14 06:20:00,178 - lava_callback - DEBUG - Processing node 69b25b02b0f5558b5d7cde78: baseline-arm64-clabbe 2026-03-14 06:20:00,178 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b25b02b0f5558b5d7cde78 2026-03-14 06:20:00,179 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 06:20:00,224 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b25b02b0f5558b5d7cde78 HTTP/1.1" 200 None 2026-03-14 06:20:00,226 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 06:20:00,251 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aef431ce46d8ec186ab81d HTTP/1.1" 200 None 2026-03-14 06:20:00,252 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 06:20:00,273 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b25b02b0f5558b5d7cde78 HTTP/1.1" 200 None 2026-03-14 06:20:00,275 - lava_callback - ERROR - Error processing callback for node 69b25b02b0f5558b5d7cde78: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:33268 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54930 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:54932 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40034 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50758 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50770 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57010 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58734 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42142 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42430 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:42446 - "GET / HTTP/1.0" 200 OK 2026-03-14 06:21:20,218 - lava_callback - INFO - Received callback for node 69b25b4cb0f5558b5d7cde88 INFO: 172.21.0.1:39642 - "POST /node/69b25b4cb0f5558b5d7cde88 HTTP/1.0" 202 Accepted 2026-03-14 06:21:20,223 - lava_callback - INFO - Starting async job submit for node 69b25b4cb0f5558b5d7cde88 2026-03-14 06:21:20,224 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 06:21:20,258 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b25b4cb0f5558b5d7cde88 HTTP/1.1" 200 None 2026-03-14 06:21:20,258 - lava_callback - DEBUG - Processing node 69b25b4cb0f5558b5d7cde88: baseline-arm64-clabbe 2026-03-14 06:21:20,259 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b25b4cb0f5558b5d7cde88 2026-03-14 06:21:20,259 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 06:21:20,273 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b25b4cb0f5558b5d7cde88 HTTP/1.1" 200 None 2026-03-14 06:21:20,274 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 06:21:20,288 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aef431ce46d8ec186ab81d HTTP/1.1" 200 None 2026-03-14 06:21:20,290 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 06:21:20,314 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b25b4cb0f5558b5d7cde88 HTTP/1.1" 200 None 2026-03-14 06:21:20,316 - lava_callback - ERROR - Error processing callback for node 69b25b4cb0f5558b5d7cde88: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:39652 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57204 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57206 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45188 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49576 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44992 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56172 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:56188 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42796 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50874 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50890 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40678 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59748 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43688 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54560 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:54564 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49214 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42500 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42504 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59122 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53498 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46410 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56636 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:56650 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56506 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37600 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37612 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42182 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35062 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58788 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55616 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:55630 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39006 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45012 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45028 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33066 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46036 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52284 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59896 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:59900 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46158 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51102 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51118 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35760 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51104 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40962 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55420 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:55428 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35944 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43672 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43676 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36520 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57822 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34774 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39404 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:39412 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42280 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48682 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48688 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59530 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46384 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58380 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60688 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:60698 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53260 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34618 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34632 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55856 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43304 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51816 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35616 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:35632 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54278 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48042 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48052 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39882 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57318 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48954 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50026 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:50038 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49270 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55814 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55818 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45378 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43890 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39644 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46996 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:47000 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56550 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36316 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36322 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36668 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41318 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51050 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42942 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:42948 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54216 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38064 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38076 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46372 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47264 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38154 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44152 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:44164 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47688 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33068 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33082 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47202 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58546 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55254 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39256 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:39268 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43698 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38628 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38634 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59094 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39450 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55618 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41980 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:41994 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52666 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54256 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54258 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50324 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36174 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41694 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33006 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:33008 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33802 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47494 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47510 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59726 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51990 - "GET / HTTP/1.0" 200 OK 2026-03-14 06:38:04,357 - lava_callback - INFO - Received callback for node 69b25f40b0f5558b5d7cde97 INFO: 172.21.0.1:57414 - "POST /node/69b25f40b0f5558b5d7cde97 HTTP/1.0" 202 Accepted 2026-03-14 06:38:04,363 - lava_callback - INFO - Starting async job submit for node 69b25f40b0f5558b5d7cde97 2026-03-14 06:38:04,363 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 06:38:04,377 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b25f40b0f5558b5d7cde97 HTTP/1.1" 200 None 2026-03-14 06:38:04,378 - lava_callback - DEBUG - Processing node 69b25f40b0f5558b5d7cde97: baseline-arm-baylibre 2026-03-14 06:38:04,378 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b25f40b0f5558b5d7cde97 2026-03-14 06:38:04,379 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 06:38:04,392 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b25f40b0f5558b5d7cde97 HTTP/1.1" 200 None 2026-03-14 06:38:04,394 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 06:38:04,411 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69af632c275c8d3b79399db4 HTTP/1.1" 200 None 2026-03-14 06:38:04,413 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 06:38:04,448 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b25f40b0f5558b5d7cde97 HTTP/1.1" 200 None 2026-03-14 06:38:04,476 - lava_callback - ERROR - Error processing callback for node 69b25f40b0f5558b5d7cde97: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:57418 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54718 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:54730 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56874 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46528 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46536 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59796 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42854 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50332 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54906 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:54918 - "GET / HTTP/1.0" 200 OK 2026-03-14 06:39:24,298 - lava_callback - INFO - Received callback for node 69b25f87b0f5558b5d7cdeb9 INFO: 172.21.0.1:38432 - "POST /node/69b25f87b0f5558b5d7cdeb9 HTTP/1.0" 202 Accepted 2026-03-14 06:39:24,303 - lava_callback - INFO - Starting async job submit for node 69b25f87b0f5558b5d7cdeb9 2026-03-14 06:39:24,304 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 06:39:24,321 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b25f87b0f5558b5d7cdeb9 HTTP/1.1" 200 None 2026-03-14 06:39:24,321 - lava_callback - DEBUG - Processing node 69b25f87b0f5558b5d7cdeb9: baseline-arm-baylibre 2026-03-14 06:39:24,322 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b25f87b0f5558b5d7cdeb9 2026-03-14 06:39:24,322 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 06:39:24,335 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b25f87b0f5558b5d7cdeb9 HTTP/1.1" 200 None 2026-03-14 06:39:24,336 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 06:39:24,352 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69af632c275c8d3b79399db4 HTTP/1.1" 200 None 2026-03-14 06:39:24,354 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 06:39:24,382 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b25f87b0f5558b5d7cdeb9 HTTP/1.1" 200 None 2026-03-14 06:39:24,384 - lava_callback - ERROR - Error processing callback for node 69b25f87b0f5558b5d7cdeb9: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:38434 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60350 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60354 - "GET / HTTP/1.0" 200 OK 2026-03-14 06:39:44,247 - lava_callback - INFO - Received callback for node 69b25fabb0f5558b5d7cdeca INFO: 172.21.0.1:58464 - "POST /node/69b25fabb0f5558b5d7cdeca HTTP/1.0" 202 Accepted 2026-03-14 06:39:44,253 - lava_callback - INFO - Starting async job submit for node 69b25fabb0f5558b5d7cdeca 2026-03-14 06:39:44,253 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 06:39:44,268 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b25fabb0f5558b5d7cdeca HTTP/1.1" 200 None 2026-03-14 06:39:44,269 - lava_callback - DEBUG - Processing node 69b25fabb0f5558b5d7cdeca: baseline-arm-baylibre 2026-03-14 06:39:44,269 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b25fabb0f5558b5d7cdeca 2026-03-14 06:39:44,270 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 06:39:44,290 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b25fabb0f5558b5d7cdeca HTTP/1.1" 200 None 2026-03-14 06:39:44,292 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 06:39:44,304 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69af632c275c8d3b79399db4 HTTP/1.1" 200 None 2026-03-14 06:39:44,306 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 06:39:44,330 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b25fabb0f5558b5d7cdeca HTTP/1.1" 200 None 2026-03-14 06:39:44,335 - lava_callback - ERROR - Error processing callback for node 69b25fabb0f5558b5d7cdeca: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:58472 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57430 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48352 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55498 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:55510 - "GET / HTTP/1.0" 200 OK 2026-03-14 06:40:24,316 - lava_callback - INFO - Received callback for node 69b25fceb0f5558b5d7cdedc INFO: 172.21.0.1:60010 - "POST /node/69b25fceb0f5558b5d7cdedc HTTP/1.0" 202 Accepted 2026-03-14 06:40:24,321 - lava_callback - INFO - Starting async job submit for node 69b25fceb0f5558b5d7cdedc 2026-03-14 06:40:24,322 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 06:40:24,337 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b25fceb0f5558b5d7cdedc HTTP/1.1" 200 None 2026-03-14 06:40:24,338 - lava_callback - DEBUG - Processing node 69b25fceb0f5558b5d7cdedc: baseline-arm-baylibre 2026-03-14 06:40:24,338 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b25fceb0f5558b5d7cdedc 2026-03-14 06:40:24,339 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 06:40:24,356 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b25fceb0f5558b5d7cdedc HTTP/1.1" 200 None 2026-03-14 06:40:24,357 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 06:40:24,370 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69af632c275c8d3b79399db4 HTTP/1.1" 200 None 2026-03-14 06:40:24,372 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 06:40:24,392 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b25fceb0f5558b5d7cdedc HTTP/1.1" 200 None 2026-03-14 06:40:24,394 - lava_callback - ERROR - Error processing callback for node 69b25fceb0f5558b5d7cdedc: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:60024 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57370 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57376 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57730 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58350 - "GET / HTTP/1.0" 200 OK 2026-03-14 06:41:04,404 - lava_callback - INFO - Received callback for node 69b25ff2b0f5558b5d7cdeee INFO: 172.21.0.1:59816 - "POST /node/69b25ff2b0f5558b5d7cdeee HTTP/1.0" 202 Accepted 2026-03-14 06:41:04,410 - lava_callback - INFO - Starting async job submit for node 69b25ff2b0f5558b5d7cdeee 2026-03-14 06:41:04,411 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 06:41:04,425 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b25ff2b0f5558b5d7cdeee HTTP/1.1" 200 None 2026-03-14 06:41:04,426 - lava_callback - DEBUG - Processing node 69b25ff2b0f5558b5d7cdeee: baseline-arm-baylibre 2026-03-14 06:41:04,426 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b25ff2b0f5558b5d7cdeee 2026-03-14 06:41:04,427 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 06:41:04,461 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b25ff2b0f5558b5d7cdeee HTTP/1.1" 200 None 2026-03-14 06:41:04,463 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 06:41:04,476 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69af632c275c8d3b79399db4 HTTP/1.1" 200 None 2026-03-14 06:41:04,477 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 06:41:04,500 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b25ff2b0f5558b5d7cdeee HTTP/1.1" 200 None 2026-03-14 06:41:04,505 - lava_callback - ERROR - Error processing callback for node 69b25ff2b0f5558b5d7cdeee: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:59822 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56420 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:56422 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60714 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49978 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49986 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33526 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52170 - "GET / HTTP/1.0" 200 OK 2026-03-14 06:42:04,391 - lava_callback - INFO - Received callback for node 69b26039b0f5558b5d7cdf0d INFO: 172.21.0.1:60140 - "POST /node/69b26039b0f5558b5d7cdf0d HTTP/1.0" 202 Accepted 2026-03-14 06:42:04,397 - lava_callback - INFO - Starting async job submit for node 69b26039b0f5558b5d7cdf0d 2026-03-14 06:42:04,398 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 06:42:04,412 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b26039b0f5558b5d7cdf0d HTTP/1.1" 200 None 2026-03-14 06:42:04,413 - lava_callback - DEBUG - Processing node 69b26039b0f5558b5d7cdf0d: baseline-arm-baylibre 2026-03-14 06:42:04,413 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b26039b0f5558b5d7cdf0d 2026-03-14 06:42:04,414 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 06:42:04,426 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b26039b0f5558b5d7cdf0d HTTP/1.1" 200 None 2026-03-14 06:42:04,427 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 06:42:04,446 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69af632c275c8d3b79399db4 HTTP/1.1" 200 None 2026-03-14 06:42:04,447 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 06:42:04,467 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b26039b0f5558b5d7cdf0d HTTP/1.1" 200 None 2026-03-14 06:42:04,469 - lava_callback - ERROR - Error processing callback for node 69b26039b0f5558b5d7cdf0d: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:60152 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60322 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:60328 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44498 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49582 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49592 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55820 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49776 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48758 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59018 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:59024 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56596 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38094 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38096 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35594 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39630 - "GET / HTTP/1.0" 200 OK 2026-03-14 06:44:04,618 - lava_callback - INFO - Received callback for node 69b260a0b0f5558b5d7cdf35 INFO: 172.21.0.1:43578 - "POST /node/69b260a0b0f5558b5d7cdf35 HTTP/1.0" 202 Accepted 2026-03-14 06:44:04,623 - lava_callback - INFO - Starting async job submit for node 69b260a0b0f5558b5d7cdf35 2026-03-14 06:44:04,624 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 06:44:04,639 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b260a0b0f5558b5d7cdf35 HTTP/1.1" 200 None 2026-03-14 06:44:04,640 - lava_callback - DEBUG - Processing node 69b260a0b0f5558b5d7cdf35: baseline-arm-baylibre 2026-03-14 06:44:04,640 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b260a0b0f5558b5d7cdf35 2026-03-14 06:44:04,641 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 06:44:04,663 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b260a0b0f5558b5d7cdf35 HTTP/1.1" 200 None 2026-03-14 06:44:04,664 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 06:44:04,677 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69af632c275c8d3b79399db4 HTTP/1.1" 200 None 2026-03-14 06:44:04,678 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 06:44:04,835 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b260a0b0f5558b5d7cdf35 HTTP/1.1" 200 None 2026-03-14 06:44:04,840 - lava_callback - ERROR - Error processing callback for node 69b260a0b0f5558b5d7cdf35: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:43580 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50098 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:50104 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35774 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55222 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55236 - "GET / HTTP/1.0" 200 OK 2026-03-14 06:44:41,334 - lava_callback - INFO - Received callback for node 69b260c5b0f5558b5d7cdf50 INFO: 172.21.0.1:49030 - "POST /node/69b260c5b0f5558b5d7cdf50 HTTP/1.0" 202 Accepted 2026-03-14 06:44:41,339 - lava_callback - INFO - Starting async job submit for node 69b260c5b0f5558b5d7cdf50 2026-03-14 06:44:41,340 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 06:44:41,354 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b260c5b0f5558b5d7cdf50 HTTP/1.1" 200 None 2026-03-14 06:44:41,355 - lava_callback - DEBUG - Processing node 69b260c5b0f5558b5d7cdf50: baseline-arm-clabbe 2026-03-14 06:44:41,355 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b260c5b0f5558b5d7cdf50 2026-03-14 06:44:41,356 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 06:44:41,369 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b260c5b0f5558b5d7cdf50 HTTP/1.1" 200 None 2026-03-14 06:44:41,371 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 06:44:41,384 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69af632c275c8d3b79399db4 HTTP/1.1" 200 None 2026-03-14 06:44:41,386 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 06:44:41,417 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b260c5b0f5558b5d7cdf50 HTTP/1.1" 200 None 2026-03-14 06:44:41,419 - lava_callback - ERROR - Error processing callback for node 69b260c5b0f5558b5d7cdf50: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:49032 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58606 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42120 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50938 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:50950 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54536 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48962 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48974 - "GET / HTTP/1.0" 200 OK 2026-03-14 06:45:41,381 - lava_callback - INFO - Received callback for node 69b2610cb0f5558b5d7cdf68 INFO: 172.21.0.1:35910 - "POST /node/69b2610cb0f5558b5d7cdf68 HTTP/1.0" 202 Accepted 2026-03-14 06:45:41,387 - lava_callback - INFO - Starting async job submit for node 69b2610cb0f5558b5d7cdf68 2026-03-14 06:45:41,388 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 06:45:41,404 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b2610cb0f5558b5d7cdf68 HTTP/1.1" 200 None 2026-03-14 06:45:41,405 - lava_callback - DEBUG - Processing node 69b2610cb0f5558b5d7cdf68: baseline-arm-clabbe 2026-03-14 06:45:41,405 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b2610cb0f5558b5d7cdf68 2026-03-14 06:45:41,406 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 06:45:41,430 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b2610cb0f5558b5d7cdf68 HTTP/1.1" 200 None 2026-03-14 06:45:41,431 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 06:45:41,445 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69af632c275c8d3b79399db4 HTTP/1.1" 200 None 2026-03-14 06:45:41,446 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 06:45:41,468 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b2610cb0f5558b5d7cdf68 HTTP/1.1" 200 None 2026-03-14 06:45:41,473 - lava_callback - ERROR - Error processing callback for node 69b2610cb0f5558b5d7cdf68: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:35912 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47082 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41998 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47396 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:47406 - "GET / HTTP/1.0" 200 OK 2026-03-14 06:46:21,373 - lava_callback - INFO - Received callback for node 69b26130b0f5558b5d7cdf7a INFO: 172.21.0.1:48006 - "POST /node/69b26130b0f5558b5d7cdf7a HTTP/1.0" 202 Accepted 2026-03-14 06:46:21,379 - lava_callback - INFO - Starting async job submit for node 69b26130b0f5558b5d7cdf7a 2026-03-14 06:46:21,380 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 06:46:21,395 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b26130b0f5558b5d7cdf7a HTTP/1.1" 200 None 2026-03-14 06:46:21,396 - lava_callback - DEBUG - Processing node 69b26130b0f5558b5d7cdf7a: baseline-arm-clabbe 2026-03-14 06:46:21,396 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b26130b0f5558b5d7cdf7a 2026-03-14 06:46:21,396 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 06:46:21,412 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b26130b0f5558b5d7cdf7a HTTP/1.1" 200 None 2026-03-14 06:46:21,413 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 06:46:21,442 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69af632c275c8d3b79399db4 HTTP/1.1" 200 None 2026-03-14 06:46:21,445 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 06:46:21,478 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b26130b0f5558b5d7cdf7a HTTP/1.1" 200 None 2026-03-14 06:46:21,485 - lava_callback - ERROR - Error processing callback for node 69b26130b0f5558b5d7cdf7a: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:48012 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41910 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41918 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52264 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43338 - "GET / HTTP/1.0" 200 OK 2026-03-14 06:47:01,475 - lava_callback - INFO - Received callback for node 69b26154b0f5558b5d7cdf8a INFO: 172.21.0.1:51978 - "POST /node/69b26154b0f5558b5d7cdf8a HTTP/1.0" 202 Accepted 2026-03-14 06:47:01,481 - lava_callback - INFO - Starting async job submit for node 69b26154b0f5558b5d7cdf8a 2026-03-14 06:47:01,481 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 06:47:01,499 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b26154b0f5558b5d7cdf8a HTTP/1.1" 200 None 2026-03-14 06:47:01,500 - lava_callback - DEBUG - Processing node 69b26154b0f5558b5d7cdf8a: baseline-arm-clabbe 2026-03-14 06:47:01,500 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b26154b0f5558b5d7cdf8a 2026-03-14 06:47:01,501 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 06:47:01,515 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b26154b0f5558b5d7cdf8a HTTP/1.1" 200 None 2026-03-14 06:47:01,517 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 06:47:01,541 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69af632c275c8d3b79399db4 HTTP/1.1" 200 None 2026-03-14 06:47:01,543 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 06:47:01,563 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b26154b0f5558b5d7cdf8a HTTP/1.1" 200 None 2026-03-14 06:47:01,564 - lava_callback - ERROR - Error processing callback for node 69b26154b0f5558b5d7cdf8a: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:51982 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37588 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:37600 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56746 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57002 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57012 - "GET / HTTP/1.0" 200 OK 2026-03-14 06:47:41,484 - lava_callback - INFO - Received callback for node 69b26178b0f5558b5d7cdf9b INFO: 172.21.0.1:40214 - "POST /node/69b26178b0f5558b5d7cdf9b HTTP/1.0" 202 Accepted 2026-03-14 06:47:41,489 - lava_callback - INFO - Starting async job submit for node 69b26178b0f5558b5d7cdf9b 2026-03-14 06:47:41,490 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 06:47:41,505 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b26178b0f5558b5d7cdf9b HTTP/1.1" 200 None 2026-03-14 06:47:41,505 - lava_callback - DEBUG - Processing node 69b26178b0f5558b5d7cdf9b: baseline-arm-clabbe 2026-03-14 06:47:41,506 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b26178b0f5558b5d7cdf9b 2026-03-14 06:47:41,506 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 06:47:41,519 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b26178b0f5558b5d7cdf9b HTTP/1.1" 200 None 2026-03-14 06:47:41,521 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 06:47:41,534 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69af632c275c8d3b79399db4 HTTP/1.1" 200 None 2026-03-14 06:47:41,535 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 06:47:41,562 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b26178b0f5558b5d7cdf9b HTTP/1.1" 200 None 2026-03-14 06:47:41,564 - lava_callback - ERROR - Error processing callback for node 69b26178b0f5558b5d7cdf9b: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:40216 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41240 - "GET / HTTP/1.0" 200 OK 2026-03-14 06:48:01,461 - lava_callback - INFO - Received callback for node 69b2619cb0f5558b5d7cdfad INFO: 172.21.0.1:34286 - "POST /node/69b2619cb0f5558b5d7cdfad HTTP/1.0" 202 Accepted 2026-03-14 06:48:01,466 - lava_callback - INFO - Starting async job submit for node 69b2619cb0f5558b5d7cdfad 2026-03-14 06:48:01,467 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 06:48:01,481 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b2619cb0f5558b5d7cdfad HTTP/1.1" 200 None 2026-03-14 06:48:01,482 - lava_callback - DEBUG - Processing node 69b2619cb0f5558b5d7cdfad: baseline-arm-clabbe 2026-03-14 06:48:01,482 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b2619cb0f5558b5d7cdfad 2026-03-14 06:48:01,483 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 06:48:01,510 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b2619cb0f5558b5d7cdfad HTTP/1.1" 200 None 2026-03-14 06:48:01,512 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 06:48:01,525 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69af632c275c8d3b79399db4 HTTP/1.1" 200 None 2026-03-14 06:48:01,526 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 06:48:01,550 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b2619cb0f5558b5d7cdfad HTTP/1.1" 200 None 2026-03-14 06:48:01,551 - lava_callback - ERROR - Error processing callback for node 69b2619cb0f5558b5d7cdfad: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:34298 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54468 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:54470 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60490 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57092 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57108 - "GET / HTTP/1.0" 200 OK 2026-03-14 06:48:41,474 - lava_callback - INFO - Received callback for node 69b261bfb0f5558b5d7cdfbb INFO: 172.21.0.1:52950 - "POST /node/69b261bfb0f5558b5d7cdfbb HTTP/1.0" 202 Accepted 2026-03-14 06:48:41,480 - lava_callback - INFO - Starting async job submit for node 69b261bfb0f5558b5d7cdfbb 2026-03-14 06:48:41,481 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 06:48:41,494 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b261bfb0f5558b5d7cdfbb HTTP/1.1" 200 None 2026-03-14 06:48:41,495 - lava_callback - DEBUG - Processing node 69b261bfb0f5558b5d7cdfbb: baseline-arm-clabbe 2026-03-14 06:48:41,495 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b261bfb0f5558b5d7cdfbb 2026-03-14 06:48:41,496 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 06:48:41,509 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b261bfb0f5558b5d7cdfbb HTTP/1.1" 200 None 2026-03-14 06:48:41,510 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 06:48:41,523 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69af632c275c8d3b79399db4 HTTP/1.1" 200 None 2026-03-14 06:48:41,524 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 06:48:41,544 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b261bfb0f5558b5d7cdfbb HTTP/1.1" 200 None 2026-03-14 06:48:41,549 - lava_callback - ERROR - Error processing callback for node 69b261bfb0f5558b5d7cdfbb: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:52960 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42460 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58236 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49706 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:49722 - "GET / HTTP/1.0" 200 OK 2026-03-14 06:49:21,531 - lava_callback - INFO - Received callback for node 69b261e3b0f5558b5d7cdfcb INFO: 172.21.0.1:59812 - "POST /node/69b261e3b0f5558b5d7cdfcb HTTP/1.0" 202 Accepted 2026-03-14 06:49:21,536 - lava_callback - INFO - Starting async job submit for node 69b261e3b0f5558b5d7cdfcb 2026-03-14 06:49:21,537 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 06:49:21,552 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b261e3b0f5558b5d7cdfcb HTTP/1.1" 200 None 2026-03-14 06:49:21,553 - lava_callback - DEBUG - Processing node 69b261e3b0f5558b5d7cdfcb: baseline-arm-clabbe 2026-03-14 06:49:21,553 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b261e3b0f5558b5d7cdfcb 2026-03-14 06:49:21,554 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 06:49:21,573 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b261e3b0f5558b5d7cdfcb HTTP/1.1" 200 None 2026-03-14 06:49:21,574 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 06:49:21,587 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69af632c275c8d3b79399db4 HTTP/1.1" 200 None 2026-03-14 06:49:21,588 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 06:49:21,635 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b261e3b0f5558b5d7cdfcb HTTP/1.1" 200 None 2026-03-14 06:49:21,640 - lava_callback - ERROR - Error processing callback for node 69b261e3b0f5558b5d7cdfcb: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:59818 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46588 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46602 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58070 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42546 - "GET / HTTP/1.0" 200 OK 2026-03-14 06:50:01,646 - lava_callback - INFO - Received callback for node 69b26207b0f5558b5d7cdfdb INFO: 172.21.0.1:45748 - "POST /node/69b26207b0f5558b5d7cdfdb HTTP/1.0" 202 Accepted 2026-03-14 06:50:01,651 - lava_callback - INFO - Starting async job submit for node 69b26207b0f5558b5d7cdfdb 2026-03-14 06:50:01,652 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 06:50:01,692 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b26207b0f5558b5d7cdfdb HTTP/1.1" 200 None 2026-03-14 06:50:01,693 - lava_callback - DEBUG - Processing node 69b26207b0f5558b5d7cdfdb: baseline-arm-clabbe 2026-03-14 06:50:01,694 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b26207b0f5558b5d7cdfdb 2026-03-14 06:50:01,694 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 06:50:01,715 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b26207b0f5558b5d7cdfdb HTTP/1.1" 200 None 2026-03-14 06:50:01,716 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 06:50:01,729 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69af632c275c8d3b79399db4 HTTP/1.1" 200 None 2026-03-14 06:50:01,731 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 06:50:01,751 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b26207b0f5558b5d7cdfdb HTTP/1.1" 200 None 2026-03-14 06:50:01,756 - lava_callback - ERROR - Error processing callback for node 69b26207b0f5558b5d7cdfdb: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:45756 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59006 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:59012 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49840 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47968 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47982 - "GET / HTTP/1.0" 200 OK 2026-03-14 06:50:41,582 - lava_callback - INFO - Received callback for node 69b2622cb0f5558b5d7cdfeb INFO: 172.21.0.1:46826 - "POST /node/69b2622cb0f5558b5d7cdfeb HTTP/1.0" 202 Accepted 2026-03-14 06:50:41,588 - lava_callback - INFO - Starting async job submit for node 69b2622cb0f5558b5d7cdfeb 2026-03-14 06:50:41,589 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 06:50:41,605 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b2622cb0f5558b5d7cdfeb HTTP/1.1" 200 None 2026-03-14 06:50:41,605 - lava_callback - DEBUG - Processing node 69b2622cb0f5558b5d7cdfeb: baseline-arm-clabbe 2026-03-14 06:50:41,606 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b2622cb0f5558b5d7cdfeb 2026-03-14 06:50:41,606 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 06:50:41,619 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b2622cb0f5558b5d7cdfeb HTTP/1.1" 200 None 2026-03-14 06:50:41,621 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 06:50:41,635 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69af632c275c8d3b79399db4 HTTP/1.1" 200 None 2026-03-14 06:50:41,637 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 06:50:41,657 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b2622cb0f5558b5d7cdfeb HTTP/1.1" 200 None 2026-03-14 06:50:41,659 - lava_callback - ERROR - Error processing callback for node 69b2622cb0f5558b5d7cdfeb: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:46828 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37450 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41042 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45360 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:45372 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40494 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37954 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37968 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59076 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47448 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59308 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48190 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:48202 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35016 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60894 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60908 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47850 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38034 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56152 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38620 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:38630 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55440 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34198 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34212 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48674 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49468 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42464 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36984 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:36996 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43064 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47954 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47970 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57608 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52974 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43518 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44680 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:44690 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37018 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48550 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48554 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51730 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48268 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60200 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52382 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:52394 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45822 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33116 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33120 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33884 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39338 - "GET / HTTP/1.0" 200 OK 2026-03-14 06:57:01,895 - lava_callback - INFO - Received callback for node 69b263a9b0f5558b5d7ce0dc INFO: 172.21.0.1:52422 - "POST /node/69b263a9b0f5558b5d7ce0dc HTTP/1.0" 202 Accepted 2026-03-14 06:57:01,901 - lava_callback - INFO - Starting async job submit for node 69b263a9b0f5558b5d7ce0dc 2026-03-14 06:57:01,902 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 06:57:01,916 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b263a9b0f5558b5d7ce0dc HTTP/1.1" 200 None 2026-03-14 06:57:01,917 - lava_callback - DEBUG - Processing node 69b263a9b0f5558b5d7ce0dc: baseline-arm-clabbe 2026-03-14 06:57:01,917 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b263a9b0f5558b5d7ce0dc 2026-03-14 06:57:01,918 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 06:57:01,934 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b263a9b0f5558b5d7ce0dc HTTP/1.1" 200 None 2026-03-14 06:57:01,936 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 06:57:01,949 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b2060ab0f5558b5d7cc5e3 HTTP/1.1" 200 None 2026-03-14 06:57:01,951 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 06:57:01,972 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b263a9b0f5558b5d7ce0dc HTTP/1.1" 200 None 2026-03-14 06:57:01,973 - lava_callback - ERROR - Error processing callback for node 69b263a9b0f5558b5d7ce0dc: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:52438 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35104 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:35120 - "GET / HTTP/1.0" 200 OK 2026-03-14 06:57:21,839 - lava_callback - INFO - Received callback for node 69b263cdb0f5558b5d7ce0ed INFO: 172.21.0.1:45904 - "POST /node/69b263cdb0f5558b5d7ce0ed HTTP/1.0" 202 Accepted 2026-03-14 06:57:21,845 - lava_callback - INFO - Starting async job submit for node 69b263cdb0f5558b5d7ce0ed 2026-03-14 06:57:21,846 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 06:57:21,861 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b263cdb0f5558b5d7ce0ed HTTP/1.1" 200 None 2026-03-14 06:57:21,861 - lava_callback - DEBUG - Processing node 69b263cdb0f5558b5d7ce0ed: baseline-arm-clabbe 2026-03-14 06:57:21,862 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b263cdb0f5558b5d7ce0ed 2026-03-14 06:57:21,862 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 06:57:21,876 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b263cdb0f5558b5d7ce0ed HTTP/1.1" 200 None 2026-03-14 06:57:21,877 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 06:57:21,890 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b2060ab0f5558b5d7cc5e3 HTTP/1.1" 200 None 2026-03-14 06:57:21,892 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 06:57:21,913 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b263cdb0f5558b5d7ce0ed HTTP/1.1" 200 None 2026-03-14 06:57:21,914 - lava_callback - ERROR - Error processing callback for node 69b263cdb0f5558b5d7ce0ed: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:45908 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48844 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48852 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34710 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41238 - "GET / HTTP/1.0" 200 OK 2026-03-14 06:58:01,899 - lava_callback - INFO - Received callback for node 69b263f1b0f5558b5d7ce104 INFO: 172.21.0.1:47210 - "POST /node/69b263f1b0f5558b5d7ce104 HTTP/1.0" 202 Accepted 2026-03-14 06:58:01,907 - lava_callback - INFO - Starting async job submit for node 69b263f1b0f5558b5d7ce104 2026-03-14 06:58:01,908 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 06:58:01,947 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b263f1b0f5558b5d7ce104 HTTP/1.1" 200 None 2026-03-14 06:58:01,948 - lava_callback - DEBUG - Processing node 69b263f1b0f5558b5d7ce104: baseline-arm-clabbe 2026-03-14 06:58:01,949 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b263f1b0f5558b5d7ce104 2026-03-14 06:58:01,949 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 06:58:01,971 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b263f1b0f5558b5d7ce104 HTTP/1.1" 200 None 2026-03-14 06:58:01,972 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 06:58:01,985 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b2060ab0f5558b5d7cc5e3 HTTP/1.1" 200 None 2026-03-14 06:58:01,987 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 06:58:02,017 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b263f1b0f5558b5d7ce104 HTTP/1.1" 200 None 2026-03-14 06:58:02,019 - lava_callback - ERROR - Error processing callback for node 69b263f1b0f5558b5d7ce104: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:47222 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35494 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:35498 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38974 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51560 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51564 - "GET / HTTP/1.0" 200 OK 2026-03-14 06:58:41,912 - lava_callback - INFO - Received callback for node 69b26415b0f5558b5d7ce10d INFO: 172.21.0.1:60476 - "POST /node/69b26415b0f5558b5d7ce10d HTTP/1.0" 202 Accepted 2026-03-14 06:58:41,917 - lava_callback - INFO - Starting async job submit for node 69b26415b0f5558b5d7ce10d 2026-03-14 06:58:41,918 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 06:58:41,934 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b26415b0f5558b5d7ce10d HTTP/1.1" 200 None 2026-03-14 06:58:41,934 - lava_callback - DEBUG - Processing node 69b26415b0f5558b5d7ce10d: baseline-arm-clabbe 2026-03-14 06:58:41,935 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b26415b0f5558b5d7ce10d 2026-03-14 06:58:41,935 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 06:58:41,948 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b26415b0f5558b5d7ce10d HTTP/1.1" 200 None 2026-03-14 06:58:41,950 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 06:58:41,963 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b2060ab0f5558b5d7cc5e3 HTTP/1.1" 200 None 2026-03-14 06:58:41,964 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 06:58:41,989 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b26415b0f5558b5d7ce10d HTTP/1.1" 200 None 2026-03-14 06:58:41,990 - lava_callback - ERROR - Error processing callback for node 69b26415b0f5558b5d7ce10d: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:60490 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55936 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40742 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39054 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:39062 - "GET / HTTP/1.0" 200 OK 2026-03-14 06:59:22,016 - lava_callback - INFO - Received callback for node 69b26438b0f5558b5d7ce11d INFO: 172.21.0.1:51520 - "POST /node/69b26438b0f5558b5d7ce11d HTTP/1.0" 202 Accepted 2026-03-14 06:59:22,022 - lava_callback - INFO - Starting async job submit for node 69b26438b0f5558b5d7ce11d 2026-03-14 06:59:22,023 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 06:59:22,037 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b26438b0f5558b5d7ce11d HTTP/1.1" 200 None 2026-03-14 06:59:22,038 - lava_callback - DEBUG - Processing node 69b26438b0f5558b5d7ce11d: baseline-arm-clabbe 2026-03-14 06:59:22,038 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b26438b0f5558b5d7ce11d 2026-03-14 06:59:22,038 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 06:59:22,052 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b26438b0f5558b5d7ce11d HTTP/1.1" 200 None 2026-03-14 06:59:22,053 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 06:59:22,069 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b2060ab0f5558b5d7cc5e3 HTTP/1.1" 200 None 2026-03-14 06:59:22,070 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 06:59:22,091 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b26438b0f5558b5d7ce11d HTTP/1.1" 200 None 2026-03-14 06:59:22,099 - lava_callback - ERROR - Error processing callback for node 69b26438b0f5558b5d7ce11d: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:51534 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59716 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59720 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46374 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52614 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58066 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52150 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:52166 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36374 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35346 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35350 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34430 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39936 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53082 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41058 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:41066 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58350 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48580 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48596 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60378 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38140 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56866 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44654 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:44670 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39042 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58972 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58986 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35708 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35948 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46498 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60846 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:60856 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60084 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59316 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59326 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43366 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58634 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34482 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37618 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:37620 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43562 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53490 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53494 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40610 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42600 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40538 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59934 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:59936 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50960 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59380 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59382 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33924 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40148 - "GET / HTTP/1.0" 200 OK 2026-03-14 07:06:06,060 - lava_callback - INFO - Received callback for node 69b265cbb0f5558b5d7ce16b INFO: 172.21.0.1:36280 - "POST /node/69b265cbb0f5558b5d7ce16b HTTP/1.0" 202 Accepted 2026-03-14 07:06:06,066 - lava_callback - INFO - Starting async job submit for node 69b265cbb0f5558b5d7ce16b 2026-03-14 07:06:06,067 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 07:06:06,081 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b265cbb0f5558b5d7ce16b HTTP/1.1" 200 None 2026-03-14 07:06:06,082 - lava_callback - DEBUG - Processing node 69b265cbb0f5558b5d7ce16b: baseline-arm64-baylibre 2026-03-14 07:06:06,082 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b265cbb0f5558b5d7ce16b 2026-03-14 07:06:06,083 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 07:06:06,096 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b265cbb0f5558b5d7ce16b HTTP/1.1" 200 None 2026-03-14 07:06:06,097 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 07:06:06,110 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b2061ab0f5558b5d7cc5f2 HTTP/1.1" 200 None 2026-03-14 07:06:06,111 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 07:06:06,141 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b265cbb0f5558b5d7ce16b HTTP/1.1" 200 None 2026-03-14 07:06:06,143 - lava_callback - ERROR - Error processing callback for node 69b265cbb0f5558b5d7ce16b: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:36286 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46714 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:46730 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54420 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34156 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34170 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53792 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37194 - "GET / HTTP/1.0" 200 OK 2026-03-14 07:07:05,801 - lava_callback - INFO - Received callback for node 69b26614b0f5558b5d7ce17d INFO: 172.21.0.1:38378 - "POST /node/69b26614b0f5558b5d7ce17d HTTP/1.0" 202 Accepted 2026-03-14 07:07:05,806 - lava_callback - INFO - Starting async job submit for node 69b26614b0f5558b5d7ce17d 2026-03-14 07:07:05,807 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 07:07:05,832 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b26614b0f5558b5d7ce17d HTTP/1.1" 200 None 2026-03-14 07:07:05,834 - lava_callback - DEBUG - Processing node 69b26614b0f5558b5d7ce17d: baseline-arm64-baylibre 2026-03-14 07:07:05,834 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b26614b0f5558b5d7ce17d 2026-03-14 07:07:05,835 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 07:07:05,868 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b26614b0f5558b5d7ce17d HTTP/1.1" 200 None 2026-03-14 07:07:05,869 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 07:07:05,883 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b2061ab0f5558b5d7cc5f2 HTTP/1.1" 200 None 2026-03-14 07:07:05,884 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 07:07:05,934 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b26614b0f5558b5d7ce17d HTTP/1.1" 200 None 2026-03-14 07:07:05,936 - lava_callback - ERROR - Error processing callback for node 69b26614b0f5558b5d7ce17d: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:38388 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38662 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:38674 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45468 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55682 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55688 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33988 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37110 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50676 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49808 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:49814 - "GET / HTTP/1.0" 200 OK 2026-03-14 07:08:25,876 - lava_callback - INFO - Received callback for node 69b26660b0f5558b5d7ce186 INFO: 172.21.0.1:39236 - "POST /node/69b26660b0f5558b5d7ce186 HTTP/1.0" 202 Accepted 2026-03-14 07:08:25,882 - lava_callback - INFO - Starting async job submit for node 69b26660b0f5558b5d7ce186 2026-03-14 07:08:25,883 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 07:08:25,897 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b26660b0f5558b5d7ce186 HTTP/1.1" 200 None 2026-03-14 07:08:25,898 - lava_callback - DEBUG - Processing node 69b26660b0f5558b5d7ce186: baseline-arm64-baylibre 2026-03-14 07:08:25,898 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b26660b0f5558b5d7ce186 2026-03-14 07:08:25,899 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 07:08:25,916 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b26660b0f5558b5d7ce186 HTTP/1.1" 200 None 2026-03-14 07:08:25,918 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 07:08:25,944 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b2061ab0f5558b5d7cc5f2 HTTP/1.1" 200 None 2026-03-14 07:08:25,946 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 07:08:25,966 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b26660b0f5558b5d7ce186 HTTP/1.1" 200 None 2026-03-14 07:08:25,971 - lava_callback - ERROR - Error processing callback for node 69b26660b0f5558b5d7ce186: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:39240 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33542 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33558 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45446 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45766 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59164 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54594 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:54610 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38864 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48828 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48836 - "GET / HTTP/1.0" 200 OK 2026-03-14 07:09:45,978 - lava_callback - INFO - Received callback for node 69b266abb0f5558b5d7ce198 INFO: 172.21.0.1:44790 - "POST /node/69b266abb0f5558b5d7ce198 HTTP/1.0" 202 Accepted 2026-03-14 07:09:45,984 - lava_callback - INFO - Starting async job submit for node 69b266abb0f5558b5d7ce198 2026-03-14 07:09:45,984 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 07:09:46,005 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b266abb0f5558b5d7ce198 HTTP/1.1" 200 None 2026-03-14 07:09:46,006 - lava_callback - DEBUG - Processing node 69b266abb0f5558b5d7ce198: baseline-arm64-baylibre 2026-03-14 07:09:46,006 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b266abb0f5558b5d7ce198 2026-03-14 07:09:46,007 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 07:09:46,030 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b266abb0f5558b5d7ce198 HTTP/1.1" 200 None 2026-03-14 07:09:46,032 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 07:09:46,045 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b2061ab0f5558b5d7cc5f2 HTTP/1.1" 200 None 2026-03-14 07:09:46,047 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 07:09:46,068 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b266abb0f5558b5d7ce198 HTTP/1.1" 200 None 2026-03-14 07:09:46,077 - lava_callback - ERROR - Error processing callback for node 69b266abb0f5558b5d7ce198: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:44796 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54204 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58826 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36398 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:36414 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60172 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40574 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40580 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34756 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42230 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47458 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51852 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:51860 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43684 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33162 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33166 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59916 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46130 - "GET / HTTP/1.0" 200 OK 2026-03-14 07:12:06,097 - lava_callback - INFO - Received callback for node 69b26740b0f5558b5d7ce1b8 INFO: 172.21.0.1:33136 - "POST /node/69b26740b0f5558b5d7ce1b8 HTTP/1.0" 202 Accepted 2026-03-14 07:12:06,103 - lava_callback - INFO - Starting async job submit for node 69b26740b0f5558b5d7ce1b8 2026-03-14 07:12:06,104 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 07:12:06,121 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b26740b0f5558b5d7ce1b8 HTTP/1.1" 200 None 2026-03-14 07:12:06,122 - lava_callback - DEBUG - Processing node 69b26740b0f5558b5d7ce1b8: baseline-arm64-baylibre 2026-03-14 07:12:06,122 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b26740b0f5558b5d7ce1b8 2026-03-14 07:12:06,123 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 07:12:06,136 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b26740b0f5558b5d7ce1b8 HTTP/1.1" 200 None 2026-03-14 07:12:06,138 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 07:12:06,152 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b2061ab0f5558b5d7cc5f2 HTTP/1.1" 200 None 2026-03-14 07:12:06,154 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 07:12:06,174 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b26740b0f5558b5d7ce1b8 HTTP/1.1" 200 None 2026-03-14 07:12:06,180 - lava_callback - ERROR - Error processing callback for node 69b26740b0f5558b5d7ce1b8: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:33138 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56574 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:56578 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55214 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51590 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51592 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47612 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40066 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40920 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60280 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:60288 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57018 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42978 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42994 - "GET / HTTP/1.0" 200 OK 2026-03-14 07:13:42,569 - lava_callback - INFO - Received callback for node 69b26790b0f5558b5d7ce1cb INFO: 172.21.0.1:50098 - "POST /node/69b26790b0f5558b5d7ce1cb HTTP/1.0" 202 Accepted 2026-03-14 07:13:42,578 - lava_callback - INFO - Starting async job submit for node 69b26790b0f5558b5d7ce1cb 2026-03-14 07:13:42,579 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 07:13:42,594 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b26790b0f5558b5d7ce1cb HTTP/1.1" 200 None 2026-03-14 07:13:42,595 - lava_callback - DEBUG - Processing node 69b26790b0f5558b5d7ce1cb: baseline-arm64-clabbe 2026-03-14 07:13:42,595 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b26790b0f5558b5d7ce1cb 2026-03-14 07:13:42,596 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 07:13:42,609 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b26790b0f5558b5d7ce1cb HTTP/1.1" 200 None 2026-03-14 07:13:42,611 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 07:13:42,632 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b2061ab0f5558b5d7cc5f2 HTTP/1.1" 200 None 2026-03-14 07:13:42,634 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 07:13:42,654 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b26790b0f5558b5d7ce1cb HTTP/1.1" 200 None 2026-03-14 07:13:42,663 - lava_callback - ERROR - Error processing callback for node 69b26790b0f5558b5d7ce1cb: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:50114 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45332 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36880 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42572 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:42582 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49664 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60840 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60842 - "GET / HTTP/1.0" 200 OK 2026-03-14 07:14:42,681 - lava_callback - INFO - Received callback for node 69b267dab0f5558b5d7ce1dc INFO: 172.21.0.1:36242 - "POST /node/69b267dab0f5558b5d7ce1dc HTTP/1.0" 202 Accepted 2026-03-14 07:14:42,690 - lava_callback - INFO - Starting async job submit for node 69b267dab0f5558b5d7ce1dc 2026-03-14 07:14:42,691 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 07:14:42,706 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b267dab0f5558b5d7ce1dc HTTP/1.1" 200 None 2026-03-14 07:14:42,708 - lava_callback - DEBUG - Processing node 69b267dab0f5558b5d7ce1dc: baseline-arm64-clabbe 2026-03-14 07:14:42,708 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b267dab0f5558b5d7ce1dc 2026-03-14 07:14:42,709 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 07:14:42,723 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b267dab0f5558b5d7ce1dc HTTP/1.1" 200 None 2026-03-14 07:14:42,725 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 07:14:42,738 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b2061ab0f5558b5d7cc5f2 HTTP/1.1" 200 None 2026-03-14 07:14:42,739 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 07:14:42,760 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b267dab0f5558b5d7ce1dc HTTP/1.1" 200 None 2026-03-14 07:14:42,762 - lava_callback - ERROR - Error processing callback for node 69b267dab0f5558b5d7ce1dc: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:36248 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39150 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37346 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43372 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:43374 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39978 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38040 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38052 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55016 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39096 - "GET / HTTP/1.0" 200 OK 2026-03-14 07:16:02,699 - lava_callback - INFO - Received callback for node 69b26825b0f5558b5d7ce1f1 INFO: 172.21.0.1:45820 - "POST /node/69b26825b0f5558b5d7ce1f1 HTTP/1.0" 202 Accepted 2026-03-14 07:16:02,704 - lava_callback - INFO - Starting async job submit for node 69b26825b0f5558b5d7ce1f1 2026-03-14 07:16:02,705 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 07:16:02,719 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b26825b0f5558b5d7ce1f1 HTTP/1.1" 200 None 2026-03-14 07:16:02,720 - lava_callback - DEBUG - Processing node 69b26825b0f5558b5d7ce1f1: baseline-arm64-clabbe 2026-03-14 07:16:02,720 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b26825b0f5558b5d7ce1f1 2026-03-14 07:16:02,720 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 07:16:02,734 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b26825b0f5558b5d7ce1f1 HTTP/1.1" 200 None 2026-03-14 07:16:02,735 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 07:16:02,748 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b2061ab0f5558b5d7cc5f2 HTTP/1.1" 200 None 2026-03-14 07:16:02,749 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 07:16:02,771 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b26825b0f5558b5d7ce1f1 HTTP/1.1" 200 None 2026-03-14 07:16:02,777 - lava_callback - ERROR - Error processing callback for node 69b26825b0f5558b5d7ce1f1: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:45834 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54356 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:54358 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33658 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36358 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36370 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36556 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55964 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48432 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42596 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:42602 - "GET / HTTP/1.0" 200 OK 2026-03-14 07:17:22,758 - lava_callback - INFO - Received callback for node 69b26870b0f5558b5d7ce205 INFO: 172.21.0.1:52342 - "POST /node/69b26870b0f5558b5d7ce205 HTTP/1.0" 202 Accepted 2026-03-14 07:17:22,764 - lava_callback - INFO - Starting async job submit for node 69b26870b0f5558b5d7ce205 2026-03-14 07:17:22,765 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 07:17:22,779 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b26870b0f5558b5d7ce205 HTTP/1.1" 200 None 2026-03-14 07:17:22,780 - lava_callback - DEBUG - Processing node 69b26870b0f5558b5d7ce205: baseline-arm64-clabbe 2026-03-14 07:17:22,780 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b26870b0f5558b5d7ce205 2026-03-14 07:17:22,781 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 07:17:22,794 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b26870b0f5558b5d7ce205 HTTP/1.1" 200 None 2026-03-14 07:17:22,795 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 07:17:22,809 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b2061ab0f5558b5d7cc5f2 HTTP/1.1" 200 None 2026-03-14 07:17:22,811 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 07:17:22,832 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b26870b0f5558b5d7ce205 HTTP/1.1" 200 None 2026-03-14 07:17:22,845 - lava_callback - ERROR - Error processing callback for node 69b26870b0f5558b5d7ce205: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:52350 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49070 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49074 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42072 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60052 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48066 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51076 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:51084 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44456 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37722 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37732 - "GET / HTTP/1.0" 200 OK 2026-03-14 07:18:42,774 - lava_callback - INFO - Received callback for node 69b268bcb0f5558b5d7ce214 INFO: 172.21.0.1:55938 - "POST /node/69b268bcb0f5558b5d7ce214 HTTP/1.0" 202 Accepted 2026-03-14 07:18:42,780 - lava_callback - INFO - Starting async job submit for node 69b268bcb0f5558b5d7ce214 2026-03-14 07:18:42,781 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 07:18:42,795 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b268bcb0f5558b5d7ce214 HTTP/1.1" 200 None 2026-03-14 07:18:42,796 - lava_callback - DEBUG - Processing node 69b268bcb0f5558b5d7ce214: baseline-arm64-clabbe 2026-03-14 07:18:42,796 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b268bcb0f5558b5d7ce214 2026-03-14 07:18:42,797 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 07:18:42,809 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b268bcb0f5558b5d7ce214 HTTP/1.1" 200 None 2026-03-14 07:18:42,810 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 07:18:42,829 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b2061ab0f5558b5d7cc5f2 HTTP/1.1" 200 None 2026-03-14 07:18:42,830 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 07:18:42,859 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b268bcb0f5558b5d7ce214 HTTP/1.1" 200 None 2026-03-14 07:18:42,860 - lava_callback - ERROR - Error processing callback for node 69b268bcb0f5558b5d7ce214: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:55944 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44582 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42214 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39646 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:39656 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33318 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45882 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45898 - "GET / HTTP/1.0" 200 OK 2026-03-14 07:19:42,794 - lava_callback - INFO - Received callback for node 69b26907b0f5558b5d7ce227 INFO: 172.21.0.1:33498 - "POST /node/69b26907b0f5558b5d7ce227 HTTP/1.0" 202 Accepted 2026-03-14 07:19:42,800 - lava_callback - INFO - Starting async job submit for node 69b26907b0f5558b5d7ce227 2026-03-14 07:19:42,801 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 07:19:42,831 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b26907b0f5558b5d7ce227 HTTP/1.1" 200 None 2026-03-14 07:19:42,832 - lava_callback - DEBUG - Processing node 69b26907b0f5558b5d7ce227: baseline-arm64-clabbe 2026-03-14 07:19:42,832 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b26907b0f5558b5d7ce227 2026-03-14 07:19:42,832 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 07:19:42,846 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b26907b0f5558b5d7ce227 HTTP/1.1" 200 None 2026-03-14 07:19:42,847 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 07:19:42,860 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b2061ab0f5558b5d7cc5f2 HTTP/1.1" 200 None 2026-03-14 07:19:42,861 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 07:19:42,890 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b26907b0f5558b5d7ce227 HTTP/1.1" 200 None 2026-03-14 07:19:42,900 - lava_callback - ERROR - Error processing callback for node 69b26907b0f5558b5d7ce227: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:33500 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34358 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57884 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38148 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:38154 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58060 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47212 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47222 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57840 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47904 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50550 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35856 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:35866 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50898 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37906 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37910 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40152 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53278 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47350 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55120 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:55136 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55828 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49352 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49366 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44132 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57666 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40436 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36580 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:36592 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34512 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45982 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45996 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59140 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56594 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44004 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34712 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:34728 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44664 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49968 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49972 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50396 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55184 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36896 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47254 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:47264 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47014 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37510 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37522 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46208 - "GET / HTTP/1.0" 200 OK 2026-03-14 07:25:46,860 - lava_callback - INFO - Received callback for node 69b26a76b0f5558b5d7ce26b INFO: 172.21.0.1:46218 - "POST /node/69b26a76b0f5558b5d7ce26b HTTP/1.0" 202 Accepted 2026-03-14 07:25:46,866 - lava_callback - INFO - Starting async job submit for node 69b26a76b0f5558b5d7ce26b 2026-03-14 07:25:46,866 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 07:25:46,881 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b26a76b0f5558b5d7ce26b HTTP/1.1" 200 None 2026-03-14 07:25:46,882 - lava_callback - DEBUG - Processing node 69b26a76b0f5558b5d7ce26b: baseline-arm64-baylibre 2026-03-14 07:25:46,882 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b26a76b0f5558b5d7ce26b 2026-03-14 07:25:46,883 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 07:25:46,897 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b26a76b0f5558b5d7ce26b HTTP/1.1" 200 None 2026-03-14 07:25:46,898 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 07:25:46,912 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69af6340275c8d3b79399dc3 HTTP/1.1" 200 None 2026-03-14 07:25:46,913 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 07:25:46,936 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b26a76b0f5558b5d7ce26b HTTP/1.1" 200 None 2026-03-14 07:25:46,938 - lava_callback - ERROR - Error processing callback for node 69b26a76b0f5558b5d7ce26b: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:32876 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39678 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56762 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:56772 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53558 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34062 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34070 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36802 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56804 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35766 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47194 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:47204 - "GET / HTTP/1.0" 200 OK 2026-03-14 07:27:23,167 - lava_callback - INFO - Received callback for node 69b26ac6b0f5558b5d7ce281 INFO: 172.21.0.1:58484 - "POST /node/69b26ac6b0f5558b5d7ce281 HTTP/1.0" 202 Accepted 2026-03-14 07:27:23,173 - lava_callback - INFO - Starting async job submit for node 69b26ac6b0f5558b5d7ce281 2026-03-14 07:27:23,174 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 07:27:23,226 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b26ac6b0f5558b5d7ce281 HTTP/1.1" 200 None 2026-03-14 07:27:23,227 - lava_callback - DEBUG - Processing node 69b26ac6b0f5558b5d7ce281: baseline-arm64-clabbe 2026-03-14 07:27:23,227 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b26ac6b0f5558b5d7ce281 2026-03-14 07:27:23,228 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 07:27:23,241 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b26ac6b0f5558b5d7ce281 HTTP/1.1" 200 None 2026-03-14 07:27:23,242 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 07:27:23,258 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69af6340275c8d3b79399dc3 HTTP/1.1" 200 None 2026-03-14 07:27:23,259 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 07:27:23,288 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b26ac6b0f5558b5d7ce281 HTTP/1.1" 200 None 2026-03-14 07:27:23,289 - lava_callback - ERROR - Error processing callback for node 69b26ac6b0f5558b5d7ce281: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:58498 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37738 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37744 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36820 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55900 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37878 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49718 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:49730 - "GET / HTTP/1.0" 200 OK 2026-03-14 07:28:23,225 - lava_callback - INFO - Received callback for node 69b26b10b0f5558b5d7ce293 INFO: 172.21.0.1:33302 - "POST /node/69b26b10b0f5558b5d7ce293 HTTP/1.0" 202 Accepted 2026-03-14 07:28:23,231 - lava_callback - INFO - Starting async job submit for node 69b26b10b0f5558b5d7ce293 2026-03-14 07:28:23,232 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 07:28:23,277 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b26b10b0f5558b5d7ce293 HTTP/1.1" 200 None 2026-03-14 07:28:23,278 - lava_callback - DEBUG - Processing node 69b26b10b0f5558b5d7ce293: baseline-arm64-clabbe 2026-03-14 07:28:23,278 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b26b10b0f5558b5d7ce293 2026-03-14 07:28:23,279 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 07:28:23,292 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b26b10b0f5558b5d7ce293 HTTP/1.1" 200 None 2026-03-14 07:28:23,294 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 07:28:23,307 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69af6340275c8d3b79399dc3 HTTP/1.1" 200 None 2026-03-14 07:28:23,309 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 07:28:23,329 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b26b10b0f5558b5d7ce293 HTTP/1.1" 200 None 2026-03-14 07:28:23,335 - lava_callback - ERROR - Error processing callback for node 69b26b10b0f5558b5d7ce293: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:33316 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33022 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33028 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52186 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33740 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57734 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51408 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:51424 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59926 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36440 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36450 - "GET / HTTP/1.0" 200 OK 2026-03-14 07:29:43,274 - lava_callback - INFO - Received callback for node 69b26b5cb0f5558b5d7ce2a3 INFO: 172.21.0.1:41736 - "POST /node/69b26b5cb0f5558b5d7ce2a3 HTTP/1.0" 202 Accepted 2026-03-14 07:29:43,279 - lava_callback - INFO - Starting async job submit for node 69b26b5cb0f5558b5d7ce2a3 2026-03-14 07:29:43,280 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 07:29:43,295 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b26b5cb0f5558b5d7ce2a3 HTTP/1.1" 200 None 2026-03-14 07:29:43,296 - lava_callback - DEBUG - Processing node 69b26b5cb0f5558b5d7ce2a3: baseline-arm64-clabbe 2026-03-14 07:29:43,296 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b26b5cb0f5558b5d7ce2a3 2026-03-14 07:29:43,296 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 07:29:43,319 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b26b5cb0f5558b5d7ce2a3 HTTP/1.1" 200 None 2026-03-14 07:29:43,320 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 07:29:43,333 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69af6340275c8d3b79399dc3 HTTP/1.1" 200 None 2026-03-14 07:29:43,335 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 07:29:43,355 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b26b5cb0f5558b5d7ce2a3 HTTP/1.1" 200 None 2026-03-14 07:29:43,356 - lava_callback - ERROR - Error processing callback for node 69b26b5cb0f5558b5d7ce2a3: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:41740 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48658 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54162 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54620 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:54622 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39268 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34660 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34674 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60516 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50630 - "GET / HTTP/1.0" 200 OK 2026-03-14 07:31:03,304 - lava_callback - INFO - Received callback for node 69b26ba9b0f5558b5d7ce2af INFO: 172.21.0.1:34722 - "POST /node/69b26ba9b0f5558b5d7ce2af HTTP/1.0" 202 Accepted 2026-03-14 07:31:03,309 - lava_callback - INFO - Starting async job submit for node 69b26ba9b0f5558b5d7ce2af 2026-03-14 07:31:03,310 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 07:31:03,326 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b26ba9b0f5558b5d7ce2af HTTP/1.1" 200 None 2026-03-14 07:31:03,327 - lava_callback - DEBUG - Processing node 69b26ba9b0f5558b5d7ce2af: baseline-arm64-clabbe 2026-03-14 07:31:03,327 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b26ba9b0f5558b5d7ce2af 2026-03-14 07:31:03,328 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 07:31:03,341 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b26ba9b0f5558b5d7ce2af HTTP/1.1" 200 None 2026-03-14 07:31:03,342 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 07:31:03,355 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69af6340275c8d3b79399dc3 HTTP/1.1" 200 None 2026-03-14 07:31:03,357 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 07:31:03,389 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b26ba9b0f5558b5d7ce2af HTTP/1.1" 200 None 2026-03-14 07:31:03,390 - lava_callback - ERROR - Error processing callback for node 69b26ba9b0f5558b5d7ce2af: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:34734 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59508 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:59510 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58752 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47010 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47018 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46226 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49084 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41356 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43578 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:43586 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49062 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38712 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38718 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36248 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42244 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54350 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37122 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:37126 - "GET / HTTP/1.0" 200 OK 2026-03-14 07:33:23,432 - lava_callback - INFO - Received callback for node 69b26c3fb0f5558b5d7ce2c6 INFO: 172.21.0.1:51916 - "POST /node/69b26c3fb0f5558b5d7ce2c6 HTTP/1.0" 202 Accepted 2026-03-14 07:33:23,437 - lava_callback - INFO - Starting async job submit for node 69b26c3fb0f5558b5d7ce2c6 2026-03-14 07:33:23,438 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 07:33:23,456 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b26c3fb0f5558b5d7ce2c6 HTTP/1.1" 200 None 2026-03-14 07:33:23,457 - lava_callback - DEBUG - Processing node 69b26c3fb0f5558b5d7ce2c6: baseline-arm64-clabbe 2026-03-14 07:33:23,457 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b26c3fb0f5558b5d7ce2c6 2026-03-14 07:33:23,458 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 07:33:23,471 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b26c3fb0f5558b5d7ce2c6 HTTP/1.1" 200 None 2026-03-14 07:33:23,472 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 07:33:23,485 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69af6340275c8d3b79399dc3 HTTP/1.1" 200 None 2026-03-14 07:33:23,486 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 07:33:23,518 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b26c3fb0f5558b5d7ce2c6 HTTP/1.1" 200 None 2026-03-14 07:33:23,520 - lava_callback - ERROR - Error processing callback for node 69b26c3fb0f5558b5d7ce2c6: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:51920 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60484 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60492 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60644 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47618 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38204 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58214 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:58216 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47424 - "GET / HTTP/1.0" 200 OK 2026-03-14 07:34:27,362 - lava_callback - INFO - Received callback for node 69b26c81b0f5558b5d7ce2d5 INFO: 172.21.0.1:47436 - "POST /node/69b26c81b0f5558b5d7ce2d5 HTTP/1.0" 202 Accepted 2026-03-14 07:34:27,369 - lava_callback - INFO - Starting async job submit for node 69b26c81b0f5558b5d7ce2d5 2026-03-14 07:34:27,370 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 07:34:27,393 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b26c81b0f5558b5d7ce2d5 HTTP/1.1" 200 None 2026-03-14 07:34:27,395 - lava_callback - DEBUG - Processing node 69b26c81b0f5558b5d7ce2d5: baseline-arm64-baylibre 2026-03-14 07:34:27,395 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b26c81b0f5558b5d7ce2d5 2026-03-14 07:34:27,395 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 07:34:27,413 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b26c81b0f5558b5d7ce2d5 HTTP/1.1" 200 None 2026-03-14 07:34:27,415 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 07:34:27,428 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69af6340275c8d3b79399dc3 HTTP/1.1" 200 None 2026-03-14 07:34:27,429 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 07:34:27,456 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b26c81b0f5558b5d7ce2d5 HTTP/1.1" 200 None 2026-03-14 07:34:27,457 - lava_callback - ERROR - Error processing callback for node 69b26c81b0f5558b5d7ce2d5: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:53512 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53524 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43168 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36536 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50418 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54788 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:54798 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45564 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47460 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47476 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55754 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56800 - "GET / HTTP/1.0" 200 OK 2026-03-14 07:36:03,504 - lava_callback - INFO - Received callback for node 69b26cd4b0f5558b5d7ce2dc INFO: 172.21.0.1:32930 - "POST /node/69b26cd4b0f5558b5d7ce2dc HTTP/1.0" 202 Accepted 2026-03-14 07:36:03,510 - lava_callback - INFO - Starting async job submit for node 69b26cd4b0f5558b5d7ce2dc 2026-03-14 07:36:03,511 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 07:36:03,531 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b26cd4b0f5558b5d7ce2dc HTTP/1.1" 200 None 2026-03-14 07:36:03,532 - lava_callback - DEBUG - Processing node 69b26cd4b0f5558b5d7ce2dc: baseline-arm64-clabbe 2026-03-14 07:36:03,532 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b26cd4b0f5558b5d7ce2dc 2026-03-14 07:36:03,533 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 07:36:03,547 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b26cd4b0f5558b5d7ce2dc HTTP/1.1" 200 None 2026-03-14 07:36:03,549 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 07:36:03,562 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69af6340275c8d3b79399dc3 HTTP/1.1" 200 None 2026-03-14 07:36:03,563 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 07:36:03,584 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b26cd4b0f5558b5d7ce2dc HTTP/1.1" 200 None 2026-03-14 07:36:03,586 - lava_callback - ERROR - Error processing callback for node 69b26cd4b0f5558b5d7ce2dc: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:32946 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55140 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:55144 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58494 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60786 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60802 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50380 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57170 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49820 - "GET / HTTP/1.0" 200 OK 2026-03-14 07:37:07,470 - lava_callback - INFO - Received callback for node 69b26d19b0f5558b5d7ce2eb INFO: 172.21.0.1:49822 - "POST /node/69b26d19b0f5558b5d7ce2eb HTTP/1.0" 202 Accepted 2026-03-14 07:37:07,476 - lava_callback - INFO - Starting async job submit for node 69b26d19b0f5558b5d7ce2eb 2026-03-14 07:37:07,477 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 07:37:07,499 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b26d19b0f5558b5d7ce2eb HTTP/1.1" 200 None 2026-03-14 07:37:07,500 - lava_callback - DEBUG - Processing node 69b26d19b0f5558b5d7ce2eb: baseline-arm64-baylibre 2026-03-14 07:37:07,501 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b26d19b0f5558b5d7ce2eb 2026-03-14 07:37:07,501 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 07:37:07,522 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b26d19b0f5558b5d7ce2eb HTTP/1.1" 200 None 2026-03-14 07:37:07,524 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 07:37:07,537 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69af6340275c8d3b79399dc3 HTTP/1.1" 200 None 2026-03-14 07:37:07,538 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 07:37:07,559 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b26d19b0f5558b5d7ce2eb HTTP/1.1" 200 None 2026-03-14 07:37:07,561 - lava_callback - ERROR - Error processing callback for node 69b26d19b0f5558b5d7ce2eb: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:41830 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:41840 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56896 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37752 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37754 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40380 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44018 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45832 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47350 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:47358 - "GET / HTTP/1.0" 200 OK 2026-03-14 07:38:23,653 - lava_callback - INFO - Received callback for node 69b26d5fb0f5558b5d7ce2f5 INFO: 172.21.0.1:36632 - "POST /node/69b26d5fb0f5558b5d7ce2f5 HTTP/1.0" 202 Accepted 2026-03-14 07:38:23,658 - lava_callback - INFO - Starting async job submit for node 69b26d5fb0f5558b5d7ce2f5 2026-03-14 07:38:23,659 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 07:38:23,694 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b26d5fb0f5558b5d7ce2f5 HTTP/1.1" 200 None 2026-03-14 07:38:23,695 - lava_callback - DEBUG - Processing node 69b26d5fb0f5558b5d7ce2f5: baseline-arm-clabbe 2026-03-14 07:38:23,695 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b26d5fb0f5558b5d7ce2f5 2026-03-14 07:38:23,696 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 07:38:23,711 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b26d5fb0f5558b5d7ce2f5 HTTP/1.1" 200 None 2026-03-14 07:38:23,713 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 07:38:23,727 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69acc009bcd207e915d76b94 HTTP/1.1" 200 None 2026-03-14 07:38:23,728 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 07:38:23,749 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b26d5fb0f5558b5d7ce2f5 HTTP/1.1" 200 None 2026-03-14 07:38:23,755 - lava_callback - ERROR - Error processing callback for node 69b26d5fb0f5558b5d7ce2f5: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:36646 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51110 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51122 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57844 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51502 - "GET / HTTP/1.0" 200 OK 2026-03-14 07:39:03,610 - lava_callback - INFO - Received callback for node 69b26d85b0f5558b5d7ce304 INFO: 172.21.0.1:59804 - "POST /node/69b26d85b0f5558b5d7ce304 HTTP/1.0" 202 Accepted 2026-03-14 07:39:03,616 - lava_callback - INFO - Starting async job submit for node 69b26d85b0f5558b5d7ce304 2026-03-14 07:39:03,617 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 07:39:03,631 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b26d85b0f5558b5d7ce304 HTTP/1.1" 200 None 2026-03-14 07:39:03,632 - lava_callback - DEBUG - Processing node 69b26d85b0f5558b5d7ce304: baseline-arm-clabbe 2026-03-14 07:39:03,632 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b26d85b0f5558b5d7ce304 2026-03-14 07:39:03,633 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 07:39:03,647 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b26d85b0f5558b5d7ce304 HTTP/1.1" 200 None 2026-03-14 07:39:03,648 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 07:39:03,661 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69acc009bcd207e915d76b94 HTTP/1.1" 200 None 2026-03-14 07:39:03,663 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 07:39:03,689 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b26d85b0f5558b5d7ce304 HTTP/1.1" 200 None 2026-03-14 07:39:03,699 - lava_callback - ERROR - Error processing callback for node 69b26d85b0f5558b5d7ce304: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:59812 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49644 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:49652 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55600 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46540 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46544 - "GET / HTTP/1.0" 200 OK 2026-03-14 07:39:43,644 - lava_callback - INFO - Received callback for node 69b26daab0f5558b5d7ce319 INFO: 172.21.0.1:41090 - "POST /node/69b26daab0f5558b5d7ce319 HTTP/1.0" 202 Accepted 2026-03-14 07:39:43,649 - lava_callback - INFO - Starting async job submit for node 69b26daab0f5558b5d7ce319 2026-03-14 07:39:43,650 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 07:39:43,664 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b26daab0f5558b5d7ce319 HTTP/1.1" 200 None 2026-03-14 07:39:43,665 - lava_callback - DEBUG - Processing node 69b26daab0f5558b5d7ce319: baseline-arm-clabbe 2026-03-14 07:39:43,665 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b26daab0f5558b5d7ce319 2026-03-14 07:39:43,666 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 07:39:43,679 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b26daab0f5558b5d7ce319 HTTP/1.1" 200 None 2026-03-14 07:39:43,680 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 07:39:43,693 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69acc009bcd207e915d76b94 HTTP/1.1" 200 None 2026-03-14 07:39:43,694 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 07:39:43,715 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b26daab0f5558b5d7ce319 HTTP/1.1" 200 None 2026-03-14 07:39:43,716 - lava_callback - ERROR - Error processing callback for node 69b26daab0f5558b5d7ce319: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:41098 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43260 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57422 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59936 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:59938 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50952 - "GET / HTTP/1.0" 200 OK 2026-03-14 07:40:27,752 - lava_callback - INFO - Received callback for node 69b26dd6b0f5558b5d7ce32b INFO: 172.21.0.1:50960 - "POST /node/69b26dd6b0f5558b5d7ce32b HTTP/1.0" 202 Accepted 2026-03-14 07:40:27,758 - lava_callback - INFO - Starting async job submit for node 69b26dd6b0f5558b5d7ce32b 2026-03-14 07:40:27,759 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 07:40:27,774 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b26dd6b0f5558b5d7ce32b HTTP/1.1" 200 None 2026-03-14 07:40:27,775 - lava_callback - DEBUG - Processing node 69b26dd6b0f5558b5d7ce32b: baseline-arm64-baylibre 2026-03-14 07:40:27,775 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b26dd6b0f5558b5d7ce32b 2026-03-14 07:40:27,776 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 07:40:27,790 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b26dd6b0f5558b5d7ce32b HTTP/1.1" 200 None 2026-03-14 07:40:27,791 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 07:40:27,806 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69af6340275c8d3b79399dc3 HTTP/1.1" 200 None 2026-03-14 07:40:27,808 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 07:40:27,832 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b26dd6b0f5558b5d7ce32b HTTP/1.1" 200 None 2026-03-14 07:40:27,834 - lava_callback - ERROR - Error processing callback for node 69b26dd6b0f5558b5d7ce32b: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:36002 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36006 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53990 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44918 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53978 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51784 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:51790 - "GET / HTTP/1.0" 200 OK 2026-03-14 07:41:23,727 - lava_callback - INFO - Received callback for node 69b26e1bb0f5558b5d7ce335 INFO: 172.21.0.1:49774 - "POST /node/69b26e1bb0f5558b5d7ce335 HTTP/1.0" 202 Accepted 2026-03-14 07:41:23,732 - lava_callback - INFO - Starting async job submit for node 69b26e1bb0f5558b5d7ce335 2026-03-14 07:41:23,733 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 07:41:23,748 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b26e1bb0f5558b5d7ce335 HTTP/1.1" 200 None 2026-03-14 07:41:23,748 - lava_callback - DEBUG - Processing node 69b26e1bb0f5558b5d7ce335: baseline-arm-clabbe 2026-03-14 07:41:23,749 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b26e1bb0f5558b5d7ce335 2026-03-14 07:41:23,749 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 07:41:23,763 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b26e1bb0f5558b5d7ce335 HTTP/1.1" 200 None 2026-03-14 07:41:23,764 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 07:41:23,777 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69acc009bcd207e915d76b94 HTTP/1.1" 200 None 2026-03-14 07:41:23,779 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 07:41:23,810 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b26e1bb0f5558b5d7ce335 HTTP/1.1" 200 None 2026-03-14 07:41:23,812 - lava_callback - ERROR - Error processing callback for node 69b26e1bb0f5558b5d7ce335: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:49790 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34004 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34006 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49982 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60600 - "GET / HTTP/1.0" 200 OK 2026-03-14 07:42:03,728 - lava_callback - INFO - Received callback for node 69b26e40b0f5558b5d7ce34f INFO: 172.21.0.1:36722 - "POST /node/69b26e40b0f5558b5d7ce34f HTTP/1.0" 202 Accepted 2026-03-14 07:42:03,733 - lava_callback - INFO - Starting async job submit for node 69b26e40b0f5558b5d7ce34f 2026-03-14 07:42:03,735 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 07:42:03,749 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b26e40b0f5558b5d7ce34f HTTP/1.1" 200 None 2026-03-14 07:42:03,750 - lava_callback - DEBUG - Processing node 69b26e40b0f5558b5d7ce34f: baseline-arm-clabbe 2026-03-14 07:42:03,750 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b26e40b0f5558b5d7ce34f 2026-03-14 07:42:03,751 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 07:42:03,764 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b26e40b0f5558b5d7ce34f HTTP/1.1" 200 None 2026-03-14 07:42:03,765 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 07:42:03,778 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69acc009bcd207e915d76b94 HTTP/1.1" 200 None 2026-03-14 07:42:03,780 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 07:42:03,801 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b26e40b0f5558b5d7ce34f HTTP/1.1" 200 None 2026-03-14 07:42:03,808 - lava_callback - ERROR - Error processing callback for node 69b26e40b0f5558b5d7ce34f: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:36736 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59242 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:59244 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43042 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37660 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37676 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51970 - "GET / HTTP/1.0" 200 OK 2026-03-14 07:42:47,819 - lava_callback - INFO - Received callback for node 69b26e6eb0f5558b5d7ce358 INFO: 172.21.0.1:51982 - "POST /node/69b26e6eb0f5558b5d7ce358 HTTP/1.0" 202 Accepted 2026-03-14 07:42:47,824 - lava_callback - INFO - Starting async job submit for node 69b26e6eb0f5558b5d7ce358 2026-03-14 07:42:47,825 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 07:42:47,842 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b26e6eb0f5558b5d7ce358 HTTP/1.1" 200 None 2026-03-14 07:42:47,843 - lava_callback - DEBUG - Processing node 69b26e6eb0f5558b5d7ce358: baseline-arm64-baylibre 2026-03-14 07:42:47,843 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b26e6eb0f5558b5d7ce358 2026-03-14 07:42:47,844 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 07:42:47,856 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b26e6eb0f5558b5d7ce358 HTTP/1.1" 200 None 2026-03-14 07:42:47,858 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 07:42:47,875 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69af6340275c8d3b79399dc3 HTTP/1.1" 200 None 2026-03-14 07:42:47,876 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 07:42:47,906 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b26e6eb0f5558b5d7ce358 HTTP/1.1" 200 None 2026-03-14 07:42:47,908 - lava_callback - ERROR - Error processing callback for node 69b26e6eb0f5558b5d7ce358: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:43136 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42260 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55704 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:55708 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49910 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43926 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43942 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54368 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45242 - "GET / HTTP/1.0" 200 OK 2026-03-14 07:44:03,794 - lava_callback - INFO - Received callback for node 69b26eb2b0f5558b5d7ce365 INFO: 172.21.0.1:48882 - "POST /node/69b26eb2b0f5558b5d7ce365 HTTP/1.0" 202 Accepted 2026-03-14 07:44:03,800 - lava_callback - INFO - Starting async job submit for node 69b26eb2b0f5558b5d7ce365 2026-03-14 07:44:03,801 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 07:44:03,823 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b26eb2b0f5558b5d7ce365 HTTP/1.1" 200 None 2026-03-14 07:44:03,823 - lava_callback - DEBUG - Processing node 69b26eb2b0f5558b5d7ce365: baseline-arm-clabbe 2026-03-14 07:44:03,824 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b26eb2b0f5558b5d7ce365 2026-03-14 07:44:03,824 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 07:44:03,837 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b26eb2b0f5558b5d7ce365 HTTP/1.1" 200 None 2026-03-14 07:44:03,839 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 07:44:03,852 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69acc009bcd207e915d76b94 HTTP/1.1" 200 None 2026-03-14 07:44:03,853 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 07:44:03,874 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b26eb2b0f5558b5d7ce365 HTTP/1.1" 200 None 2026-03-14 07:44:03,879 - lava_callback - ERROR - Error processing callback for node 69b26eb2b0f5558b5d7ce365: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:48884 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49772 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:49774 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59554 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53454 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53460 - "GET / HTTP/1.0" 200 OK 2026-03-14 07:44:43,990 - lava_callback - INFO - Received callback for node 69b26ee5b0f5558b5d7ce37a INFO: 172.21.0.1:51280 - "POST /node/69b26ee5b0f5558b5d7ce37a HTTP/1.0" 202 Accepted 2026-03-14 07:44:43,996 - lava_callback - INFO - Starting async job submit for node 69b26ee5b0f5558b5d7ce37a 2026-03-14 07:44:43,997 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 07:44:44,014 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b26ee5b0f5558b5d7ce37a HTTP/1.1" 200 None 2026-03-14 07:44:44,015 - lava_callback - DEBUG - Processing node 69b26ee5b0f5558b5d7ce37a: baseline-arm64-clabbe 2026-03-14 07:44:44,015 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b26ee5b0f5558b5d7ce37a 2026-03-14 07:44:44,016 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 07:44:44,038 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b26ee5b0f5558b5d7ce37a HTTP/1.1" 200 None 2026-03-14 07:44:44,040 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 07:44:44,054 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69af6340275c8d3b79399dc3 HTTP/1.1" 200 None 2026-03-14 07:44:44,056 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 07:44:44,077 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b26ee5b0f5558b5d7ce37a HTTP/1.1" 200 None 2026-03-14 07:44:44,084 - lava_callback - ERROR - Error processing callback for node 69b26ee5b0f5558b5d7ce37a: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:51288 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37334 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46048 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40240 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:40242 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47252 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37642 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37652 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46142 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60684 - "GET / HTTP/1.0" 200 OK 2026-03-14 07:46:03,951 - lava_callback - INFO - Received callback for node 69b26f31b0f5558b5d7ce38e INFO: 172.21.0.1:58432 - "POST /node/69b26f31b0f5558b5d7ce38e HTTP/1.0" 202 Accepted 2026-03-14 07:46:03,956 - lava_callback - INFO - Starting async job submit for node 69b26f31b0f5558b5d7ce38e 2026-03-14 07:46:03,957 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 07:46:03,973 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b26f31b0f5558b5d7ce38e HTTP/1.1" 200 None 2026-03-14 07:46:03,974 - lava_callback - DEBUG - Processing node 69b26f31b0f5558b5d7ce38e: baseline-arm64-clabbe 2026-03-14 07:46:03,974 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b26f31b0f5558b5d7ce38e 2026-03-14 07:46:03,975 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 07:46:04,002 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b26f31b0f5558b5d7ce38e HTTP/1.1" 200 None 2026-03-14 07:46:04,003 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 07:46:04,039 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69af6340275c8d3b79399dc3 HTTP/1.1" 200 None 2026-03-14 07:46:04,040 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 07:46:04,060 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b26f31b0f5558b5d7ce38e HTTP/1.1" 200 None 2026-03-14 07:46:04,068 - lava_callback - ERROR - Error processing callback for node 69b26f31b0f5558b5d7ce38e: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:58440 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54948 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:54952 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37450 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55206 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55218 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40868 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50462 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45510 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56960 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:56964 - "GET / HTTP/1.0" 200 OK 2026-03-14 07:47:23,958 - lava_callback - INFO - Received callback for node 69b26f7db0f5558b5d7ce398 INFO: 172.21.0.1:59006 - "POST /node/69b26f7db0f5558b5d7ce398 HTTP/1.0" 202 Accepted 2026-03-14 07:47:23,963 - lava_callback - INFO - Starting async job submit for node 69b26f7db0f5558b5d7ce398 2026-03-14 07:47:23,964 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 07:47:23,979 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b26f7db0f5558b5d7ce398 HTTP/1.1" 200 None 2026-03-14 07:47:23,980 - lava_callback - DEBUG - Processing node 69b26f7db0f5558b5d7ce398: baseline-arm64-clabbe 2026-03-14 07:47:23,980 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b26f7db0f5558b5d7ce398 2026-03-14 07:47:23,981 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 07:47:23,995 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b26f7db0f5558b5d7ce398 HTTP/1.1" 200 None 2026-03-14 07:47:23,996 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 07:47:24,018 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69af6340275c8d3b79399dc3 HTTP/1.1" 200 None 2026-03-14 07:47:24,019 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 07:47:24,040 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b26f7db0f5558b5d7ce398 HTTP/1.1" 200 None 2026-03-14 07:47:24,045 - lava_callback - ERROR - Error processing callback for node 69b26f7db0f5558b5d7ce398: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:59010 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50680 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50684 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41326 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55272 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57384 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48260 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:48274 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45276 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34192 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34196 - "GET / HTTP/1.0" 200 OK 2026-03-14 07:48:44,066 - lava_callback - INFO - Received callback for node 69b26fc9b0f5558b5d7ce3ad INFO: 172.21.0.1:46352 - "POST /node/69b26fc9b0f5558b5d7ce3ad HTTP/1.0" 202 Accepted 2026-03-14 07:48:44,072 - lava_callback - INFO - Starting async job submit for node 69b26fc9b0f5558b5d7ce3ad 2026-03-14 07:48:44,073 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 07:48:44,107 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b26fc9b0f5558b5d7ce3ad HTTP/1.1" 200 None 2026-03-14 07:48:44,107 - lava_callback - DEBUG - Processing node 69b26fc9b0f5558b5d7ce3ad: baseline-arm64-clabbe 2026-03-14 07:48:44,108 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b26fc9b0f5558b5d7ce3ad 2026-03-14 07:48:44,108 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 07:48:44,122 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b26fc9b0f5558b5d7ce3ad HTTP/1.1" 200 None 2026-03-14 07:48:44,123 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 07:48:44,136 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69af6340275c8d3b79399dc3 HTTP/1.1" 200 None 2026-03-14 07:48:44,138 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 07:48:44,167 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b26fc9b0f5558b5d7ce3ad HTTP/1.1" 200 None 2026-03-14 07:48:44,174 - lava_callback - ERROR - Error processing callback for node 69b26fc9b0f5558b5d7ce3ad: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:46358 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54778 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58298 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48060 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:48076 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45622 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56448 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56456 - "GET / HTTP/1.0" 200 OK 2026-03-14 07:49:44,111 - lava_callback - INFO - Received callback for node 69b27014b0f5558b5d7ce3b7 INFO: 172.21.0.1:50296 - "POST /node/69b27014b0f5558b5d7ce3b7 HTTP/1.0" 202 Accepted 2026-03-14 07:49:44,116 - lava_callback - INFO - Starting async job submit for node 69b27014b0f5558b5d7ce3b7 2026-03-14 07:49:44,117 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 07:49:44,135 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b27014b0f5558b5d7ce3b7 HTTP/1.1" 200 None 2026-03-14 07:49:44,136 - lava_callback - DEBUG - Processing node 69b27014b0f5558b5d7ce3b7: baseline-arm64-clabbe 2026-03-14 07:49:44,137 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b27014b0f5558b5d7ce3b7 2026-03-14 07:49:44,137 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 07:49:44,151 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b27014b0f5558b5d7ce3b7 HTTP/1.1" 200 None 2026-03-14 07:49:44,153 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 07:49:44,166 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69af6340275c8d3b79399dc3 HTTP/1.1" 200 None 2026-03-14 07:49:44,167 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 07:49:44,189 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b27014b0f5558b5d7ce3b7 HTTP/1.1" 200 None 2026-03-14 07:49:44,198 - lava_callback - ERROR - Error processing callback for node 69b27014b0f5558b5d7ce3b7: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:50302 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40824 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41234 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47122 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:47124 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43638 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43858 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43862 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58144 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45040 - "GET / HTTP/1.0" 200 OK 2026-03-14 07:51:04,110 - lava_callback - INFO - Received callback for node 69b27061b0f5558b5d7ce3d4 INFO: 172.21.0.1:45420 - "POST /node/69b27061b0f5558b5d7ce3d4 HTTP/1.0" 202 Accepted 2026-03-14 07:51:04,115 - lava_callback - INFO - Starting async job submit for node 69b27061b0f5558b5d7ce3d4 2026-03-14 07:51:04,116 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 07:51:04,131 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b27061b0f5558b5d7ce3d4 HTTP/1.1" 200 None 2026-03-14 07:51:04,131 - lava_callback - DEBUG - Processing node 69b27061b0f5558b5d7ce3d4: baseline-arm64-clabbe 2026-03-14 07:51:04,132 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b27061b0f5558b5d7ce3d4 2026-03-14 07:51:04,132 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 07:51:04,145 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b27061b0f5558b5d7ce3d4 HTTP/1.1" 200 None 2026-03-14 07:51:04,147 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 07:51:04,160 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69af6340275c8d3b79399dc3 HTTP/1.1" 200 None 2026-03-14 07:51:04,161 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 07:51:04,182 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b27061b0f5558b5d7ce3d4 HTTP/1.1" 200 None 2026-03-14 07:51:04,183 - lava_callback - ERROR - Error processing callback for node 69b27061b0f5558b5d7ce3d4: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:45424 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49416 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:49430 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56286 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59978 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59992 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52518 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55530 - "GET / HTTP/1.0" 200 OK 2026-03-14 07:52:04,166 - lava_callback - INFO - Received callback for node 69b2709fb0f5558b5d7ce3de INFO: 172.21.0.1:35804 - "POST /node/69b2709fb0f5558b5d7ce3de HTTP/1.0" 202 Accepted 2026-03-14 07:52:04,172 - lava_callback - INFO - Starting async job submit for node 69b2709fb0f5558b5d7ce3de 2026-03-14 07:52:04,173 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 07:52:04,187 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b2709fb0f5558b5d7ce3de HTTP/1.1" 200 None 2026-03-14 07:52:04,188 - lava_callback - DEBUG - Processing node 69b2709fb0f5558b5d7ce3de: baseline-arm-clabbe 2026-03-14 07:52:04,188 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b2709fb0f5558b5d7ce3de 2026-03-14 07:52:04,189 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 07:52:04,206 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b2709fb0f5558b5d7ce3de HTTP/1.1" 200 None 2026-03-14 07:52:04,207 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 07:52:04,225 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69acc009bcd207e915d76b94 HTTP/1.1" 200 None 2026-03-14 07:52:04,226 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 07:52:04,247 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b2709fb0f5558b5d7ce3de HTTP/1.1" 200 None 2026-03-14 07:52:04,255 - lava_callback - ERROR - Error processing callback for node 69b2709fb0f5558b5d7ce3de: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:35820 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54902 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:54910 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45244 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47894 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47900 - "GET / HTTP/1.0" 200 OK 2026-03-14 07:52:44,218 - lava_callback - INFO - Received callback for node 69b270c4b0f5558b5d7ce3ed INFO: 172.21.0.1:39582 - "POST /node/69b270c4b0f5558b5d7ce3ed HTTP/1.0" 202 Accepted 2026-03-14 07:52:44,224 - lava_callback - INFO - Starting async job submit for node 69b270c4b0f5558b5d7ce3ed 2026-03-14 07:52:44,225 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 07:52:44,239 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b270c4b0f5558b5d7ce3ed HTTP/1.1" 200 None 2026-03-14 07:52:44,240 - lava_callback - DEBUG - Processing node 69b270c4b0f5558b5d7ce3ed: baseline-arm-clabbe 2026-03-14 07:52:44,240 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b270c4b0f5558b5d7ce3ed 2026-03-14 07:52:44,240 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 07:52:44,255 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b270c4b0f5558b5d7ce3ed HTTP/1.1" 200 None 2026-03-14 07:52:44,257 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 07:52:44,271 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69acc009bcd207e915d76b94 HTTP/1.1" 200 None 2026-03-14 07:52:44,273 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 07:52:44,294 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b270c4b0f5558b5d7ce3ed HTTP/1.1" 200 None 2026-03-14 07:52:44,300 - lava_callback - ERROR - Error processing callback for node 69b270c4b0f5558b5d7ce3ed: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:39598 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60464 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60476 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60484 - "GET /favicon.ico HTTP/1.0" 404 Not Found INFO: 172.21.0.1:60492 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56384 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56388 - "GET /login HTTP/1.0" 404 Not Found INFO: 172.21.0.1:43384 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:43398 - "GET / HTTP/1.0" 200 OK 2026-03-14 07:53:24,248 - lava_callback - INFO - Received callback for node 69b270e9b0f5558b5d7ce3fc INFO: 172.21.0.1:36850 - "POST /node/69b270e9b0f5558b5d7ce3fc HTTP/1.0" 202 Accepted 2026-03-14 07:53:24,254 - lava_callback - INFO - Starting async job submit for node 69b270e9b0f5558b5d7ce3fc 2026-03-14 07:53:24,254 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 07:53:24,273 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b270e9b0f5558b5d7ce3fc HTTP/1.1" 200 None 2026-03-14 07:53:24,274 - lava_callback - DEBUG - Processing node 69b270e9b0f5558b5d7ce3fc: baseline-arm-clabbe 2026-03-14 07:53:24,274 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b270e9b0f5558b5d7ce3fc 2026-03-14 07:53:24,275 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 07:53:24,289 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b270e9b0f5558b5d7ce3fc HTTP/1.1" 200 None 2026-03-14 07:53:24,290 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 07:53:24,309 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69acc009bcd207e915d76b94 HTTP/1.1" 200 None 2026-03-14 07:53:24,310 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 07:53:24,331 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b270e9b0f5558b5d7ce3fc HTTP/1.1" 200 None 2026-03-14 07:53:24,332 - lava_callback - ERROR - Error processing callback for node 69b270e9b0f5558b5d7ce3fc: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:36858 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42484 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42492 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50168 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45070 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49306 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42292 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:42298 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40424 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55566 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55582 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44792 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39698 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48012 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51876 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:51890 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38454 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54818 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54828 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33366 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43808 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34196 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48072 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:48074 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49364 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57584 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57594 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46610 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49604 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59894 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59280 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:59294 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50534 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48572 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48574 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38270 - "GET / HTTP/1.0" 200 OK 2026-03-14 07:57:48,658 - lava_callback - INFO - Received callback for node 69b271f5b0f5558b5d7ce427 INFO: 172.21.0.1:38272 - "POST /node/69b271f5b0f5558b5d7ce427 HTTP/1.0" 202 Accepted 2026-03-14 07:57:48,663 - lava_callback - INFO - Starting async job submit for node 69b271f5b0f5558b5d7ce427 2026-03-14 07:57:48,664 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 07:57:48,679 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b271f5b0f5558b5d7ce427 HTTP/1.1" 200 None 2026-03-14 07:57:48,680 - lava_callback - DEBUG - Processing node 69b271f5b0f5558b5d7ce427: baseline-arm64-baylibre 2026-03-14 07:57:48,680 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b271f5b0f5558b5d7ce427 2026-03-14 07:57:48,681 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 07:57:48,694 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b271f5b0f5558b5d7ce427 HTTP/1.1" 200 None 2026-03-14 07:57:48,695 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 07:57:48,708 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69acc01dbcd207e915d76ba7 HTTP/1.1" 200 None 2026-03-14 07:57:48,710 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 07:57:48,731 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b271f5b0f5558b5d7ce427 HTTP/1.1" 200 None 2026-03-14 07:57:48,740 - lava_callback - ERROR - Error processing callback for node 69b271f5b0f5558b5d7ce427: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:35934 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44164 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60048 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60062 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:60074 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47254 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51520 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51530 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44880 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43976 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52712 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43326 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:43330 - "GET / HTTP/1.0" 200 OK 2026-03-14 07:59:24,721 - lava_callback - INFO - Received callback for node 69b27246b0f5558b5d7ce438 INFO: 172.21.0.1:52622 - "POST /node/69b27246b0f5558b5d7ce438 HTTP/1.0" 202 Accepted 2026-03-14 07:59:24,727 - lava_callback - INFO - Starting async job submit for node 69b27246b0f5558b5d7ce438 2026-03-14 07:59:24,728 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 07:59:24,743 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b27246b0f5558b5d7ce438 HTTP/1.1" 200 None 2026-03-14 07:59:24,744 - lava_callback - DEBUG - Processing node 69b27246b0f5558b5d7ce438: baseline-arm64-clabbe 2026-03-14 07:59:24,744 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b27246b0f5558b5d7ce438 2026-03-14 07:59:24,745 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 07:59:24,760 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b27246b0f5558b5d7ce438 HTTP/1.1" 200 None 2026-03-14 07:59:24,762 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 07:59:24,777 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69acc01dbcd207e915d76ba7 HTTP/1.1" 200 None 2026-03-14 07:59:24,778 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 07:59:24,800 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b27246b0f5558b5d7ce438 HTTP/1.1" 200 None 2026-03-14 07:59:24,805 - lava_callback - ERROR - Error processing callback for node 69b27246b0f5558b5d7ce438: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:52634 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50954 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50964 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43566 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48306 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55454 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53870 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:53874 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47230 - "GET /favicon.ico HTTP/1.0" 404 Not Found INFO: 172.21.0.1:47244 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52956 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52970 - "GET / HTTP/1.0" 200 OK 2026-03-14 08:00:44,790 - lava_callback - INFO - Received callback for node 69b2729eb0f5558b5d7ce44c INFO: 172.21.0.1:60726 - "POST /node/69b2729eb0f5558b5d7ce44c HTTP/1.0" 202 Accepted 2026-03-14 08:00:44,797 - lava_callback - INFO - Starting async job submit for node 69b2729eb0f5558b5d7ce44c 2026-03-14 08:00:44,798 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 08:00:44,811 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b2729eb0f5558b5d7ce44c HTTP/1.1" 200 None 2026-03-14 08:00:44,812 - lava_callback - DEBUG - Processing node 69b2729eb0f5558b5d7ce44c: baseline-arm64-clabbe 2026-03-14 08:00:44,812 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b2729eb0f5558b5d7ce44c 2026-03-14 08:00:44,813 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 08:00:44,828 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b2729eb0f5558b5d7ce44c HTTP/1.1" 200 None 2026-03-14 08:00:44,830 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 08:00:44,843 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69acc01dbcd207e915d76ba7 HTTP/1.1" 200 None 2026-03-14 08:00:44,844 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 08:00:44,865 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b2729eb0f5558b5d7ce44c HTTP/1.1" 200 None 2026-03-14 08:00:44,871 - lava_callback - ERROR - Error processing callback for node 69b2729eb0f5558b5d7ce44c: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:60732 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54606 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40796 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47570 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:47576 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37192 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42014 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42020 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59632 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42812 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48194 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34360 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:34362 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46460 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37432 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37446 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38368 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34034 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44106 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39704 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:39708 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46408 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38556 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38562 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48682 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49504 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58378 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49826 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:49842 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47936 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43894 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43896 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59840 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55760 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:32960 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37490 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:37506 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50564 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43430 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43442 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43370 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34696 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46530 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41764 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:41776 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41204 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56126 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56134 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47588 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59860 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40888 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36380 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:36394 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54044 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39088 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39102 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41962 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48102 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48718 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56270 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:56286 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38202 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43962 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43966 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39948 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36386 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39868 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52306 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:52322 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37296 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33740 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33752 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42436 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47534 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54956 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40554 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:40556 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42282 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35258 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35268 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54384 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45924 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38772 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33150 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:33160 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40082 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47768 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47776 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43370 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39650 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41914 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49788 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:49794 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52616 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37966 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37970 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56354 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57700 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41138 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34850 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:34856 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39336 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34216 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34228 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57098 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45054 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51886 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53966 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:53976 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52754 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33266 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33278 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53178 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48054 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54666 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52618 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:52632 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41182 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42860 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42862 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54032 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37176 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33934 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59554 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:59568 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46206 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59786 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59802 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51822 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37716 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57660 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56630 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:56632 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34556 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48052 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48064 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46940 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39726 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55346 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38238 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:38254 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49008 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42756 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42760 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60916 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35430 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34288 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39986 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:40002 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41622 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42468 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42484 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34966 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40970 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55416 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41448 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:41452 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52756 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41418 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41420 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60982 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56784 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53074 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45532 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:45538 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36018 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44306 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44310 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58412 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37872 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60866 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37916 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:37932 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48602 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38200 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38212 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59086 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53200 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57562 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58770 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:58782 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36702 - "GET / HTTP/1.0" 200 OK 2026-03-14 08:23:30,293 - lava_callback - INFO - Received callback for node 69b277fe4bce73bcf0233d5b INFO: 172.21.0.1:50392 - "POST /node/69b277fe4bce73bcf0233d5b HTTP/1.0" 202 Accepted 2026-03-14 08:23:30,298 - lava_callback - INFO - Starting async job submit for node 69b277fe4bce73bcf0233d5b 2026-03-14 08:23:30,299 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 08:23:30,314 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b277fe4bce73bcf0233d5b HTTP/1.1" 200 None 2026-03-14 08:23:30,314 - lava_callback - DEBUG - Processing node 69b277fe4bce73bcf0233d5b: baseline-arm64-baylibre 2026-03-14 08:23:30,315 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b277fe4bce73bcf0233d5b 2026-03-14 08:23:30,315 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 08:23:30,328 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b277fe4bce73bcf0233d5b HTTP/1.1" 200 None 2026-03-14 08:23:30,330 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 08:23:30,343 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69acc01dbcd207e915d76ba7 HTTP/1.1" 200 None 2026-03-14 08:23:30,345 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 08:23:30,366 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b277fe4bce73bcf0233d5b HTTP/1.1" 200 None 2026-03-14 08:23:30,368 - lava_callback - ERROR - Error processing callback for node 69b277fe4bce73bcf0233d5b: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:50408 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50422 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36950 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57412 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39320 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55642 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:55646 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35628 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46086 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46088 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50064 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35524 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46866 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58868 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:58870 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43686 - "GET / HTTP/1.0" 200 OK 2026-03-14 08:25:30,051 - lava_callback - INFO - Received callback for node 69b278764bce73bcf0233d6c INFO: 172.21.0.1:54970 - "POST /node/69b278764bce73bcf0233d6c HTTP/1.0" 202 Accepted 2026-03-14 08:25:30,057 - lava_callback - INFO - Starting async job submit for node 69b278764bce73bcf0233d6c 2026-03-14 08:25:30,057 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 08:25:30,072 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b278764bce73bcf0233d6c HTTP/1.1" 200 None 2026-03-14 08:25:30,073 - lava_callback - DEBUG - Processing node 69b278764bce73bcf0233d6c: baseline-arm64-baylibre 2026-03-14 08:25:30,073 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b278764bce73bcf0233d6c 2026-03-14 08:25:30,073 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 08:25:30,112 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b278764bce73bcf0233d6c HTTP/1.1" 200 None 2026-03-14 08:25:30,114 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 08:25:30,128 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69acc01dbcd207e915d76ba7 HTTP/1.1" 200 None 2026-03-14 08:25:30,129 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 08:25:30,157 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b278764bce73bcf0233d6c HTTP/1.1" 200 None 2026-03-14 08:25:30,158 - lava_callback - ERROR - Error processing callback for node 69b278764bce73bcf0233d6c: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:54974 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54978 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38996 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54262 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38030 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39196 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:39208 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49786 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55326 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55340 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58200 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33202 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41750 - "GET / HTTP/1.0" 200 OK 2026-03-14 08:27:10,141 - lava_callback - INFO - Received callback for node 69b278c74bce73bcf0233d7e INFO: 172.21.0.1:49736 - "POST /node/69b278c74bce73bcf0233d7e HTTP/1.0" 202 Accepted 2026-03-14 08:27:10,147 - lava_callback - INFO - Starting async job submit for node 69b278c74bce73bcf0233d7e 2026-03-14 08:27:10,148 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 08:27:10,162 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b278c74bce73bcf0233d7e HTTP/1.1" 200 None 2026-03-14 08:27:10,163 - lava_callback - DEBUG - Processing node 69b278c74bce73bcf0233d7e: baseline-arm64-baylibre 2026-03-14 08:27:10,163 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b278c74bce73bcf0233d7e 2026-03-14 08:27:10,164 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 08:27:10,179 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b278c74bce73bcf0233d7e HTTP/1.1" 200 None 2026-03-14 08:27:10,181 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 08:27:10,194 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69acc01dbcd207e915d76ba7 HTTP/1.1" 200 None 2026-03-14 08:27:10,195 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 08:27:10,215 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b278c74bce73bcf0233d7e HTTP/1.1" 200 None 2026-03-14 08:27:10,221 - lava_callback - ERROR - Error processing callback for node 69b278c74bce73bcf0233d7e: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:49752 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:49766 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52626 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45426 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45438 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50686 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43354 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53092 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47086 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:47088 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38096 - "GET / HTTP/1.0" 200 OK 2026-03-14 08:28:30,276 - lava_callback - INFO - Received callback for node 69b279184bce73bcf0233d92 INFO: 172.21.0.1:57372 - "POST /node/69b279184bce73bcf0233d92 HTTP/1.0" 202 Accepted 2026-03-14 08:28:30,281 - lava_callback - INFO - Starting async job submit for node 69b279184bce73bcf0233d92 2026-03-14 08:28:30,283 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 08:28:30,297 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b279184bce73bcf0233d92 HTTP/1.1" 200 None 2026-03-14 08:28:30,298 - lava_callback - DEBUG - Processing node 69b279184bce73bcf0233d92: baseline-arm64-baylibre 2026-03-14 08:28:30,298 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b279184bce73bcf0233d92 2026-03-14 08:28:30,298 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 08:28:30,312 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b279184bce73bcf0233d92 HTTP/1.1" 200 None 2026-03-14 08:28:30,313 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 08:28:30,325 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69acc01dbcd207e915d76ba7 HTTP/1.1" 200 None 2026-03-14 08:28:30,327 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 08:28:30,348 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b279184bce73bcf0233d92 HTTP/1.1" 200 None 2026-03-14 08:28:30,354 - lava_callback - ERROR - Error processing callback for node 69b279184bce73bcf0233d92: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:57386 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57388 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43488 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38176 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54694 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58506 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:58512 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50226 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59202 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59216 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37384 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33092 - "GET / HTTP/1.0" 200 OK 2026-03-14 08:30:05,965 - lava_callback - INFO - Received callback for node 69b279794bce73bcf0233dab INFO: 172.21.0.1:39822 - "POST /node/69b279794bce73bcf0233dab HTTP/1.0" 202 Accepted 2026-03-14 08:30:05,970 - lava_callback - INFO - Starting async job submit for node 69b279794bce73bcf0233dab 2026-03-14 08:30:05,971 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 08:30:05,986 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b279794bce73bcf0233dab HTTP/1.1" 200 None 2026-03-14 08:30:05,986 - lava_callback - DEBUG - Processing node 69b279794bce73bcf0233dab: baseline-arm64-clabbe 2026-03-14 08:30:05,987 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b279794bce73bcf0233dab 2026-03-14 08:30:05,987 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 08:30:06,000 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b279794bce73bcf0233dab HTTP/1.1" 200 None 2026-03-14 08:30:06,002 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 08:30:06,015 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69acc01dbcd207e915d76ba7 HTTP/1.1" 200 None 2026-03-14 08:30:06,017 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 08:30:06,043 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b279794bce73bcf0233dab HTTP/1.1" 200 None 2026-03-14 08:30:06,044 - lava_callback - ERROR - Error processing callback for node 69b279794bce73bcf0233dab: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:39826 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50168 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:50174 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40178 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53142 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53146 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43288 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44602 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39396 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41450 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:41458 - "GET / HTTP/1.0" 200 OK 2026-03-14 08:31:25,962 - lava_callback - INFO - Received callback for node 69b279c84bce73bcf0233db9 INFO: 172.21.0.1:44800 - "POST /node/69b279c84bce73bcf0233db9 HTTP/1.0" 202 Accepted 2026-03-14 08:31:25,967 - lava_callback - INFO - Starting async job submit for node 69b279c84bce73bcf0233db9 2026-03-14 08:31:25,968 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 08:31:25,983 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b279c84bce73bcf0233db9 HTTP/1.1" 200 None 2026-03-14 08:31:25,984 - lava_callback - DEBUG - Processing node 69b279c84bce73bcf0233db9: baseline-arm64-clabbe 2026-03-14 08:31:25,984 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b279c84bce73bcf0233db9 2026-03-14 08:31:25,984 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 08:31:26,003 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b279c84bce73bcf0233db9 HTTP/1.1" 200 None 2026-03-14 08:31:26,005 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 08:31:26,019 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69acc01dbcd207e915d76ba7 HTTP/1.1" 200 None 2026-03-14 08:31:26,021 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 08:31:26,046 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b279c84bce73bcf0233db9 HTTP/1.1" 200 None 2026-03-14 08:31:26,052 - lava_callback - ERROR - Error processing callback for node 69b279c84bce73bcf0233db9: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:44808 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43920 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43930 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44174 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37592 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35214 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45280 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:45292 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40548 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47274 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47278 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41980 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54588 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60148 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35788 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:35804 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56922 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57918 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57922 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59522 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58198 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54794 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46176 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:46182 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45234 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40578 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40582 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39630 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45158 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46356 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41668 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:41682 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59646 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51240 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51248 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59836 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37958 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33588 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54604 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:54618 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58114 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46130 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46142 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48454 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54192 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38392 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49760 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:49776 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37570 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51134 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51138 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54784 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46046 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37186 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53952 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:53962 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51880 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56528 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56534 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36912 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41322 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53466 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35476 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:35480 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47786 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33276 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33292 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43666 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49072 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55206 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51786 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:51802 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50088 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53008 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53020 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45516 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38638 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56448 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49172 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:49180 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42076 - "GET / HTTP/1.0" 200 OK 2026-03-14 08:41:31,248 - lava_callback - INFO - Received callback for node 69b27c374bce73bcf0233df2 INFO: 172.21.0.1:60940 - "POST /node/69b27c374bce73bcf0233df2 HTTP/1.0" 202 Accepted 2026-03-14 08:41:31,254 - lava_callback - INFO - Starting async job submit for node 69b27c374bce73bcf0233df2 2026-03-14 08:41:31,255 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 08:41:31,269 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b27c374bce73bcf0233df2 HTTP/1.1" 200 None 2026-03-14 08:41:31,270 - lava_callback - DEBUG - Processing node 69b27c374bce73bcf0233df2: baseline-arm-baylibre 2026-03-14 08:41:31,270 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b27c374bce73bcf0233df2 2026-03-14 08:41:31,271 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 08:41:31,314 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b27c374bce73bcf0233df2 HTTP/1.1" 200 None 2026-03-14 08:41:31,316 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 08:41:31,329 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aa8de776ddd5d9e606d488 HTTP/1.1" 200 None 2026-03-14 08:41:31,330 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 08:41:31,350 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b27c374bce73bcf0233df2 HTTP/1.1" 200 None 2026-03-14 08:41:31,351 - lava_callback - ERROR - Error processing callback for node 69b27c374bce73bcf0233df2: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:60950 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60956 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53540 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36462 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49464 - "GET / HTTP/1.0" 200 OK 2026-03-14 08:42:10,920 - lava_callback - INFO - Received callback for node 69b27c5b4bce73bcf0233e02 INFO: 172.21.0.1:48874 - "POST /node/69b27c5b4bce73bcf0233e02 HTTP/1.0" 202 Accepted 2026-03-14 08:42:10,925 - lava_callback - INFO - Starting async job submit for node 69b27c5b4bce73bcf0233e02 2026-03-14 08:42:10,926 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 08:42:10,940 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b27c5b4bce73bcf0233e02 HTTP/1.1" 200 None 2026-03-14 08:42:10,941 - lava_callback - DEBUG - Processing node 69b27c5b4bce73bcf0233e02: baseline-arm-baylibre 2026-03-14 08:42:10,941 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b27c5b4bce73bcf0233e02 2026-03-14 08:42:10,942 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 08:42:10,956 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b27c5b4bce73bcf0233e02 HTTP/1.1" 200 None 2026-03-14 08:42:10,957 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 08:42:10,979 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aa8de776ddd5d9e606d488 HTTP/1.1" 200 None 2026-03-14 08:42:10,980 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 08:42:11,007 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b27c5b4bce73bcf0233e02 HTTP/1.1" 200 None 2026-03-14 08:42:11,009 - lava_callback - ERROR - Error processing callback for node 69b27c5b4bce73bcf0233e02: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:48884 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:48898 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38638 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47612 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47616 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46182 - "GET / HTTP/1.0" 200 OK 2026-03-14 08:42:50,997 - lava_callback - INFO - Received callback for node 69b27c854bce73bcf0233e17 INFO: 172.21.0.1:41928 - "POST /node/69b27c854bce73bcf0233e17 HTTP/1.0" 202 Accepted 2026-03-14 08:42:51,004 - lava_callback - INFO - Starting async job submit for node 69b27c854bce73bcf0233e17 2026-03-14 08:42:51,005 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 08:42:51,020 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b27c854bce73bcf0233e17 HTTP/1.1" 200 None 2026-03-14 08:42:51,021 - lava_callback - DEBUG - Processing node 69b27c854bce73bcf0233e17: baseline-arm-baylibre 2026-03-14 08:42:51,021 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b27c854bce73bcf0233e17 2026-03-14 08:42:51,022 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 08:42:51,041 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b27c854bce73bcf0233e17 HTTP/1.1" 200 None 2026-03-14 08:42:51,043 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 08:42:51,057 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aa8de776ddd5d9e606d488 HTTP/1.1" 200 None 2026-03-14 08:42:51,058 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 08:42:51,079 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b27c854bce73bcf0233e17 HTTP/1.1" 200 None 2026-03-14 08:42:51,085 - lava_callback - ERROR - Error processing callback for node 69b27c854bce73bcf0233e17: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:41944 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40062 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33660 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:33676 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59864 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57944 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57958 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43574 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45546 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59920 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52998 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:53004 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35930 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49542 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49558 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45630 - "GET / HTTP/1.0" 200 OK 2026-03-14 08:44:51,099 - lava_callback - INFO - Received callback for node 69b27cf54bce73bcf02341d5 INFO: 172.21.0.1:50668 - "POST /node/69b27cf54bce73bcf02341d5 HTTP/1.0" 202 Accepted 2026-03-14 08:44:51,105 - lava_callback - INFO - Starting async job submit for node 69b27cf54bce73bcf02341d5 2026-03-14 08:44:51,106 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 08:44:51,121 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b27cf54bce73bcf02341d5 HTTP/1.1" 200 None 2026-03-14 08:44:51,122 - lava_callback - DEBUG - Processing node 69b27cf54bce73bcf02341d5: baseline-arm-baylibre 2026-03-14 08:44:51,122 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b27cf54bce73bcf02341d5 2026-03-14 08:44:51,123 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 08:44:51,145 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b27cf54bce73bcf02341d5 HTTP/1.1" 200 None 2026-03-14 08:44:51,147 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 08:44:51,160 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aa8de776ddd5d9e606d488 HTTP/1.1" 200 None 2026-03-14 08:44:51,162 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 08:44:51,183 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b27cf54bce73bcf02341d5 HTTP/1.1" 200 None 2026-03-14 08:44:51,185 - lava_callback - ERROR - Error processing callback for node 69b27cf54bce73bcf02341d5: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:50678 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51652 - "GET / HTTP/1.0" 200 OK 2026-03-14 08:45:11,068 - lava_callback - INFO - Received callback for node 69b27d0e4bce73bcf02341fa INFO: 172.21.0.1:40828 - "POST /node/69b27d0e4bce73bcf02341fa HTTP/1.0" 202 Accepted 2026-03-14 08:45:11,073 - lava_callback - INFO - Starting async job submit for node 69b27d0e4bce73bcf02341fa 2026-03-14 08:45:11,074 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 08:45:11,094 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b27d0e4bce73bcf02341fa HTTP/1.1" 200 None 2026-03-14 08:45:11,095 - lava_callback - DEBUG - Processing node 69b27d0e4bce73bcf02341fa: baseline-arm-baylibre 2026-03-14 08:45:11,096 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b27d0e4bce73bcf02341fa 2026-03-14 08:45:11,096 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 08:45:11,109 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b27d0e4bce73bcf02341fa HTTP/1.1" 200 None 2026-03-14 08:45:11,111 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 08:45:11,124 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b276654bce73bcf0233d14 HTTP/1.1" 200 None 2026-03-14 08:45:11,125 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 08:45:11,145 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b27d0e4bce73bcf02341fa HTTP/1.1" 200 None 2026-03-14 08:45:11,153 - lava_callback - ERROR - Error processing callback for node 69b27d0e4bce73bcf02341fa: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:40844 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:40858 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34062 - "GET / HTTP/1.0" 200 OK 2026-03-14 08:45:26,513 - lava_callback - INFO - Received callback for node 69b27d154bce73bcf0234230 INFO: 172.21.0.1:34078 - "POST /node/69b27d154bce73bcf0234230 HTTP/1.0" 202 Accepted 2026-03-14 08:45:26,518 - lava_callback - INFO - Starting async job submit for node 69b27d154bce73bcf0234230 2026-03-14 08:45:26,519 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 08:45:26,533 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b27d154bce73bcf0234230 HTTP/1.1" 200 None 2026-03-14 08:45:26,533 - lava_callback - DEBUG - Processing node 69b27d154bce73bcf0234230: baseline-arm-clabbe 2026-03-14 08:45:26,534 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b27d154bce73bcf0234230 2026-03-14 08:45:26,534 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 08:45:26,547 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b27d154bce73bcf0234230 HTTP/1.1" 200 None 2026-03-14 08:45:26,548 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 08:45:26,562 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b276654bce73bcf0233d14 HTTP/1.1" 200 None 2026-03-14 08:45:26,563 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 08:45:26,584 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b27d154bce73bcf0234230 HTTP/1.1" 200 None 2026-03-14 08:45:26,586 - lava_callback - ERROR - Error processing callback for node 69b27d154bce73bcf0234230: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' 2026-03-14 08:45:27,171 - lava_callback - INFO - Received callback for node 69b27d1a4bce73bcf023423e INFO: 172.21.0.1:34092 - "POST /node/69b27d1a4bce73bcf023423e HTTP/1.0" 202 Accepted 2026-03-14 08:45:27,177 - lava_callback - INFO - Starting async job submit for node 69b27d1a4bce73bcf023423e 2026-03-14 08:45:27,178 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 08:45:27,192 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b27d1a4bce73bcf023423e HTTP/1.1" 200 None 2026-03-14 08:45:27,193 - lava_callback - DEBUG - Processing node 69b27d1a4bce73bcf023423e: baseline-arm-clabbe 2026-03-14 08:45:27,193 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b27d1a4bce73bcf023423e 2026-03-14 08:45:27,194 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 08:45:27,207 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b27d1a4bce73bcf023423e HTTP/1.1" 200 None 2026-03-14 08:45:27,208 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 08:45:27,222 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b276654bce73bcf0233d14 HTTP/1.1" 200 None 2026-03-14 08:45:27,223 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 08:45:27,243 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b27d1a4bce73bcf023423e HTTP/1.1" 200 None 2026-03-14 08:45:27,245 - lava_callback - ERROR - Error processing callback for node 69b27d1a4bce73bcf023423e: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' 2026-03-14 08:45:27,828 - lava_callback - INFO - Received callback for node 69b27d1a4bce73bcf0234241 INFO: 172.21.0.1:34098 - "POST /node/69b27d1a4bce73bcf0234241 HTTP/1.0" 202 Accepted 2026-03-14 08:45:27,834 - lava_callback - INFO - Starting async job submit for node 69b27d1a4bce73bcf0234241 2026-03-14 08:45:27,834 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 08:45:27,848 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b27d1a4bce73bcf0234241 HTTP/1.1" 200 None 2026-03-14 08:45:27,849 - lava_callback - DEBUG - Processing node 69b27d1a4bce73bcf0234241: baseline-arm-clabbe 2026-03-14 08:45:27,850 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b27d1a4bce73bcf0234241 2026-03-14 08:45:27,850 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 08:45:27,863 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b27d1a4bce73bcf0234241 HTTP/1.1" 200 None 2026-03-14 08:45:27,865 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 08:45:27,878 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b276654bce73bcf0233d14 HTTP/1.1" 200 None 2026-03-14 08:45:27,880 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 08:45:27,899 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b27d1a4bce73bcf0234241 HTTP/1.1" 200 None 2026-03-14 08:45:27,901 - lava_callback - ERROR - Error processing callback for node 69b27d1a4bce73bcf0234241: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' 2026-03-14 08:45:28,489 - lava_callback - INFO - Received callback for node 69b27d1b4bce73bcf0234244 INFO: 172.21.0.1:34112 - "POST /node/69b27d1b4bce73bcf0234244 HTTP/1.0" 202 Accepted 2026-03-14 08:45:28,494 - lava_callback - INFO - Starting async job submit for node 69b27d1b4bce73bcf0234244 2026-03-14 08:45:28,495 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 08:45:28,509 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b27d1b4bce73bcf0234244 HTTP/1.1" 200 None 2026-03-14 08:45:28,510 - lava_callback - DEBUG - Processing node 69b27d1b4bce73bcf0234244: baseline-arm-clabbe 2026-03-14 08:45:28,510 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b27d1b4bce73bcf0234244 2026-03-14 08:45:28,511 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 08:45:28,524 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b27d1b4bce73bcf0234244 HTTP/1.1" 200 None 2026-03-14 08:45:28,525 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 08:45:28,539 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b276654bce73bcf0233d14 HTTP/1.1" 200 None 2026-03-14 08:45:28,540 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 08:45:28,561 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b27d1b4bce73bcf0234244 HTTP/1.1" 200 None 2026-03-14 08:45:28,566 - lava_callback - ERROR - Error processing callback for node 69b27d1b4bce73bcf0234244: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' 2026-03-14 08:45:29,148 - lava_callback - INFO - Received callback for node 69b27d1e4bce73bcf023424d INFO: 172.21.0.1:34128 - "POST /node/69b27d1e4bce73bcf023424d HTTP/1.0" 202 Accepted 2026-03-14 08:45:29,153 - lava_callback - INFO - Starting async job submit for node 69b27d1e4bce73bcf023424d 2026-03-14 08:45:29,154 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 08:45:29,169 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b27d1e4bce73bcf023424d HTTP/1.1" 200 None 2026-03-14 08:45:29,170 - lava_callback - DEBUG - Processing node 69b27d1e4bce73bcf023424d: baseline-arm-clabbe 2026-03-14 08:45:29,170 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b27d1e4bce73bcf023424d 2026-03-14 08:45:29,170 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 08:45:29,184 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b27d1e4bce73bcf023424d HTTP/1.1" 200 None 2026-03-14 08:45:29,185 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 08:45:29,199 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b276654bce73bcf0233d14 HTTP/1.1" 200 None 2026-03-14 08:45:29,201 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 08:45:29,221 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b27d1e4bce73bcf023424d HTTP/1.1" 200 None 2026-03-14 08:45:29,222 - lava_callback - ERROR - Error processing callback for node 69b27d1e4bce73bcf023424d: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:33752 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33760 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33376 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37472 - "GET / HTTP/1.0" 200 OK 2026-03-14 08:46:06,503 - lava_callback - INFO - Received callback for node 69b27d404bce73bcf02342ad INFO: 172.21.0.1:58252 - "POST /node/69b27d404bce73bcf02342ad HTTP/1.0" 202 Accepted 2026-03-14 08:46:06,509 - lava_callback - INFO - Starting async job submit for node 69b27d404bce73bcf02342ad 2026-03-14 08:46:06,510 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 INFO: 172.21.0.1:58260 - "GET / HTTP/1.0" 200 OK 2026-03-14 08:46:06,525 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b27d404bce73bcf02342ad HTTP/1.1" 200 None 2026-03-14 08:46:06,526 - lava_callback - DEBUG - Processing node 69b27d404bce73bcf02342ad: baseline-arm-clabbe 2026-03-14 08:46:06,526 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b27d404bce73bcf02342ad 2026-03-14 08:46:06,526 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 08:46:06,540 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b27d404bce73bcf02342ad HTTP/1.1" 200 None 2026-03-14 08:46:06,542 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 08:46:06,555 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aa8de776ddd5d9e606d488 HTTP/1.1" 200 None 2026-03-14 08:46:06,557 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 08:46:06,580 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b27d404bce73bcf02342ad HTTP/1.1" 200 None 2026-03-14 08:46:06,581 - lava_callback - ERROR - Error processing callback for node 69b27d404bce73bcf02342ad: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:43914 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:43926 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38050 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60614 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60616 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34760 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42358 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59180 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52924 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:52932 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45614 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45620 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45628 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35886 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50634 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39854 - "GET / HTTP/1.0" 200 OK 2026-03-14 08:48:06,633 - lava_callback - INFO - Received callback for node 69b27db44bce73bcf023434b INFO: 172.21.0.1:39864 - "POST /node/69b27db44bce73bcf023434b HTTP/1.0" 202 Accepted 2026-03-14 08:48:06,638 - lava_callback - INFO - Starting async job submit for node 69b27db44bce73bcf023434b 2026-03-14 08:48:06,639 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 08:48:06,653 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b27db44bce73bcf023434b HTTP/1.1" 200 None 2026-03-14 08:48:06,654 - lava_callback - DEBUG - Processing node 69b27db44bce73bcf023434b: baseline-arm-clabbe 2026-03-14 08:48:06,654 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b27db44bce73bcf023434b 2026-03-14 08:48:06,655 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 08:48:06,668 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b27db44bce73bcf023434b HTTP/1.1" 200 None 2026-03-14 08:48:06,669 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 08:48:06,683 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aa8de776ddd5d9e606d488 HTTP/1.1" 200 None 2026-03-14 08:48:06,685 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 08:48:06,707 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b27db44bce73bcf023434b HTTP/1.1" 200 None 2026-03-14 08:48:06,709 - lava_callback - ERROR - Error processing callback for node 69b27db44bce73bcf023434b: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:41538 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:41540 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37184 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60294 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60300 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60796 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56284 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53514 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35052 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:35054 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57446 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45762 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45774 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33378 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48330 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60652 - "GET / HTTP/1.0" 200 OK 2026-03-14 08:50:06,734 - lava_callback - INFO - Received callback for node 69b27e294bce73bcf02343be INFO: 172.21.0.1:60668 - "POST /node/69b27e294bce73bcf02343be HTTP/1.0" 202 Accepted 2026-03-14 08:50:06,740 - lava_callback - INFO - Starting async job submit for node 69b27e294bce73bcf02343be 2026-03-14 08:50:06,741 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 08:50:06,756 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b27e294bce73bcf02343be HTTP/1.1" 200 None 2026-03-14 08:50:06,757 - lava_callback - DEBUG - Processing node 69b27e294bce73bcf02343be: baseline-arm-clabbe 2026-03-14 08:50:06,757 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b27e294bce73bcf02343be 2026-03-14 08:50:06,757 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 08:50:06,770 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b27e294bce73bcf02343be HTTP/1.1" 200 None 2026-03-14 08:50:06,772 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 08:50:06,789 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aa8de776ddd5d9e606d488 HTTP/1.1" 200 None 2026-03-14 08:50:06,791 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 08:50:06,811 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b27e294bce73bcf02343be HTTP/1.1" 200 None 2026-03-14 08:50:06,816 - lava_callback - ERROR - Error processing callback for node 69b27e294bce73bcf02343be: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:59028 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:59038 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43414 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55776 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55778 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50188 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51608 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41104 - "GET / HTTP/1.0" 200 OK 2026-03-14 08:51:11,584 - lava_callback - INFO - Received callback for node 69b27e7a4bce73bcf0234411 INFO: 172.21.0.1:56846 - "POST /node/69b27e7a4bce73bcf0234411 HTTP/1.0" 202 Accepted 2026-03-14 08:51:11,589 - lava_callback - INFO - Starting async job submit for node 69b27e7a4bce73bcf0234411 2026-03-14 08:51:11,590 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 08:51:11,626 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b27e7a4bce73bcf0234411 HTTP/1.1" 200 None 2026-03-14 08:51:11,627 - lava_callback - DEBUG - Processing node 69b27e7a4bce73bcf0234411: baseline-arm64-baylibre 2026-03-14 08:51:11,628 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b27e7a4bce73bcf0234411 2026-03-14 08:51:11,628 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 08:51:11,643 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b27e7a4bce73bcf0234411 HTTP/1.1" 200 None 2026-03-14 08:51:11,645 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 08:51:11,665 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69acc01dbcd207e915d76ba7 HTTP/1.1" 200 None 2026-03-14 08:51:11,666 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 08:51:11,687 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b27e7a4bce73bcf0234411 HTTP/1.1" 200 None 2026-03-14 08:51:11,688 - lava_callback - ERROR - Error processing callback for node 69b27e7a4bce73bcf0234411: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:56850 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:56858 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59328 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48990 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49000 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36302 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40676 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47180 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55816 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:55820 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55280 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46634 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46642 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39730 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34228 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44652 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42194 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:42208 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44076 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44632 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44634 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50778 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41116 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36084 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50806 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:50818 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53642 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49834 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49844 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53102 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37038 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48314 - "GET / HTTP/1.0" 200 OK 2026-03-14 08:55:06,961 - lava_callback - INFO - Received callback for node 69b27f574bce73bcf0234470 INFO: 172.21.0.1:48328 - "POST /node/69b27f574bce73bcf0234470 HTTP/1.0" 202 Accepted 2026-03-14 08:55:06,967 - lava_callback - INFO - Starting async job submit for node 69b27f574bce73bcf0234470 2026-03-14 08:55:06,968 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 08:55:06,991 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b27f574bce73bcf0234470 HTTP/1.1" 200 None 2026-03-14 08:55:06,992 - lava_callback - DEBUG - Processing node 69b27f574bce73bcf0234470: baseline-arm64-clabbe 2026-03-14 08:55:06,992 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b27f574bce73bcf0234470 2026-03-14 08:55:06,993 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 08:55:07,040 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b27f574bce73bcf0234470 HTTP/1.1" 200 None 2026-03-14 08:55:07,042 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 08:55:07,082 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69acc01dbcd207e915d76ba7 HTTP/1.1" 200 None 2026-03-14 08:55:07,083 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 08:55:07,120 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b27f574bce73bcf0234470 HTTP/1.1" 200 None 2026-03-14 08:55:07,121 - lava_callback - ERROR - Error processing callback for node 69b27f574bce73bcf0234470: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:59006 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:59008 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33508 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56368 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56378 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53920 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58026 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58756 - "GET / HTTP/1.0" 200 OK 2026-03-14 08:56:11,862 - lava_callback - INFO - Received callback for node 69b27f994bce73bcf0234480 INFO: 172.21.0.1:58080 - "POST /node/69b27f994bce73bcf0234480 HTTP/1.0" 202 Accepted 2026-03-14 08:56:11,868 - lava_callback - INFO - Starting async job submit for node 69b27f994bce73bcf0234480 2026-03-14 08:56:11,869 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 08:56:11,901 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b27f994bce73bcf0234480 HTTP/1.1" 200 None 2026-03-14 08:56:11,902 - lava_callback - DEBUG - Processing node 69b27f994bce73bcf0234480: baseline-arm64-baylibre 2026-03-14 08:56:11,902 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b27f994bce73bcf0234480 2026-03-14 08:56:11,903 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 08:56:12,069 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b27f994bce73bcf0234480 HTTP/1.1" 200 None 2026-03-14 08:56:12,070 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 08:56:12,098 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aa8df576ddd5d9e606d49a HTTP/1.1" 200 None 2026-03-14 08:56:12,099 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 08:56:12,143 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b27f994bce73bcf0234480 HTTP/1.1" 200 None 2026-03-14 08:56:12,149 - lava_callback - ERROR - Error processing callback for node 69b27f994bce73bcf0234480: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:58096 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:58106 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59820 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42158 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42162 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39896 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56416 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39986 - "GET / HTTP/1.0" 200 OK 2026-03-14 08:57:11,821 - lava_callback - INFO - Received callback for node 69b27fe44bce73bcf0234498 INFO: 172.21.0.1:44410 - "POST /node/69b27fe44bce73bcf0234498 HTTP/1.0" 202 Accepted 2026-03-14 08:57:11,827 - lava_callback - INFO - Starting async job submit for node 69b27fe44bce73bcf0234498 2026-03-14 08:57:11,827 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 08:57:11,845 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b27fe44bce73bcf0234498 HTTP/1.1" 200 None 2026-03-14 08:57:11,846 - lava_callback - DEBUG - Processing node 69b27fe44bce73bcf0234498: baseline-arm64-baylibre 2026-03-14 08:57:11,846 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b27fe44bce73bcf0234498 2026-03-14 08:57:11,847 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 08:57:11,860 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b27fe44bce73bcf0234498 HTTP/1.1" 200 None 2026-03-14 08:57:11,862 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 08:57:11,878 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69afd3b0c9209b146d8e1d77 HTTP/1.1" 200 None 2026-03-14 08:57:11,880 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 08:57:11,901 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b27fe44bce73bcf0234498 HTTP/1.1" 200 None 2026-03-14 08:57:11,902 - lava_callback - ERROR - Error processing callback for node 69b27fe44bce73bcf0234498: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:44416 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:44424 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60408 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42134 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42150 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38800 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36928 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45544 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53156 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:53164 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46456 - "GET / HTTP/1.0" 200 OK 2026-03-14 08:58:31,905 - lava_callback - INFO - Received callback for node 69b280304bce73bcf02344b1 INFO: 172.21.0.1:36774 - "POST /node/69b280304bce73bcf02344b1 HTTP/1.0" 202 Accepted 2026-03-14 08:58:31,911 - lava_callback - INFO - Starting async job submit for node 69b280304bce73bcf02344b1 2026-03-14 08:58:31,912 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 08:58:31,927 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b280304bce73bcf02344b1 HTTP/1.1" 200 None 2026-03-14 08:58:31,927 - lava_callback - DEBUG - Processing node 69b280304bce73bcf02344b1: baseline-arm64-baylibre 2026-03-14 08:58:31,928 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b280304bce73bcf02344b1 2026-03-14 08:58:31,928 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 08:58:31,942 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b280304bce73bcf02344b1 HTTP/1.1" 200 None 2026-03-14 08:58:31,943 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 08:58:31,965 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69afd3b0c9209b146d8e1d77 HTTP/1.1" 200 None 2026-03-14 08:58:31,967 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 08:58:32,008 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b280304bce73bcf02344b1 HTTP/1.1" 200 None 2026-03-14 08:58:32,009 - lava_callback - ERROR - Error processing callback for node 69b280304bce73bcf02344b1: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:36788 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36800 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39624 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58252 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59528 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59800 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:59802 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45214 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42244 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42252 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37318 - "GET / HTTP/1.0" 200 OK 2026-03-14 08:59:52,081 - lava_callback - INFO - Received callback for node 69b2807b4bce73bcf02344ee INFO: 172.21.0.1:55060 - "POST /node/69b2807b4bce73bcf02344ee HTTP/1.0" 202 Accepted 2026-03-14 08:59:52,088 - lava_callback - INFO - Starting async job submit for node 69b2807b4bce73bcf02344ee 2026-03-14 08:59:52,089 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 08:59:52,111 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b2807b4bce73bcf02344ee HTTP/1.1" 200 None 2026-03-14 08:59:52,113 - lava_callback - DEBUG - Processing node 69b2807b4bce73bcf02344ee: baseline-arm64-baylibre 2026-03-14 08:59:52,113 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b2807b4bce73bcf02344ee 2026-03-14 08:59:52,114 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 08:59:52,127 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b2807b4bce73bcf02344ee HTTP/1.1" 200 None 2026-03-14 08:59:52,129 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 08:59:52,142 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69afd3b0c9209b146d8e1d77 HTTP/1.1" 200 None 2026-03-14 08:59:52,144 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 08:59:52,173 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b2807b4bce73bcf02344ee HTTP/1.1" 200 None 2026-03-14 08:59:52,175 - lava_callback - ERROR - Error processing callback for node 69b2807b4bce73bcf02344ee: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:55072 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33942 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56886 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:56902 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50586 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54272 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54286 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54924 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44986 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36594 - "GET / HTTP/1.0" 200 OK 2026-03-14 09:01:12,061 - lava_callback - INFO - Received callback for node 69b280c74bce73bcf0234529 INFO: 172.21.0.1:47112 - "POST /node/69b280c74bce73bcf0234529 HTTP/1.0" 202 Accepted 2026-03-14 09:01:12,066 - lava_callback - INFO - Starting async job submit for node 69b280c74bce73bcf0234529 2026-03-14 09:01:12,067 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 09:01:12,089 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b280c74bce73bcf0234529 HTTP/1.1" 200 None 2026-03-14 09:01:12,089 - lava_callback - DEBUG - Processing node 69b280c74bce73bcf0234529: baseline-arm64-baylibre 2026-03-14 09:01:12,090 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b280c74bce73bcf0234529 2026-03-14 09:01:12,090 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 09:01:12,110 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b280c74bce73bcf0234529 HTTP/1.1" 200 None 2026-03-14 09:01:12,111 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 09:01:12,125 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69afd3b0c9209b146d8e1d77 HTTP/1.1" 200 None 2026-03-14 09:01:12,126 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 09:01:12,146 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b280c74bce73bcf0234529 HTTP/1.1" 200 None 2026-03-14 09:01:12,148 - lava_callback - ERROR - Error processing callback for node 69b280c74bce73bcf0234529: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:47128 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:47136 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43206 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45708 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45716 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60600 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55104 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60232 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34722 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:34728 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35272 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34554 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34556 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47382 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:32950 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43434 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39528 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:39536 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45030 - "GET / HTTP/1.0" 200 OK 2026-03-14 09:03:32,335 - lava_callback - INFO - Received callback for node 69b2815e4bce73bcf0234552 INFO: 172.21.0.1:57384 - "POST /node/69b2815e4bce73bcf0234552 HTTP/1.0" 202 Accepted 2026-03-14 09:03:32,341 - lava_callback - INFO - Starting async job submit for node 69b2815e4bce73bcf0234552 2026-03-14 09:03:32,342 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 09:03:32,358 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b2815e4bce73bcf0234552 HTTP/1.1" 200 None 2026-03-14 09:03:32,359 - lava_callback - DEBUG - Processing node 69b2815e4bce73bcf0234552: baseline-arm64-baylibre 2026-03-14 09:03:32,359 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b2815e4bce73bcf0234552 2026-03-14 09:03:32,360 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 09:03:32,384 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b2815e4bce73bcf0234552 HTTP/1.1" 200 None 2026-03-14 09:03:32,385 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 09:03:32,404 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69afd3b0c9209b146d8e1d77 HTTP/1.1" 200 None 2026-03-14 09:03:32,405 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 09:03:32,427 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b2815e4bce73bcf0234552 HTTP/1.1" 200 None 2026-03-14 09:03:32,429 - lava_callback - ERROR - Error processing callback for node 69b2815e4bce73bcf0234552: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:57400 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57414 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:32980 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:32884 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58948 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41758 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:41774 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41774 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54976 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54984 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50776 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44618 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52808 - "GET / HTTP/1.0" 200 OK 2026-03-14 09:05:07,484 - lava_callback - INFO - Received callback for node 69b281ae4bce73bcf0234566 INFO: 172.21.0.1:52820 - "POST /node/69b281ae4bce73bcf0234566 HTTP/1.0" 202 Accepted 2026-03-14 09:05:07,490 - lava_callback - INFO - Starting async job submit for node 69b281ae4bce73bcf0234566 2026-03-14 09:05:07,491 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 09:05:07,505 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b281ae4bce73bcf0234566 HTTP/1.1" 200 None 2026-03-14 09:05:07,506 - lava_callback - DEBUG - Processing node 69b281ae4bce73bcf0234566: baseline-arm64-clabbe 2026-03-14 09:05:07,506 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b281ae4bce73bcf0234566 2026-03-14 09:05:07,507 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 09:05:07,532 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b281ae4bce73bcf0234566 HTTP/1.1" 200 None 2026-03-14 09:05:07,533 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 09:05:07,569 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69acc01dbcd207e915d76ba7 HTTP/1.1" 200 None 2026-03-14 09:05:07,570 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 09:05:07,600 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b281ae4bce73bcf0234566 HTTP/1.1" 200 None 2026-03-14 09:05:07,601 - lava_callback - ERROR - Error processing callback for node 69b281ae4bce73bcf0234566: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:52876 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:52886 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49870 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49536 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49552 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60810 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57652 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52452 - "GET / HTTP/1.0" 200 OK 2026-03-14 09:06:07,407 - lava_callback - INFO - Received callback for node 69b281f94bce73bcf0234576 INFO: 172.21.0.1:52454 - "POST /node/69b281f94bce73bcf0234576 HTTP/1.0" 202 Accepted 2026-03-14 09:06:07,412 - lava_callback - INFO - Starting async job submit for node 69b281f94bce73bcf0234576 2026-03-14 09:06:07,413 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 09:06:07,433 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b281f94bce73bcf0234576 HTTP/1.1" 200 None 2026-03-14 09:06:07,434 - lava_callback - DEBUG - Processing node 69b281f94bce73bcf0234576: baseline-arm64-clabbe 2026-03-14 09:06:07,434 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b281f94bce73bcf0234576 2026-03-14 09:06:07,435 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 09:06:07,448 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b281f94bce73bcf0234576 HTTP/1.1" 200 None 2026-03-14 09:06:07,450 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 09:06:07,463 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69afd3b0c9209b146d8e1d77 HTTP/1.1" 200 None 2026-03-14 09:06:07,465 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 09:06:07,506 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b281f94bce73bcf0234576 HTTP/1.1" 200 None 2026-03-14 09:06:07,512 - lava_callback - ERROR - Error processing callback for node 69b281f94bce73bcf0234576: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:48184 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:48200 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39610 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52416 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52428 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36318 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55494 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39086 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57158 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:57166 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59676 - "GET / HTTP/1.0" 200 OK 2026-03-14 09:07:27,508 - lava_callback - INFO - Received callback for node 69b282444bce73bcf0234587 INFO: 172.21.0.1:59688 - "POST /node/69b282444bce73bcf0234587 HTTP/1.0" 202 Accepted 2026-03-14 09:07:27,513 - lava_callback - INFO - Starting async job submit for node 69b282444bce73bcf0234587 2026-03-14 09:07:27,514 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 09:07:27,528 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b282444bce73bcf0234587 HTTP/1.1" 200 None 2026-03-14 09:07:27,529 - lava_callback - DEBUG - Processing node 69b282444bce73bcf0234587: baseline-arm64-clabbe 2026-03-14 09:07:27,529 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b282444bce73bcf0234587 2026-03-14 09:07:27,530 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 09:07:27,543 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b282444bce73bcf0234587 HTTP/1.1" 200 None 2026-03-14 09:07:27,544 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 09:07:27,565 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69afd3b0c9209b146d8e1d77 HTTP/1.1" 200 None 2026-03-14 09:07:27,567 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 09:07:27,588 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b282444bce73bcf0234587 HTTP/1.1" 200 None 2026-03-14 09:07:27,595 - lava_callback - ERROR - Error processing callback for node 69b282444bce73bcf0234587: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:44436 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44450 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51504 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50380 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41220 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48204 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:48216 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52476 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45350 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45352 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48760 - "GET / HTTP/1.0" 200 OK 2026-03-14 09:08:47,518 - lava_callback - INFO - Received callback for node 69b2828f4bce73bcf0234590 INFO: 172.21.0.1:48764 - "POST /node/69b2828f4bce73bcf0234590 HTTP/1.0" 202 Accepted 2026-03-14 09:08:47,524 - lava_callback - INFO - Starting async job submit for node 69b2828f4bce73bcf0234590 2026-03-14 09:08:47,525 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 09:08:47,539 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b2828f4bce73bcf0234590 HTTP/1.1" 200 None 2026-03-14 09:08:47,540 - lava_callback - DEBUG - Processing node 69b2828f4bce73bcf0234590: baseline-arm64-clabbe 2026-03-14 09:08:47,540 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b2828f4bce73bcf0234590 2026-03-14 09:08:47,540 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 09:08:47,554 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b2828f4bce73bcf0234590 HTTP/1.1" 200 None 2026-03-14 09:08:47,555 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 09:08:47,576 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69afd3b0c9209b146d8e1d77 HTTP/1.1" 200 None 2026-03-14 09:08:47,577 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 09:08:47,603 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b2828f4bce73bcf0234590 HTTP/1.1" 200 None 2026-03-14 09:08:47,604 - lava_callback - ERROR - Error processing callback for node 69b2828f4bce73bcf0234590: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:33186 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42134 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56540 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:56546 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49352 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50084 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50096 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41968 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46496 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34484 - "GET / HTTP/1.0" 200 OK 2026-03-14 09:10:07,609 - lava_callback - INFO - Received callback for node 69b282db4bce73bcf02345a1 INFO: 172.21.0.1:34490 - "POST /node/69b282db4bce73bcf02345a1 HTTP/1.0" 202 Accepted 2026-03-14 09:10:07,615 - lava_callback - INFO - Starting async job submit for node 69b282db4bce73bcf02345a1 2026-03-14 09:10:07,616 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 09:10:07,630 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b282db4bce73bcf02345a1 HTTP/1.1" 200 None 2026-03-14 09:10:07,631 - lava_callback - DEBUG - Processing node 69b282db4bce73bcf02345a1: baseline-arm64-clabbe 2026-03-14 09:10:07,631 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b282db4bce73bcf02345a1 2026-03-14 09:10:07,632 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 09:10:07,645 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b282db4bce73bcf02345a1 HTTP/1.1" 200 None 2026-03-14 09:10:07,647 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 09:10:07,660 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69afd3b0c9209b146d8e1d77 HTTP/1.1" 200 None 2026-03-14 09:10:07,662 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 09:10:07,692 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b282db4bce73bcf02345a1 HTTP/1.1" 200 None 2026-03-14 09:10:07,697 - lava_callback - ERROR - Error processing callback for node 69b282db4bce73bcf02345a1: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:47748 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:47760 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40106 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51726 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51738 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34078 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47820 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33892 - "GET / HTTP/1.0" 200 OK 2026-03-14 09:11:07,640 - lava_callback - INFO - Received callback for node 69b283274bce73bcf02345af INFO: 172.21.0.1:33896 - "POST /node/69b283274bce73bcf02345af HTTP/1.0" 202 Accepted 2026-03-14 09:11:07,646 - lava_callback - INFO - Starting async job submit for node 69b283274bce73bcf02345af 2026-03-14 09:11:07,647 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 09:11:07,665 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b283274bce73bcf02345af HTTP/1.1" 200 None 2026-03-14 09:11:07,666 - lava_callback - DEBUG - Processing node 69b283274bce73bcf02345af: baseline-arm64-clabbe 2026-03-14 09:11:07,666 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b283274bce73bcf02345af 2026-03-14 09:11:07,667 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 09:11:07,683 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b283274bce73bcf02345af HTTP/1.1" 200 None 2026-03-14 09:11:07,685 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 09:11:07,698 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69afd3b0c9209b146d8e1d77 HTTP/1.1" 200 None 2026-03-14 09:11:07,699 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 09:11:07,720 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b283274bce73bcf02345af HTTP/1.1" 200 None 2026-03-14 09:11:07,725 - lava_callback - ERROR - Error processing callback for node 69b283274bce73bcf02345af: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:49578 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:49592 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46542 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34614 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34622 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56796 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48702 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43750 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54528 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:54532 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57316 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50400 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50412 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60662 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51078 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46672 - "GET / HTTP/1.0" 200 OK 2026-03-14 09:13:07,773 - lava_callback - INFO - Received callback for node 69b283944bce73bcf02345d5 INFO: 172.21.0.1:46686 - "POST /node/69b283944bce73bcf02345d5 HTTP/1.0" 202 Accepted 2026-03-14 09:13:07,780 - lava_callback - INFO - Starting async job submit for node 69b283944bce73bcf02345d5 2026-03-14 09:13:07,781 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 09:13:07,804 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b283944bce73bcf02345d5 HTTP/1.1" 200 None 2026-03-14 09:13:07,805 - lava_callback - DEBUG - Processing node 69b283944bce73bcf02345d5: baseline-arm64-clabbe 2026-03-14 09:13:07,805 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b283944bce73bcf02345d5 2026-03-14 09:13:07,806 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 09:13:07,839 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b283944bce73bcf02345d5 HTTP/1.1" 200 None 2026-03-14 09:13:07,841 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 09:13:07,878 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69afd3b0c9209b146d8e1d77 HTTP/1.1" 200 None 2026-03-14 09:13:07,880 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 09:13:07,906 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b283944bce73bcf02345d5 HTTP/1.1" 200 None 2026-03-14 09:13:07,907 - lava_callback - ERROR - Error processing callback for node 69b283944bce73bcf02345d5: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:57698 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:57704 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34530 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:32946 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:32960 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35176 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54982 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55832 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59336 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:59340 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54124 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47192 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47194 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34260 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38762 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41956 - "GET / HTTP/1.0" 200 OK 2026-03-14 09:15:12,957 - lava_callback - INFO - Received callback for node 69b284114bce73bcf023467f INFO: 172.21.0.1:58280 - "POST /node/69b284114bce73bcf023467f HTTP/1.0" 202 Accepted 2026-03-14 09:15:12,963 - lava_callback - INFO - Starting async job submit for node 69b284114bce73bcf023467f 2026-03-14 09:15:12,964 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 09:15:12,999 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b284114bce73bcf023467f HTTP/1.1" 200 None 2026-03-14 09:15:13,000 - lava_callback - DEBUG - Processing node 69b284114bce73bcf023467f: baseline-arm64-baylibre 2026-03-14 09:15:13,000 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b284114bce73bcf023467f 2026-03-14 09:15:13,001 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 09:15:13,024 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b284114bce73bcf023467f HTTP/1.1" 200 None 2026-03-14 09:15:13,025 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 09:15:13,039 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b276764bce73bcf0233d23 HTTP/1.1" 200 None 2026-03-14 09:15:13,040 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 09:15:13,061 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b284114bce73bcf023467f HTTP/1.1" 200 None 2026-03-14 09:15:13,062 - lava_callback - ERROR - Error processing callback for node 69b284114bce73bcf023467f: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' 2026-03-14 09:15:13,629 - lava_callback - INFO - Received callback for node 69b284124bce73bcf0234682 INFO: 172.21.0.1:58288 - "POST /node/69b284124bce73bcf0234682 HTTP/1.0" 202 Accepted 2026-03-14 09:15:13,635 - lava_callback - INFO - Starting async job submit for node 69b284124bce73bcf0234682 2026-03-14 09:15:13,636 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 09:15:13,649 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b284124bce73bcf0234682 HTTP/1.1" 200 None 2026-03-14 09:15:13,650 - lava_callback - DEBUG - Processing node 69b284124bce73bcf0234682: baseline-arm64-baylibre 2026-03-14 09:15:13,650 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b284124bce73bcf0234682 2026-03-14 09:15:13,650 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 09:15:13,663 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b284124bce73bcf0234682 HTTP/1.1" 200 None 2026-03-14 09:15:13,665 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 09:15:13,692 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b276764bce73bcf0233d23 HTTP/1.1" 200 None 2026-03-14 09:15:13,694 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 09:15:13,716 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b284124bce73bcf0234682 HTTP/1.1" 200 None 2026-03-14 09:15:13,718 - lava_callback - ERROR - Error processing callback for node 69b284124bce73bcf0234682: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' 2026-03-14 09:15:14,291 - lava_callback - INFO - Received callback for node 69b284154bce73bcf0234689 INFO: 172.21.0.1:58290 - "POST /node/69b284154bce73bcf0234689 HTTP/1.0" 202 Accepted 2026-03-14 09:15:14,300 - lava_callback - INFO - Starting async job submit for node 69b284154bce73bcf0234689 2026-03-14 09:15:14,301 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 09:15:14,317 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b284154bce73bcf0234689 HTTP/1.1" 200 None 2026-03-14 09:15:14,319 - lava_callback - DEBUG - Processing node 69b284154bce73bcf0234689: baseline-arm64-baylibre 2026-03-14 09:15:14,319 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b284154bce73bcf0234689 2026-03-14 09:15:14,319 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 09:15:14,333 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b284154bce73bcf0234689 HTTP/1.1" 200 None 2026-03-14 09:15:14,334 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 09:15:14,349 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b276764bce73bcf0233d23 HTTP/1.1" 200 None 2026-03-14 09:15:14,350 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 09:15:14,383 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b284154bce73bcf0234689 HTTP/1.1" 200 None 2026-03-14 09:15:14,389 - lava_callback - ERROR - Error processing callback for node 69b284154bce73bcf0234689: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' 2026-03-14 09:15:14,955 - lava_callback - INFO - Received callback for node 69b284154bce73bcf023468b INFO: 172.21.0.1:58306 - "POST /node/69b284154bce73bcf023468b HTTP/1.0" 202 Accepted 2026-03-14 09:15:14,961 - lava_callback - INFO - Starting async job submit for node 69b284154bce73bcf023468b 2026-03-14 09:15:14,961 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 09:15:14,975 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b284154bce73bcf023468b HTTP/1.1" 200 None 2026-03-14 09:15:14,976 - lava_callback - DEBUG - Processing node 69b284154bce73bcf023468b: baseline-arm-baylibre 2026-03-14 09:15:14,976 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b284154bce73bcf023468b 2026-03-14 09:15:14,977 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 09:15:14,990 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b284154bce73bcf023468b HTTP/1.1" 200 None 2026-03-14 09:15:14,992 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 09:15:15,006 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69afd3a3c9209b146d8e1d68 HTTP/1.1" 200 None 2026-03-14 09:15:15,008 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 09:15:15,039 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b284154bce73bcf023468b HTTP/1.1" 200 None 2026-03-14 09:15:15,041 - lava_callback - ERROR - Error processing callback for node 69b284154bce73bcf023468b: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:58308 - "GET /api/metrics HTTP/1.0" 200 OK 2026-03-14 09:15:15,642 - lava_callback - INFO - Received callback for node 69b284164bce73bcf023468f INFO: 172.21.0.1:58322 - "POST /node/69b284164bce73bcf023468f HTTP/1.0" 202 Accepted 2026-03-14 09:15:15,648 - lava_callback - INFO - Starting async job submit for node 69b284164bce73bcf023468f 2026-03-14 09:15:15,649 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 09:15:15,664 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b284164bce73bcf023468f HTTP/1.1" 200 None 2026-03-14 09:15:15,665 - lava_callback - DEBUG - Processing node 69b284164bce73bcf023468f: baseline-arm64-baylibre 2026-03-14 09:15:15,665 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b284164bce73bcf023468f 2026-03-14 09:15:15,665 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 09:15:15,679 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b284164bce73bcf023468f HTTP/1.1" 200 None 2026-03-14 09:15:15,680 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 09:15:15,693 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b276764bce73bcf0233d23 HTTP/1.1" 200 None 2026-03-14 09:15:15,695 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 09:15:15,723 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b284164bce73bcf023468f HTTP/1.1" 200 None 2026-03-14 09:15:15,725 - lava_callback - ERROR - Error processing callback for node 69b284164bce73bcf023468f: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' 2026-03-14 09:15:16,308 - lava_callback - INFO - Received callback for node 69b284184bce73bcf0234692 INFO: 172.21.0.1:58336 - "POST /node/69b284184bce73bcf0234692 HTTP/1.0" 202 Accepted 2026-03-14 09:15:16,314 - lava_callback - INFO - Starting async job submit for node 69b284184bce73bcf0234692 2026-03-14 09:15:16,315 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 09:15:16,329 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b284184bce73bcf0234692 HTTP/1.1" 200 None 2026-03-14 09:15:16,330 - lava_callback - DEBUG - Processing node 69b284184bce73bcf0234692: baseline-arm64-baylibre 2026-03-14 09:15:16,331 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b284184bce73bcf0234692 2026-03-14 09:15:16,331 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 09:15:16,344 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b284184bce73bcf0234692 HTTP/1.1" 200 None 2026-03-14 09:15:16,345 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 09:15:16,360 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b276764bce73bcf0233d23 HTTP/1.1" 200 None 2026-03-14 09:15:16,362 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 09:15:16,385 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b284184bce73bcf0234692 HTTP/1.1" 200 None 2026-03-14 09:15:16,387 - lava_callback - ERROR - Error processing callback for node 69b284184bce73bcf0234692: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:58342 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60308 - "GET / HTTP/1.0" 200 OK 2026-03-14 09:15:27,858 - lava_callback - INFO - Received callback for node 69b284274bce73bcf02346d1 INFO: 172.21.0.1:60314 - "POST /node/69b284274bce73bcf02346d1 HTTP/1.0" 202 Accepted 2026-03-14 09:15:27,864 - lava_callback - INFO - Starting async job submit for node 69b284274bce73bcf02346d1 2026-03-14 09:15:27,865 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 09:15:27,880 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b284274bce73bcf02346d1 HTTP/1.1" 200 None 2026-03-14 09:15:27,881 - lava_callback - DEBUG - Processing node 69b284274bce73bcf02346d1: baseline-arm64-clabbe 2026-03-14 09:15:27,881 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b284274bce73bcf02346d1 2026-03-14 09:15:27,882 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 09:15:27,895 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b284274bce73bcf02346d1 HTTP/1.1" 200 None 2026-03-14 09:15:27,897 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 09:15:27,910 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b276764bce73bcf0233d23 HTTP/1.1" 200 None 2026-03-14 09:15:27,911 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 09:15:27,932 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b284274bce73bcf02346d1 HTTP/1.1" 200 None 2026-03-14 09:15:27,933 - lava_callback - ERROR - Error processing callback for node 69b284274bce73bcf02346d1: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' 2026-03-14 09:15:28,525 - lava_callback - INFO - Received callback for node 69b284294bce73bcf02346d4 INFO: 172.21.0.1:60330 - "POST /node/69b284294bce73bcf02346d4 HTTP/1.0" 202 Accepted 2026-03-14 09:15:28,532 - lava_callback - INFO - Starting async job submit for node 69b284294bce73bcf02346d4 2026-03-14 09:15:28,534 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 09:15:28,557 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b284294bce73bcf02346d4 HTTP/1.1" 200 None 2026-03-14 09:15:28,557 - lava_callback - DEBUG - Processing node 69b284294bce73bcf02346d4: baseline-arm64-clabbe 2026-03-14 09:15:28,558 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b284294bce73bcf02346d4 2026-03-14 09:15:28,558 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 09:15:28,572 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b284294bce73bcf02346d4 HTTP/1.1" 200 None 2026-03-14 09:15:28,573 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 09:15:28,601 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b276764bce73bcf0233d23 HTTP/1.1" 200 None 2026-03-14 09:15:28,602 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 09:15:28,622 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b284294bce73bcf02346d4 HTTP/1.1" 200 None 2026-03-14 09:15:28,627 - lava_callback - ERROR - Error processing callback for node 69b284294bce73bcf02346d4: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' 2026-03-14 09:15:29,198 - lava_callback - INFO - Received callback for node 69b2842a4bce73bcf02346d7 INFO: 172.21.0.1:60346 - "POST /node/69b2842a4bce73bcf02346d7 HTTP/1.0" 202 Accepted 2026-03-14 09:15:29,204 - lava_callback - INFO - Starting async job submit for node 69b2842a4bce73bcf02346d7 2026-03-14 09:15:29,205 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 09:15:29,225 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b2842a4bce73bcf02346d7 HTTP/1.1" 200 None 2026-03-14 09:15:29,226 - lava_callback - DEBUG - Processing node 69b2842a4bce73bcf02346d7: baseline-arm64-clabbe 2026-03-14 09:15:29,226 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b2842a4bce73bcf02346d7 2026-03-14 09:15:29,226 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 09:15:29,240 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b2842a4bce73bcf02346d7 HTTP/1.1" 200 None 2026-03-14 09:15:29,241 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 09:15:29,254 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b276764bce73bcf0233d23 HTTP/1.1" 200 None 2026-03-14 09:15:29,255 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 09:15:29,287 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b2842a4bce73bcf02346d7 HTTP/1.1" 200 None 2026-03-14 09:15:29,289 - lava_callback - ERROR - Error processing callback for node 69b2842a4bce73bcf02346d7: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' 2026-03-14 09:15:29,870 - lava_callback - INFO - Received callback for node 69b2842a4bce73bcf02346da INFO: 172.21.0.1:38028 - "POST /node/69b2842a4bce73bcf02346da HTTP/1.0" 202 Accepted 2026-03-14 09:15:29,875 - lava_callback - INFO - Starting async job submit for node 69b2842a4bce73bcf02346da 2026-03-14 09:15:29,876 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 09:15:29,892 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b2842a4bce73bcf02346da HTTP/1.1" 200 None 2026-03-14 09:15:29,893 - lava_callback - DEBUG - Processing node 69b2842a4bce73bcf02346da: baseline-arm64-clabbe 2026-03-14 09:15:29,893 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b2842a4bce73bcf02346da 2026-03-14 09:15:29,894 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 09:15:29,913 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b2842a4bce73bcf02346da HTTP/1.1" 200 None 2026-03-14 09:15:29,915 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 09:15:29,929 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b276764bce73bcf0233d23 HTTP/1.1" 200 None 2026-03-14 09:15:29,930 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 09:15:29,951 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b2842a4bce73bcf02346da HTTP/1.1" 200 None 2026-03-14 09:15:29,956 - lava_callback - ERROR - Error processing callback for node 69b2842a4bce73bcf02346da: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' 2026-03-14 09:15:30,547 - lava_callback - INFO - Received callback for node 69b2842d4bce73bcf02346e3 INFO: 172.21.0.1:38044 - "POST /node/69b2842d4bce73bcf02346e3 HTTP/1.0" 202 Accepted 2026-03-14 09:15:30,553 - lava_callback - INFO - Starting async job submit for node 69b2842d4bce73bcf02346e3 2026-03-14 09:15:30,554 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 09:15:30,575 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b2842d4bce73bcf02346e3 HTTP/1.1" 200 None 2026-03-14 09:15:30,576 - lava_callback - DEBUG - Processing node 69b2842d4bce73bcf02346e3: baseline-arm64-clabbe 2026-03-14 09:15:30,577 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b2842d4bce73bcf02346e3 2026-03-14 09:15:30,577 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 09:15:30,591 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b2842d4bce73bcf02346e3 HTTP/1.1" 200 None 2026-03-14 09:15:30,593 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 09:15:30,606 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b276764bce73bcf0233d23 HTTP/1.1" 200 None 2026-03-14 09:15:30,608 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 09:15:30,629 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b2842d4bce73bcf02346e3 HTTP/1.1" 200 None 2026-03-14 09:15:30,630 - lava_callback - ERROR - Error processing callback for node 69b2842d4bce73bcf02346e3: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' 2026-03-14 09:15:31,222 - lava_callback - INFO - Received callback for node 69b2842c4bce73bcf02346e0 INFO: 172.21.0.1:38058 - "POST /node/69b2842c4bce73bcf02346e0 HTTP/1.0" 202 Accepted 2026-03-14 09:15:31,228 - lava_callback - INFO - Starting async job submit for node 69b2842c4bce73bcf02346e0 2026-03-14 09:15:31,228 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 09:15:31,250 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b2842c4bce73bcf02346e0 HTTP/1.1" 200 None 2026-03-14 09:15:31,251 - lava_callback - DEBUG - Processing node 69b2842c4bce73bcf02346e0: baseline-arm64-clabbe 2026-03-14 09:15:31,251 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b2842c4bce73bcf02346e0 2026-03-14 09:15:31,252 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 09:15:31,274 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b2842c4bce73bcf02346e0 HTTP/1.1" 200 None 2026-03-14 09:15:31,276 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 09:15:31,289 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b276764bce73bcf0233d23 HTTP/1.1" 200 None 2026-03-14 09:15:31,291 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 09:15:31,311 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b2842c4bce73bcf02346e0 HTTP/1.1" 200 None 2026-03-14 09:15:31,320 - lava_callback - ERROR - Error processing callback for node 69b2842c4bce73bcf02346e0: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:38062 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38076 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51010 - "GET / HTTP/1.0" 200 OK 2026-03-14 09:15:52,805 - lava_callback - INFO - Received callback for node 69b284374bce73bcf02346f9 INFO: 172.21.0.1:59148 - "POST /node/69b284374bce73bcf02346f9 HTTP/1.0" 202 Accepted 2026-03-14 09:15:52,811 - lava_callback - INFO - Starting async job submit for node 69b284374bce73bcf02346f9 2026-03-14 09:15:52,811 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 09:15:52,832 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b284374bce73bcf02346f9 HTTP/1.1" 200 None 2026-03-14 09:15:52,832 - lava_callback - DEBUG - Processing node 69b284374bce73bcf02346f9: baseline-arm-baylibre 2026-03-14 09:15:52,833 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b284374bce73bcf02346f9 2026-03-14 09:15:52,833 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 09:15:52,854 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b284374bce73bcf02346f9 HTTP/1.1" 200 None 2026-03-14 09:15:52,855 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 09:15:52,868 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69afd3a3c9209b146d8e1d68 HTTP/1.1" 200 None 2026-03-14 09:15:52,870 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 09:15:52,890 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b284374bce73bcf02346f9 HTTP/1.1" 200 None 2026-03-14 09:15:52,891 - lava_callback - ERROR - Error processing callback for node 69b284374bce73bcf02346f9: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:59158 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55300 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59888 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:59900 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51342 - "GET / HTTP/1.0" 200 OK 2026-03-14 09:16:33,498 - lava_callback - INFO - Received callback for node 69b2845b4bce73bcf0234724 INFO: 172.21.0.1:55158 - "POST /node/69b2845b4bce73bcf0234724 HTTP/1.0" 202 Accepted 2026-03-14 09:16:33,504 - lava_callback - INFO - Starting async job submit for node 69b2845b4bce73bcf0234724 2026-03-14 09:16:33,504 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 09:16:33,519 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b2845b4bce73bcf0234724 HTTP/1.1" 200 None 2026-03-14 09:16:33,520 - lava_callback - DEBUG - Processing node 69b2845b4bce73bcf0234724: baseline-arm-baylibre 2026-03-14 09:16:33,520 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b2845b4bce73bcf0234724 2026-03-14 09:16:33,520 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 09:16:33,534 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b2845b4bce73bcf0234724 HTTP/1.1" 200 None 2026-03-14 09:16:33,535 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 09:16:33,562 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69afd3a3c9209b146d8e1d68 HTTP/1.1" 200 None 2026-03-14 09:16:33,564 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 09:16:33,585 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b2845b4bce73bcf0234724 HTTP/1.1" 200 None 2026-03-14 09:16:33,594 - lava_callback - ERROR - Error processing callback for node 69b2845b4bce73bcf0234724: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:55168 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55184 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46416 - "GET / HTTP/1.0" 200 OK 2026-03-14 09:16:52,838 - lava_callback - INFO - Received callback for node 69b2847f4bce73bcf0234774 INFO: 172.21.0.1:51628 - "POST /node/69b2847f4bce73bcf0234774 HTTP/1.0" 202 Accepted 2026-03-14 09:16:52,844 - lava_callback - INFO - Starting async job submit for node 69b2847f4bce73bcf0234774 2026-03-14 09:16:52,845 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 09:16:52,861 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b2847f4bce73bcf0234774 HTTP/1.1" 200 None 2026-03-14 09:16:52,862 - lava_callback - DEBUG - Processing node 69b2847f4bce73bcf0234774: baseline-arm-baylibre 2026-03-14 09:16:52,862 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b2847f4bce73bcf0234774 2026-03-14 09:16:52,863 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 09:16:52,876 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b2847f4bce73bcf0234774 HTTP/1.1" 200 None 2026-03-14 09:16:52,877 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 09:16:52,891 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69afd3a3c9209b146d8e1d68 HTTP/1.1" 200 None 2026-03-14 09:16:52,892 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 09:16:52,924 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b2847f4bce73bcf0234774 HTTP/1.1" 200 None 2026-03-14 09:16:52,933 - lava_callback - ERROR - Error processing callback for node 69b2847f4bce73bcf0234774: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:51630 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41854 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50786 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:50800 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41802 - "GET / HTTP/1.0" 200 OK 2026-03-14 09:17:32,877 - lava_callback - INFO - Received callback for node 69b284a44bce73bcf02347db INFO: 172.21.0.1:39448 - "POST /node/69b284a44bce73bcf02347db HTTP/1.0" 202 Accepted 2026-03-14 09:17:32,884 - lava_callback - INFO - Starting async job submit for node 69b284a44bce73bcf02347db 2026-03-14 09:17:32,885 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 09:17:32,900 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b284a44bce73bcf02347db HTTP/1.1" 200 None 2026-03-14 09:17:32,901 - lava_callback - DEBUG - Processing node 69b284a44bce73bcf02347db: baseline-arm-baylibre 2026-03-14 09:17:32,901 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b284a44bce73bcf02347db 2026-03-14 09:17:32,902 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 09:17:32,917 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b284a44bce73bcf02347db HTTP/1.1" 200 None 2026-03-14 09:17:32,918 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 09:17:32,941 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69afd3a3c9209b146d8e1d68 HTTP/1.1" 200 None 2026-03-14 09:17:32,942 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 09:17:32,964 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b284a44bce73bcf02347db HTTP/1.1" 200 None 2026-03-14 09:17:32,972 - lava_callback - ERROR - Error processing callback for node 69b284a44bce73bcf02347db: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:39458 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39462 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56788 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38904 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53204 - "GET / HTTP/1.0" 200 OK 2026-03-14 09:18:13,000 - lava_callback - INFO - Received callback for node 69b284c94bce73bcf0234818 INFO: 172.21.0.1:55910 - "POST /node/69b284c94bce73bcf0234818 HTTP/1.0" 202 Accepted 2026-03-14 09:18:13,007 - lava_callback - INFO - Starting async job submit for node 69b284c94bce73bcf0234818 2026-03-14 09:18:13,009 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 09:18:13,028 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b284c94bce73bcf0234818 HTTP/1.1" 200 None 2026-03-14 09:18:13,029 - lava_callback - DEBUG - Processing node 69b284c94bce73bcf0234818: baseline-arm-baylibre 2026-03-14 09:18:13,029 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b284c94bce73bcf0234818 2026-03-14 09:18:13,030 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 09:18:13,048 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b284c94bce73bcf0234818 HTTP/1.1" 200 None 2026-03-14 09:18:13,049 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 09:18:13,080 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69afd3a3c9209b146d8e1d68 HTTP/1.1" 200 None 2026-03-14 09:18:13,081 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 09:18:13,102 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b284c94bce73bcf0234818 HTTP/1.1" 200 None 2026-03-14 09:18:13,104 - lava_callback - ERROR - Error processing callback for node 69b284c94bce73bcf0234818: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:55926 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:55938 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43980 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42470 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42472 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53650 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59408 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55268 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60622 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:60626 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39062 - "GET / HTTP/1.0" 200 OK 2026-03-14 09:19:28,039 - lava_callback - INFO - Received callback for node 69b285124bce73bcf0234860 INFO: 172.21.0.1:39072 - "POST /node/69b285124bce73bcf0234860 HTTP/1.0" 202 Accepted 2026-03-14 09:19:28,044 - lava_callback - INFO - Starting async job submit for node 69b285124bce73bcf0234860 2026-03-14 09:19:28,045 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 09:19:28,068 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b285124bce73bcf0234860 HTTP/1.1" 200 None 2026-03-14 09:19:28,069 - lava_callback - DEBUG - Processing node 69b285124bce73bcf0234860: baseline-arm-clabbe 2026-03-14 09:19:28,069 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b285124bce73bcf0234860 2026-03-14 09:19:28,070 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 09:19:28,085 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b285124bce73bcf0234860 HTTP/1.1" 200 None 2026-03-14 09:19:28,086 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 09:19:28,100 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69afd3a3c9209b146d8e1d68 HTTP/1.1" 200 None 2026-03-14 09:19:28,102 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 09:19:28,124 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b285124bce73bcf0234860 HTTP/1.1" 200 None 2026-03-14 09:19:28,125 - lava_callback - ERROR - Error processing callback for node 69b285124bce73bcf0234860: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:49998 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50012 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47674 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59224 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57466 - "GET / HTTP/1.0" 200 OK 2026-03-14 09:20:08,094 - lava_callback - INFO - Received callback for node 69b285374bce73bcf0234869 INFO: 172.21.0.1:57478 - "POST /node/69b285374bce73bcf0234869 HTTP/1.0" 202 Accepted 2026-03-14 09:20:08,099 - lava_callback - INFO - Starting async job submit for node 69b285374bce73bcf0234869 2026-03-14 09:20:08,100 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 09:20:08,115 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b285374bce73bcf0234869 HTTP/1.1" 200 None 2026-03-14 09:20:08,116 - lava_callback - DEBUG - Processing node 69b285374bce73bcf0234869: baseline-arm-clabbe 2026-03-14 09:20:08,116 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b285374bce73bcf0234869 2026-03-14 09:20:08,116 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 09:20:08,130 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b285374bce73bcf0234869 HTTP/1.1" 200 None 2026-03-14 09:20:08,131 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 09:20:08,145 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69afd3a3c9209b146d8e1d68 HTTP/1.1" 200 None 2026-03-14 09:20:08,146 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 09:20:08,175 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b285374bce73bcf0234869 HTTP/1.1" 200 None 2026-03-14 09:20:08,185 - lava_callback - ERROR - Error processing callback for node 69b285374bce73bcf0234869: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:59758 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:59764 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42656 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35896 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35898 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56250 - "GET / HTTP/1.0" 200 OK 2026-03-14 09:20:48,146 - lava_callback - INFO - Received callback for node 69b2855b4bce73bcf0234876 INFO: 172.21.0.1:56258 - "POST /node/69b2855b4bce73bcf0234876 HTTP/1.0" 202 Accepted 2026-03-14 09:20:48,151 - lava_callback - INFO - Starting async job submit for node 69b2855b4bce73bcf0234876 2026-03-14 09:20:48,152 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 09:20:48,166 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b2855b4bce73bcf0234876 HTTP/1.1" 200 None 2026-03-14 09:20:48,167 - lava_callback - DEBUG - Processing node 69b2855b4bce73bcf0234876: baseline-arm-clabbe 2026-03-14 09:20:48,167 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b2855b4bce73bcf0234876 2026-03-14 09:20:48,167 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 09:20:48,181 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b2855b4bce73bcf0234876 HTTP/1.1" 200 None 2026-03-14 09:20:48,182 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 09:20:48,196 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69afd3a3c9209b146d8e1d68 HTTP/1.1" 200 None 2026-03-14 09:20:48,197 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 09:20:48,232 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b2855b4bce73bcf0234876 HTTP/1.1" 200 None 2026-03-14 09:20:48,238 - lava_callback - ERROR - Error processing callback for node 69b2855b4bce73bcf0234876: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:34628 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54300 - "GET / HTTP/1.0" 200 OK 2026-03-14 09:21:08,099 - lava_callback - INFO - Received callback for node 69b285804bce73bcf023488a INFO: 172.21.0.1:54310 - "POST /node/69b285804bce73bcf023488a HTTP/1.0" 202 Accepted 2026-03-14 09:21:08,104 - lava_callback - INFO - Starting async job submit for node 69b285804bce73bcf023488a 2026-03-14 09:21:08,105 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 09:21:08,120 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b285804bce73bcf023488a HTTP/1.1" 200 None 2026-03-14 09:21:08,121 - lava_callback - DEBUG - Processing node 69b285804bce73bcf023488a: baseline-arm-clabbe 2026-03-14 09:21:08,121 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b285804bce73bcf023488a 2026-03-14 09:21:08,122 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 09:21:08,138 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b285804bce73bcf023488a HTTP/1.1" 200 None 2026-03-14 09:21:08,140 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 09:21:08,167 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69afd3a3c9209b146d8e1d68 HTTP/1.1" 200 None 2026-03-14 09:21:08,169 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 09:21:08,191 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b285804bce73bcf023488a HTTP/1.1" 200 None 2026-03-14 09:21:08,198 - lava_callback - ERROR - Error processing callback for node 69b285804bce73bcf023488a: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:52792 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:52802 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53534 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48620 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48624 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47566 - "GET / HTTP/1.0" 200 OK 2026-03-14 09:21:53,577 - lava_callback - INFO - Received callback for node 69b285aa4bce73bcf02348a0 INFO: 172.21.0.1:57498 - "POST /node/69b285aa4bce73bcf02348a0 HTTP/1.0" 202 Accepted 2026-03-14 09:21:53,582 - lava_callback - INFO - Starting async job submit for node 69b285aa4bce73bcf02348a0 2026-03-14 09:21:53,583 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 09:21:53,604 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b285aa4bce73bcf02348a0 HTTP/1.1" 200 None 2026-03-14 09:21:53,605 - lava_callback - DEBUG - Processing node 69b285aa4bce73bcf02348a0: baseline-arm64-baylibre 2026-03-14 09:21:53,605 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b285aa4bce73bcf02348a0 2026-03-14 09:21:53,606 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 09:21:53,619 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b285aa4bce73bcf02348a0 HTTP/1.1" 200 None 2026-03-14 09:21:53,621 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 09:21:53,634 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aa8df576ddd5d9e606d49a HTTP/1.1" 200 None 2026-03-14 09:21:53,636 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 09:21:53,657 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b285aa4bce73bcf02348a0 HTTP/1.1" 200 None 2026-03-14 09:21:53,658 - lava_callback - ERROR - Error processing callback for node 69b285aa4bce73bcf02348a0: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:57506 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57728 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33650 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:33666 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42270 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47988 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47992 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54412 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38820 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50390 - "GET / HTTP/1.0" 200 OK 2026-03-14 09:23:08,185 - lava_callback - INFO - Received callback for node 69b285ee4bce73bcf02348b0 INFO: 172.21.0.1:50394 - "POST /node/69b285ee4bce73bcf02348b0 HTTP/1.0" 202 Accepted 2026-03-14 09:23:08,190 - lava_callback - INFO - Starting async job submit for node 69b285ee4bce73bcf02348b0 2026-03-14 09:23:08,191 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 09:23:08,206 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b285ee4bce73bcf02348b0 HTTP/1.1" 200 None 2026-03-14 09:23:08,207 - lava_callback - DEBUG - Processing node 69b285ee4bce73bcf02348b0: baseline-arm-clabbe 2026-03-14 09:23:08,207 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b285ee4bce73bcf02348b0 2026-03-14 09:23:08,208 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 09:23:08,226 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b285ee4bce73bcf02348b0 HTTP/1.1" 200 None 2026-03-14 09:23:08,227 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 09:23:08,240 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69afd3a3c9209b146d8e1d68 HTTP/1.1" 200 None 2026-03-14 09:23:08,242 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 09:23:08,262 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b285ee4bce73bcf02348b0 HTTP/1.1" 200 None 2026-03-14 09:23:08,263 - lava_callback - ERROR - Error processing callback for node 69b285ee4bce73bcf02348b0: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:53422 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:53424 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42468 - "GET / HTTP/1.0" 200 OK 2026-03-14 09:23:33,217 - lava_callback - INFO - Received callback for node 69b2860e4bce73bcf02348bb INFO: 172.21.0.1:58842 - "POST /node/69b2860e4bce73bcf02348bb HTTP/1.0" 202 Accepted 2026-03-14 09:23:33,223 - lava_callback - INFO - Starting async job submit for node 69b2860e4bce73bcf02348bb 2026-03-14 09:23:33,224 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 09:23:33,238 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b2860e4bce73bcf02348bb HTTP/1.1" 200 None 2026-03-14 09:23:33,239 - lava_callback - DEBUG - Processing node 69b2860e4bce73bcf02348bb: baseline-arm-baylibre 2026-03-14 09:23:33,239 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b2860e4bce73bcf02348bb 2026-03-14 09:23:33,240 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 09:23:33,253 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b2860e4bce73bcf02348bb HTTP/1.1" 200 None 2026-03-14 09:23:33,254 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 09:23:33,274 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ad30bced37758c525e15d2 HTTP/1.1" 200 None 2026-03-14 09:23:33,275 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 09:23:33,299 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b2860e4bce73bcf02348bb HTTP/1.1" 200 None 2026-03-14 09:23:33,305 - lava_callback - ERROR - Error processing callback for node 69b2860e4bce73bcf02348bb: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:58858 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58862 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49074 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55202 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37244 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41864 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:41876 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39620 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51692 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51696 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58408 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47640 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56070 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57758 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:57768 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44466 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37140 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37150 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37642 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42374 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53962 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52420 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:52426 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35640 - "GET / HTTP/1.0" 200 OK 2026-03-14 09:26:33,551 - lava_callback - INFO - Received callback for node 69b286c14bce73bcf02348f8 INFO: 172.21.0.1:34272 - "POST /node/69b286c14bce73bcf02348f8 HTTP/1.0" 202 Accepted 2026-03-14 09:26:33,556 - lava_callback - INFO - Starting async job submit for node 69b286c14bce73bcf02348f8 2026-03-14 09:26:33,557 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 09:26:33,578 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b286c14bce73bcf02348f8 HTTP/1.1" 200 None 2026-03-14 09:26:33,579 - lava_callback - DEBUG - Processing node 69b286c14bce73bcf02348f8: baseline-arm-baylibre 2026-03-14 09:26:33,579 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b286c14bce73bcf02348f8 2026-03-14 09:26:33,580 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 09:26:33,593 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b286c14bce73bcf02348f8 HTTP/1.1" 200 None 2026-03-14 09:26:33,594 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 09:26:33,607 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ad30bced37758c525e15d2 HTTP/1.1" 200 None 2026-03-14 09:26:33,608 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 09:26:33,629 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b286c14bce73bcf02348f8 HTTP/1.1" 200 None 2026-03-14 09:26:33,635 - lava_callback - ERROR - Error processing callback for node 69b286c14bce73bcf02348f8: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:34288 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34292 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57204 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40026 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39428 - "GET / HTTP/1.0" 200 OK 2026-03-14 09:27:13,757 - lava_callback - INFO - Received callback for node 69b286e54bce73bcf0234902 INFO: 172.21.0.1:59350 - "POST /node/69b286e54bce73bcf0234902 HTTP/1.0" 202 Accepted 2026-03-14 09:27:13,763 - lava_callback - INFO - Starting async job submit for node 69b286e54bce73bcf0234902 2026-03-14 09:27:13,764 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 09:27:13,780 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b286e54bce73bcf0234902 HTTP/1.1" 200 None 2026-03-14 09:27:13,781 - lava_callback - DEBUG - Processing node 69b286e54bce73bcf0234902: baseline-arm-baylibre 2026-03-14 09:27:13,781 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b286e54bce73bcf0234902 2026-03-14 09:27:13,781 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 09:27:13,814 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b286e54bce73bcf0234902 HTTP/1.1" 200 None 2026-03-14 09:27:13,815 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 09:27:13,828 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ad30bced37758c525e15d2 HTTP/1.1" 200 None 2026-03-14 09:27:13,829 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 09:27:13,856 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b286e54bce73bcf0234902 HTTP/1.1" 200 None 2026-03-14 09:27:13,857 - lava_callback - ERROR - Error processing callback for node 69b286e54bce73bcf0234902: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:59362 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:59376 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42290 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37826 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37830 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57092 - "GET / HTTP/1.0" 200 OK 2026-03-14 09:27:53,465 - lava_callback - INFO - Received callback for node 69b2870a4bce73bcf023490f INFO: 172.21.0.1:55858 - "POST /node/69b2870a4bce73bcf023490f HTTP/1.0" 202 Accepted 2026-03-14 09:27:53,471 - lava_callback - INFO - Starting async job submit for node 69b2870a4bce73bcf023490f 2026-03-14 09:27:53,471 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 09:27:53,493 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b2870a4bce73bcf023490f HTTP/1.1" 200 None 2026-03-14 09:27:53,494 - lava_callback - DEBUG - Processing node 69b2870a4bce73bcf023490f: baseline-arm-baylibre 2026-03-14 09:27:53,494 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b2870a4bce73bcf023490f 2026-03-14 09:27:53,494 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 09:27:53,527 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b2870a4bce73bcf023490f HTTP/1.1" 200 None 2026-03-14 09:27:53,529 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 09:27:53,542 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ad30bced37758c525e15d2 HTTP/1.1" 200 None 2026-03-14 09:27:53,544 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 09:27:53,564 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b2870a4bce73bcf023490f HTTP/1.1" 200 None 2026-03-14 09:27:53,571 - lava_callback - ERROR - Error processing callback for node 69b2870a4bce73bcf023490f: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:55868 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48364 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47634 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:47646 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46384 - "GET / HTTP/1.0" 200 OK 2026-03-14 09:28:33,445 - lava_callback - INFO - Received callback for node 69b2872f4bce73bcf0234919 INFO: 172.21.0.1:36554 - "POST /node/69b2872f4bce73bcf0234919 HTTP/1.0" 202 Accepted 2026-03-14 09:28:33,450 - lava_callback - INFO - Starting async job submit for node 69b2872f4bce73bcf0234919 2026-03-14 09:28:33,451 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 09:28:33,465 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b2872f4bce73bcf0234919 HTTP/1.1" 200 None 2026-03-14 09:28:33,466 - lava_callback - DEBUG - Processing node 69b2872f4bce73bcf0234919: baseline-arm-baylibre 2026-03-14 09:28:33,466 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b2872f4bce73bcf0234919 2026-03-14 09:28:33,466 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 09:28:33,486 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b2872f4bce73bcf0234919 HTTP/1.1" 200 None 2026-03-14 09:28:33,488 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 09:28:33,501 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ad30bced37758c525e15d2 HTTP/1.1" 200 None 2026-03-14 09:28:33,502 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 09:28:33,523 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b2872f4bce73bcf0234919 HTTP/1.1" 200 None 2026-03-14 09:28:33,524 - lava_callback - ERROR - Error processing callback for node 69b2872f4bce73bcf0234919: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:36558 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36560 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56128 - "GET / HTTP/1.0" 200 OK 2026-03-14 09:28:53,467 - lava_callback - INFO - Received callback for node 69b287534bce73bcf0234925 INFO: 172.21.0.1:48206 - "POST /node/69b287534bce73bcf0234925 HTTP/1.0" 202 Accepted 2026-03-14 09:28:53,472 - lava_callback - INFO - Starting async job submit for node 69b287534bce73bcf0234925 2026-03-14 09:28:53,473 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 09:28:53,487 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b287534bce73bcf0234925 HTTP/1.1" 200 None 2026-03-14 09:28:53,488 - lava_callback - DEBUG - Processing node 69b287534bce73bcf0234925: baseline-arm-baylibre 2026-03-14 09:28:53,489 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b287534bce73bcf0234925 2026-03-14 09:28:53,489 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 09:28:53,505 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b287534bce73bcf0234925 HTTP/1.1" 200 None 2026-03-14 09:28:53,507 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 09:28:53,522 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ad30bced37758c525e15d2 HTTP/1.1" 200 None 2026-03-14 09:28:53,524 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 09:28:53,545 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b287534bce73bcf0234925 HTTP/1.1" 200 None 2026-03-14 09:28:53,555 - lava_callback - ERROR - Error processing callback for node 69b287534bce73bcf0234925: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:48210 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49434 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40006 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:40018 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41814 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33792 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33804 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38094 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55254 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52704 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43452 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:43462 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33766 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49188 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49200 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36286 - "GET / HTTP/1.0" 200 OK 2026-03-14 09:30:48,659 - lava_callback - INFO - Received callback for node 69b287b94bce73bcf0234936 INFO: 172.21.0.1:36290 - "POST /node/69b287b94bce73bcf0234936 HTTP/1.0" 202 Accepted 2026-03-14 09:30:48,664 - lava_callback - INFO - Starting async job submit for node 69b287b94bce73bcf0234936 2026-03-14 09:30:48,665 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 09:30:48,679 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b287b94bce73bcf0234936 HTTP/1.1" 200 None 2026-03-14 09:30:48,680 - lava_callback - DEBUG - Processing node 69b287b94bce73bcf0234936: baseline-arm-clabbe 2026-03-14 09:30:48,680 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b287b94bce73bcf0234936 2026-03-14 09:30:48,681 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 09:30:48,694 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b287b94bce73bcf0234936 HTTP/1.1" 200 None 2026-03-14 09:30:48,695 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 09:30:48,708 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ad30bced37758c525e15d2 HTTP/1.1" 200 None 2026-03-14 09:30:48,709 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 09:30:48,729 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b287b94bce73bcf0234936 HTTP/1.1" 200 None 2026-03-14 09:30:48,730 - lava_callback - ERROR - Error processing callback for node 69b287b94bce73bcf0234936: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:42288 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40858 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46026 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:46034 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36152 - "GET / HTTP/1.0" 200 OK 2026-03-14 09:31:28,529 - lava_callback - INFO - Received callback for node 69b287df4bce73bcf023494c INFO: 172.21.0.1:36160 - "POST /node/69b287df4bce73bcf023494c HTTP/1.0" 202 Accepted 2026-03-14 09:31:28,535 - lava_callback - INFO - Starting async job submit for node 69b287df4bce73bcf023494c 2026-03-14 09:31:28,536 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 09:31:28,550 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b287df4bce73bcf023494c HTTP/1.1" 200 None 2026-03-14 09:31:28,551 - lava_callback - DEBUG - Processing node 69b287df4bce73bcf023494c: baseline-arm-clabbe 2026-03-14 09:31:28,551 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b287df4bce73bcf023494c 2026-03-14 09:31:28,552 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 09:31:28,567 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b287df4bce73bcf023494c HTTP/1.1" 200 None 2026-03-14 09:31:28,568 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 09:31:28,582 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ad30bced37758c525e15d2 HTTP/1.1" 200 None 2026-03-14 09:31:28,584 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 09:31:28,607 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b287df4bce73bcf023494c HTTP/1.1" 200 None 2026-03-14 09:31:28,617 - lava_callback - ERROR - Error processing callback for node 69b287df4bce73bcf023494c: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:43062 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43070 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57166 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44246 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47866 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59442 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:59452 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58910 - "GET / HTTP/1.0" 200 OK 2026-03-14 09:32:28,586 - lava_callback - INFO - Received callback for node 69b288274bce73bcf0234960 INFO: 172.21.0.1:58922 - "POST /node/69b288274bce73bcf0234960 HTTP/1.0" 202 Accepted 2026-03-14 09:32:28,591 - lava_callback - INFO - Starting async job submit for node 69b288274bce73bcf0234960 2026-03-14 09:32:28,592 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 09:32:28,606 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b288274bce73bcf0234960 HTTP/1.1" 200 None 2026-03-14 09:32:28,607 - lava_callback - DEBUG - Processing node 69b288274bce73bcf0234960: baseline-arm-clabbe 2026-03-14 09:32:28,607 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b288274bce73bcf0234960 2026-03-14 09:32:28,608 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 09:32:28,624 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b288274bce73bcf0234960 HTTP/1.1" 200 None 2026-03-14 09:32:28,625 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 09:32:28,639 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ad30bced37758c525e15d2 HTTP/1.1" 200 None 2026-03-14 09:32:28,641 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 09:32:28,683 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b288274bce73bcf0234960 HTTP/1.1" 200 None 2026-03-14 09:32:28,685 - lava_callback - ERROR - Error processing callback for node 69b288274bce73bcf0234960: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:49370 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49384 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33258 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37970 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34262 - "GET / HTTP/1.0" 200 OK 2026-03-14 09:33:13,963 - lava_callback - INFO - Received callback for node 69b288524bce73bcf0234969 INFO: 172.21.0.1:55844 - "POST /node/69b288524bce73bcf0234969 HTTP/1.0" 202 Accepted 2026-03-14 09:33:13,969 - lava_callback - INFO - Starting async job submit for node 69b288524bce73bcf0234969 2026-03-14 09:33:13,970 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 09:33:13,983 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b288524bce73bcf0234969 HTTP/1.1" 200 None 2026-03-14 09:33:13,984 - lava_callback - DEBUG - Processing node 69b288524bce73bcf0234969: baseline-arm64-baylibre 2026-03-14 09:33:13,984 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b288524bce73bcf0234969 2026-03-14 09:33:13,985 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 09:33:13,999 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b288524bce73bcf0234969 HTTP/1.1" 200 None 2026-03-14 09:33:14,000 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 09:33:14,013 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aa8df576ddd5d9e606d49a HTTP/1.1" 200 None 2026-03-14 09:33:14,015 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 09:33:14,035 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b288524bce73bcf0234969 HTTP/1.1" 200 None 2026-03-14 09:33:14,036 - lava_callback - ERROR - Error processing callback for node 69b288524bce73bcf0234969: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:55860 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:55874 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59564 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57594 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57604 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54874 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37918 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47134 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51910 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:51920 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52884 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49602 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49604 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56768 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58252 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49406 - "GET / HTTP/1.0" 200 OK 2026-03-14 09:35:13,928 - lava_callback - INFO - Received callback for node 69b288c34bce73bcf023497c INFO: 172.21.0.1:39668 - "POST /node/69b288c34bce73bcf023497c HTTP/1.0" 202 Accepted 2026-03-14 09:35:13,934 - lava_callback - INFO - Starting async job submit for node 69b288c34bce73bcf023497c 2026-03-14 09:35:13,934 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 09:35:13,949 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b288c34bce73bcf023497c HTTP/1.1" 200 None 2026-03-14 09:35:13,949 - lava_callback - DEBUG - Processing node 69b288c34bce73bcf023497c: baseline-arm64-baylibre 2026-03-14 09:35:13,950 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b288c34bce73bcf023497c 2026-03-14 09:35:13,950 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 09:35:13,964 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b288c34bce73bcf023497c HTTP/1.1" 200 None 2026-03-14 09:35:13,965 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 09:35:13,986 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aa8df576ddd5d9e606d49a HTTP/1.1" 200 None 2026-03-14 09:35:13,987 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 09:35:14,008 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b288c34bce73bcf023497c HTTP/1.1" 200 None 2026-03-14 09:35:14,014 - lava_callback - ERROR - Error processing callback for node 69b288c34bce73bcf023497c: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:39682 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:39698 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55602 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54682 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54698 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44372 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45908 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57600 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56194 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:56200 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36892 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58568 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58584 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40746 - "GET / HTTP/1.0" 200 OK 2026-03-14 09:36:53,987 - lava_callback - INFO - Received callback for node 69b289284bce73bcf023499b INFO: 172.21.0.1:48408 - "POST /node/69b289284bce73bcf023499b HTTP/1.0" 202 Accepted 2026-03-14 09:36:53,992 - lava_callback - INFO - Starting async job submit for node 69b289284bce73bcf023499b 2026-03-14 09:36:53,993 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 09:36:54,009 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b289284bce73bcf023499b HTTP/1.1" 200 None 2026-03-14 09:36:54,010 - lava_callback - DEBUG - Processing node 69b289284bce73bcf023499b: baseline-arm-baylibre 2026-03-14 09:36:54,010 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b289284bce73bcf023499b 2026-03-14 09:36:54,011 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 09:36:54,024 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b289284bce73bcf023499b HTTP/1.1" 200 None 2026-03-14 09:36:54,025 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 09:36:54,039 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69afd826ae557f2600f0f036 HTTP/1.1" 200 None 2026-03-14 09:36:54,040 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 09:36:54,061 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b289284bce73bcf023499b HTTP/1.1" 200 None 2026-03-14 09:36:54,068 - lava_callback - ERROR - Error processing callback for node 69b289284bce73bcf023499b: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:48422 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54748 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48152 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:48164 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37760 - "GET / HTTP/1.0" 200 OK 2026-03-14 09:37:33,984 - lava_callback - INFO - Received callback for node 69b2894b4bce73bcf02349a8 INFO: 172.21.0.1:45634 - "POST /node/69b2894b4bce73bcf02349a8 HTTP/1.0" 202 Accepted 2026-03-14 09:37:33,989 - lava_callback - INFO - Starting async job submit for node 69b2894b4bce73bcf02349a8 2026-03-14 09:37:33,990 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 09:37:34,004 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b2894b4bce73bcf02349a8 HTTP/1.1" 200 None 2026-03-14 09:37:34,005 - lava_callback - DEBUG - Processing node 69b2894b4bce73bcf02349a8: baseline-arm-baylibre 2026-03-14 09:37:34,005 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b2894b4bce73bcf02349a8 2026-03-14 09:37:34,005 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 09:37:34,026 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b2894b4bce73bcf02349a8 HTTP/1.1" 200 None 2026-03-14 09:37:34,027 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 09:37:34,041 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69afd826ae557f2600f0f036 HTTP/1.1" 200 None 2026-03-14 09:37:34,042 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 09:37:34,068 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b2894b4bce73bcf02349a8 HTTP/1.1" 200 None 2026-03-14 09:37:34,070 - lava_callback - ERROR - Error processing callback for node 69b2894b4bce73bcf02349a8: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:45638 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45640 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49866 - "GET / HTTP/1.0" 200 OK 2026-03-14 09:37:54,007 - lava_callback - INFO - Received callback for node 69b2896f4bce73bcf02349b2 INFO: 172.21.0.1:59034 - "POST /node/69b2896f4bce73bcf02349b2 HTTP/1.0" 202 Accepted 2026-03-14 09:37:54,013 - lava_callback - INFO - Starting async job submit for node 69b2896f4bce73bcf02349b2 2026-03-14 09:37:54,013 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 09:37:54,028 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b2896f4bce73bcf02349b2 HTTP/1.1" 200 None 2026-03-14 09:37:54,029 - lava_callback - DEBUG - Processing node 69b2896f4bce73bcf02349b2: baseline-arm-baylibre 2026-03-14 09:37:54,029 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b2896f4bce73bcf02349b2 2026-03-14 09:37:54,029 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 09:37:54,042 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b2896f4bce73bcf02349b2 HTTP/1.1" 200 None 2026-03-14 09:37:54,044 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 09:37:54,057 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69afd826ae557f2600f0f036 HTTP/1.1" 200 None 2026-03-14 09:37:54,058 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 09:37:54,080 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b2896f4bce73bcf02349b2 HTTP/1.1" 200 None 2026-03-14 09:37:54,082 - lava_callback - ERROR - Error processing callback for node 69b2896f4bce73bcf02349b2: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:59048 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33816 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50780 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:50786 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50242 - "GET / HTTP/1.0" 200 OK 2026-03-14 09:38:34,091 - lava_callback - INFO - Received callback for node 69b289944bce73bcf02349bf INFO: 172.21.0.1:42122 - "POST /node/69b289944bce73bcf02349bf HTTP/1.0" 202 Accepted 2026-03-14 09:38:34,096 - lava_callback - INFO - Starting async job submit for node 69b289944bce73bcf02349bf 2026-03-14 09:38:34,097 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 09:38:34,112 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b289944bce73bcf02349bf HTTP/1.1" 200 None 2026-03-14 09:38:34,112 - lava_callback - DEBUG - Processing node 69b289944bce73bcf02349bf: baseline-arm-baylibre 2026-03-14 09:38:34,113 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b289944bce73bcf02349bf 2026-03-14 09:38:34,113 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 09:38:34,126 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b289944bce73bcf02349bf HTTP/1.1" 200 None 2026-03-14 09:38:34,128 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 09:38:34,141 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69afd826ae557f2600f0f036 HTTP/1.1" 200 None 2026-03-14 09:38:34,142 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 09:38:34,165 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b289944bce73bcf02349bf HTTP/1.1" 200 None 2026-03-14 09:38:34,171 - lava_callback - ERROR - Error processing callback for node 69b289944bce73bcf02349bf: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:42132 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42142 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34088 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39696 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52094 - "GET / HTTP/1.0" 200 OK 2026-03-14 09:39:14,082 - lava_callback - INFO - Received callback for node 69b289b94bce73bcf02349cb INFO: 172.21.0.1:48578 - "POST /node/69b289b94bce73bcf02349cb HTTP/1.0" 202 Accepted 2026-03-14 09:39:14,087 - lava_callback - INFO - Starting async job submit for node 69b289b94bce73bcf02349cb 2026-03-14 09:39:14,088 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 09:39:14,103 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b289b94bce73bcf02349cb HTTP/1.1" 200 None 2026-03-14 09:39:14,104 - lava_callback - DEBUG - Processing node 69b289b94bce73bcf02349cb: baseline-arm-baylibre 2026-03-14 09:39:14,104 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b289b94bce73bcf02349cb 2026-03-14 09:39:14,105 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 09:39:14,118 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b289b94bce73bcf02349cb HTTP/1.1" 200 None 2026-03-14 09:39:14,119 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 09:39:14,133 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69afd826ae557f2600f0f036 HTTP/1.1" 200 None 2026-03-14 09:39:14,135 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 09:39:14,155 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b289b94bce73bcf02349cb HTTP/1.1" 200 None 2026-03-14 09:39:14,161 - lava_callback - ERROR - Error processing callback for node 69b289b94bce73bcf02349cb: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:48586 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:48600 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33932 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51694 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51696 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48094 - "GET / HTTP/1.0" 200 OK 2026-03-14 09:39:54,163 - lava_callback - INFO - Received callback for node 69b289dd4bce73bcf02349dd INFO: 172.21.0.1:55692 - "POST /node/69b289dd4bce73bcf02349dd HTTP/1.0" 202 Accepted 2026-03-14 09:39:54,169 - lava_callback - INFO - Starting async job submit for node 69b289dd4bce73bcf02349dd 2026-03-14 09:39:54,169 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 09:39:54,184 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b289dd4bce73bcf02349dd HTTP/1.1" 200 None 2026-03-14 09:39:54,185 - lava_callback - DEBUG - Processing node 69b289dd4bce73bcf02349dd: baseline-arm-baylibre 2026-03-14 09:39:54,185 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b289dd4bce73bcf02349dd 2026-03-14 09:39:54,186 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 09:39:54,199 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b289dd4bce73bcf02349dd HTTP/1.1" 200 None 2026-03-14 09:39:54,201 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 09:39:54,214 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69afd826ae557f2600f0f036 HTTP/1.1" 200 None 2026-03-14 09:39:54,216 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 09:39:54,244 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b289dd4bce73bcf02349dd HTTP/1.1" 200 None 2026-03-14 09:39:54,250 - lava_callback - ERROR - Error processing callback for node 69b289dd4bce73bcf02349dd: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:55702 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60694 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43548 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:43552 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44714 - "GET / HTTP/1.0" 200 OK 2026-03-14 09:40:28,909 - lava_callback - INFO - Received callback for node 69b28a024bce73bcf02349e9 INFO: 172.21.0.1:44718 - "POST /node/69b28a024bce73bcf02349e9 HTTP/1.0" 202 Accepted 2026-03-14 09:40:28,914 - lava_callback - INFO - Starting async job submit for node 69b28a024bce73bcf02349e9 2026-03-14 09:40:28,915 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 09:40:28,930 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b28a024bce73bcf02349e9 HTTP/1.1" 200 None 2026-03-14 09:40:28,931 - lava_callback - DEBUG - Processing node 69b28a024bce73bcf02349e9: baseline-arm-clabbe 2026-03-14 09:40:28,931 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b28a024bce73bcf02349e9 2026-03-14 09:40:28,931 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 09:40:28,946 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b28a024bce73bcf02349e9 HTTP/1.1" 200 None 2026-03-14 09:40:28,948 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 09:40:28,963 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69afd826ae557f2600f0f036 HTTP/1.1" 200 None 2026-03-14 09:40:28,964 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 09:40:28,990 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b28a024bce73bcf02349e9 HTTP/1.1" 200 None 2026-03-14 09:40:28,991 - lava_callback - ERROR - Error processing callback for node 69b28a024bce73bcf02349e9: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:53728 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53738 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44392 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42318 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35136 - "GET / HTTP/1.0" 200 OK 2026-03-14 09:41:08,891 - lava_callback - INFO - Received callback for node 69b28a264bce73bcf02349f8 INFO: 172.21.0.1:35146 - "POST /node/69b28a264bce73bcf02349f8 HTTP/1.0" 202 Accepted 2026-03-14 09:41:08,897 - lava_callback - INFO - Starting async job submit for node 69b28a264bce73bcf02349f8 2026-03-14 09:41:08,897 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 09:41:08,912 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b28a264bce73bcf02349f8 HTTP/1.1" 200 None 2026-03-14 09:41:08,913 - lava_callback - DEBUG - Processing node 69b28a264bce73bcf02349f8: baseline-arm-clabbe 2026-03-14 09:41:08,913 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b28a264bce73bcf02349f8 2026-03-14 09:41:08,913 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 09:41:08,932 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b28a264bce73bcf02349f8 HTTP/1.1" 200 None 2026-03-14 09:41:08,933 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 09:41:08,947 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69afd826ae557f2600f0f036 HTTP/1.1" 200 None 2026-03-14 09:41:08,948 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 09:41:08,970 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b28a264bce73bcf02349f8 HTTP/1.1" 200 None 2026-03-14 09:41:08,971 - lava_callback - ERROR - Error processing callback for node 69b28a264bce73bcf02349f8: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:60790 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:60804 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59978 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52440 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52446 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57220 - "GET / HTTP/1.0" 200 OK 2026-03-14 09:41:48,927 - lava_callback - INFO - Received callback for node 69b28a4b4bce73bcf0234a09 INFO: 172.21.0.1:57224 - "POST /node/69b28a4b4bce73bcf0234a09 HTTP/1.0" 202 Accepted 2026-03-14 09:41:48,932 - lava_callback - INFO - Starting async job submit for node 69b28a4b4bce73bcf0234a09 2026-03-14 09:41:48,933 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 09:41:48,955 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b28a4b4bce73bcf0234a09 HTTP/1.1" 200 None 2026-03-14 09:41:48,956 - lava_callback - DEBUG - Processing node 69b28a4b4bce73bcf0234a09: baseline-arm-clabbe 2026-03-14 09:41:48,956 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b28a4b4bce73bcf0234a09 2026-03-14 09:41:48,957 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 09:41:48,995 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b28a4b4bce73bcf0234a09 HTTP/1.1" 200 None 2026-03-14 09:41:48,996 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 09:41:49,010 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69afd826ae557f2600f0f036 HTTP/1.1" 200 None 2026-03-14 09:41:49,012 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 09:41:49,037 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b28a4b4bce73bcf0234a09 HTTP/1.1" 200 None 2026-03-14 09:41:49,047 - lava_callback - ERROR - Error processing callback for node 69b28a4b4bce73bcf0234a09: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:44752 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57532 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46382 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:46388 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33972 - "GET / HTTP/1.0" 200 OK 2026-03-14 09:42:28,929 - lava_callback - INFO - Received callback for node 69b28a6f4bce73bcf0234a20 INFO: 172.21.0.1:33986 - "POST /node/69b28a6f4bce73bcf0234a20 HTTP/1.0" 202 Accepted 2026-03-14 09:42:28,934 - lava_callback - INFO - Starting async job submit for node 69b28a6f4bce73bcf0234a20 2026-03-14 09:42:28,935 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 09:42:28,959 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b28a6f4bce73bcf0234a20 HTTP/1.1" 200 None 2026-03-14 09:42:28,960 - lava_callback - DEBUG - Processing node 69b28a6f4bce73bcf0234a20: baseline-arm-clabbe 2026-03-14 09:42:28,960 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b28a6f4bce73bcf0234a20 2026-03-14 09:42:28,961 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 09:42:28,974 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b28a6f4bce73bcf0234a20 HTTP/1.1" 200 None 2026-03-14 09:42:28,975 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 09:42:28,989 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69afd826ae557f2600f0f036 HTTP/1.1" 200 None 2026-03-14 09:42:28,990 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 09:42:29,011 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b28a6f4bce73bcf0234a20 HTTP/1.1" 200 None 2026-03-14 09:42:29,012 - lava_callback - ERROR - Error processing callback for node 69b28a6f4bce73bcf0234a20: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:34446 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34454 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51872 - "GET / HTTP/1.0" 200 OK 2026-03-14 09:42:49,014 - lava_callback - INFO - Received callback for node 69b28a944bce73bcf0234a29 INFO: 172.21.0.1:51882 - "POST /node/69b28a944bce73bcf0234a29 HTTP/1.0" 202 Accepted 2026-03-14 09:42:49,019 - lava_callback - INFO - Starting async job submit for node 69b28a944bce73bcf0234a29 2026-03-14 09:42:49,020 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 09:42:49,034 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b28a944bce73bcf0234a29 HTTP/1.1" 200 None 2026-03-14 09:42:49,035 - lava_callback - DEBUG - Processing node 69b28a944bce73bcf0234a29: baseline-arm-clabbe 2026-03-14 09:42:49,035 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b28a944bce73bcf0234a29 2026-03-14 09:42:49,036 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 09:42:49,061 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b28a944bce73bcf0234a29 HTTP/1.1" 200 None 2026-03-14 09:42:49,062 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 09:42:49,077 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69afd826ae557f2600f0f036 HTTP/1.1" 200 None 2026-03-14 09:42:49,079 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 09:42:49,099 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b28a944bce73bcf0234a29 HTTP/1.1" 200 None 2026-03-14 09:42:49,100 - lava_callback - ERROR - Error processing callback for node 69b28a944bce73bcf0234a29: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:54404 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44888 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48250 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:48262 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40738 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59472 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59486 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49338 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44700 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39784 - "GET / HTTP/1.0" 200 OK 2026-03-14 09:44:14,479 - lava_callback - INFO - Received callback for node 69b28ae44bce73bcf0234a48 INFO: 172.21.0.1:55848 - "POST /node/69b28ae44bce73bcf0234a48 HTTP/1.0" 202 Accepted 2026-03-14 09:44:14,484 - lava_callback - INFO - Starting async job submit for node 69b28ae44bce73bcf0234a48 2026-03-14 09:44:14,485 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 09:44:14,499 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b28ae44bce73bcf0234a48 HTTP/1.1" 200 None 2026-03-14 09:44:14,499 - lava_callback - DEBUG - Processing node 69b28ae44bce73bcf0234a48: baseline-arm64-baylibre 2026-03-14 09:44:14,500 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b28ae44bce73bcf0234a48 2026-03-14 09:44:14,500 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 09:44:14,513 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b28ae44bce73bcf0234a48 HTTP/1.1" 200 None 2026-03-14 09:44:14,514 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 09:44:14,545 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aa8df576ddd5d9e606d49a HTTP/1.1" 200 None 2026-03-14 09:44:14,547 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 09:44:14,567 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b28ae44bce73bcf0234a48 HTTP/1.1" 200 None 2026-03-14 09:44:14,568 - lava_callback - ERROR - Error processing callback for node 69b28ae44bce73bcf0234a48: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:55862 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:55872 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50432 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59070 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59072 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57380 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51638 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60108 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46968 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:46980 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55938 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59864 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59866 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38824 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37506 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36232 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60966 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:60980 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54702 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57174 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57188 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44554 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54262 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43306 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54092 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:54100 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49608 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43852 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43854 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36790 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59818 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39402 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53532 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:53536 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41658 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58438 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58442 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57244 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41090 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56616 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53048 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:53050 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49382 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34584 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34588 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36128 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44756 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38596 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43004 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:43008 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48926 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34444 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34446 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45614 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33262 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54232 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55192 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:55198 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47764 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:32986 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:32992 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58598 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47018 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51636 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53154 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:53162 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44086 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44004 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44018 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52812 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49234 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54328 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50518 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:50524 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40668 - "GET / HTTP/1.0" 200 OK 2026-03-14 09:53:35,220 - lava_callback - INFO - Received callback for node 69b28d144bce73bcf0234abc INFO: 172.21.0.1:42460 - "POST /node/69b28d144bce73bcf0234abc HTTP/1.0" 202 Accepted 2026-03-14 09:53:35,226 - lava_callback - INFO - Starting async job submit for node 69b28d144bce73bcf0234abc 2026-03-14 09:53:35,227 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 09:53:35,260 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b28d144bce73bcf0234abc HTTP/1.1" 200 None 2026-03-14 09:53:35,261 - lava_callback - DEBUG - Processing node 69b28d144bce73bcf0234abc: baseline-arm64-baylibre 2026-03-14 09:53:35,262 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b28d144bce73bcf0234abc 2026-03-14 09:53:35,262 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 09:53:35,281 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b28d144bce73bcf0234abc HTTP/1.1" 200 None 2026-03-14 09:53:35,283 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 09:53:35,296 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aa8df576ddd5d9e606d49a HTTP/1.1" 200 None 2026-03-14 09:53:35,298 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 09:53:35,323 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b28d144bce73bcf0234abc HTTP/1.1" 200 None 2026-03-14 09:53:35,325 - lava_callback - ERROR - Error processing callback for node 69b28d144bce73bcf0234abc: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:42462 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42466 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50602 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46700 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40754 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47508 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:47512 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43716 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40476 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40484 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50762 - "GET / HTTP/1.0" 200 OK 2026-03-14 09:54:55,231 - lava_callback - INFO - Received callback for node 69b28d5b4bce73bcf0234ad8 INFO: 172.21.0.1:40764 - "POST /node/69b28d5b4bce73bcf0234ad8 HTTP/1.0" 202 Accepted 2026-03-14 09:54:55,236 - lava_callback - INFO - Starting async job submit for node 69b28d5b4bce73bcf0234ad8 2026-03-14 09:54:55,237 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 09:54:55,257 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b28d5b4bce73bcf0234ad8 HTTP/1.1" 200 None 2026-03-14 09:54:55,259 - lava_callback - DEBUG - Processing node 69b28d5b4bce73bcf0234ad8: baseline-arm64-baylibre 2026-03-14 09:54:55,259 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b28d5b4bce73bcf0234ad8 2026-03-14 09:54:55,260 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 09:54:55,275 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b28d5b4bce73bcf0234ad8 HTTP/1.1" 200 None 2026-03-14 09:54:55,277 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 09:54:55,291 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69afd839ae557f2600f0f045 HTTP/1.1" 200 None 2026-03-14 09:54:55,292 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 09:54:55,336 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b28d5b4bce73bcf0234ad8 HTTP/1.1" 200 None 2026-03-14 09:54:55,337 - lava_callback - ERROR - Error processing callback for node 69b28d5b4bce73bcf0234ad8: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:40766 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47476 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38488 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:38498 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60160 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36342 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36352 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37462 - "GET / HTTP/1.0" 200 OK 2026-03-14 09:55:55,043 - lava_callback - INFO - Received callback for node 69b28da54bce73bcf0234ae2 INFO: 172.21.0.1:51060 - "POST /node/69b28da54bce73bcf0234ae2 HTTP/1.0" 202 Accepted 2026-03-14 09:55:55,049 - lava_callback - INFO - Starting async job submit for node 69b28da54bce73bcf0234ae2 2026-03-14 09:55:55,050 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 09:55:55,064 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b28da54bce73bcf0234ae2 HTTP/1.1" 200 None 2026-03-14 09:55:55,065 - lava_callback - DEBUG - Processing node 69b28da54bce73bcf0234ae2: baseline-arm64-baylibre 2026-03-14 09:55:55,066 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b28da54bce73bcf0234ae2 2026-03-14 09:55:55,066 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 09:55:55,081 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b28da54bce73bcf0234ae2 HTTP/1.1" 200 None 2026-03-14 09:55:55,083 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 09:55:55,107 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69afd839ae557f2600f0f045 HTTP/1.1" 200 None 2026-03-14 09:55:55,108 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 09:55:55,130 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b28da54bce73bcf0234ae2 HTTP/1.1" 200 None 2026-03-14 09:55:55,131 - lava_callback - ERROR - Error processing callback for node 69b28da54bce73bcf0234ae2: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:51068 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38454 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38638 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:38642 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52474 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58376 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58388 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54876 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44838 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37582 - "GET / HTTP/1.0" 200 OK 2026-03-14 09:57:15,128 - lava_callback - INFO - Received callback for node 69b28df04bce73bcf0234ae8 INFO: 172.21.0.1:36454 - "POST /node/69b28df04bce73bcf0234ae8 HTTP/1.0" 202 Accepted 2026-03-14 09:57:15,134 - lava_callback - INFO - Starting async job submit for node 69b28df04bce73bcf0234ae8 2026-03-14 09:57:15,134 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 09:57:15,149 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b28df04bce73bcf0234ae8 HTTP/1.1" 200 None 2026-03-14 09:57:15,150 - lava_callback - DEBUG - Processing node 69b28df04bce73bcf0234ae8: baseline-arm64-baylibre 2026-03-14 09:57:15,150 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b28df04bce73bcf0234ae8 2026-03-14 09:57:15,151 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 INFO: 172.21.0.1:36464 - "GET /api/metrics HTTP/1.0" 200 OK 2026-03-14 09:57:15,188 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b28df04bce73bcf0234ae8 HTTP/1.1" 200 None 2026-03-14 09:57:15,190 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 09:57:15,204 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69afd839ae557f2600f0f045 HTTP/1.1" 200 None 2026-03-14 09:57:15,205 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 09:57:15,230 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b28df04bce73bcf0234ae8 HTTP/1.1" 200 None 2026-03-14 09:57:15,232 - lava_callback - ERROR - Error processing callback for node 69b28df04bce73bcf0234ae8: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:36472 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53962 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54136 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54138 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34920 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59316 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60696 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46238 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:46250 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43394 - "GET / HTTP/1.0" 200 OK 2026-03-14 09:58:35,151 - lava_callback - INFO - Received callback for node 69b28e3b4bce73bcf0234af3 INFO: 172.21.0.1:36788 - "POST /node/69b28e3b4bce73bcf0234af3 HTTP/1.0" 202 Accepted 2026-03-14 09:58:35,157 - lava_callback - INFO - Starting async job submit for node 69b28e3b4bce73bcf0234af3 2026-03-14 09:58:35,158 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 09:58:35,172 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b28e3b4bce73bcf0234af3 HTTP/1.1" 200 None 2026-03-14 09:58:35,173 - lava_callback - DEBUG - Processing node 69b28e3b4bce73bcf0234af3: baseline-arm64-baylibre 2026-03-14 09:58:35,173 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b28e3b4bce73bcf0234af3 2026-03-14 09:58:35,173 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 09:58:35,186 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b28e3b4bce73bcf0234af3 HTTP/1.1" 200 None 2026-03-14 09:58:35,188 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 09:58:35,200 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69afd839ae557f2600f0f045 HTTP/1.1" 200 None 2026-03-14 09:58:35,201 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 09:58:35,221 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b28e3b4bce73bcf0234af3 HTTP/1.1" 200 None 2026-03-14 09:58:35,223 - lava_callback - ERROR - Error processing callback for node 69b28e3b4bce73bcf0234af3: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:36794 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36806 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47514 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37560 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54678 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36372 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:36374 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38102 - "GET / HTTP/1.0" 200 OK 2026-03-14 09:59:35,388 - lava_callback - INFO - Received callback for node 69b28e854bce73bcf0234afa INFO: 172.21.0.1:34876 - "POST /node/69b28e854bce73bcf0234afa HTTP/1.0" 202 Accepted 2026-03-14 09:59:35,394 - lava_callback - INFO - Starting async job submit for node 69b28e854bce73bcf0234afa 2026-03-14 09:59:35,395 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 09:59:35,424 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b28e854bce73bcf0234afa HTTP/1.1" 200 None 2026-03-14 09:59:35,425 - lava_callback - DEBUG - Processing node 69b28e854bce73bcf0234afa: baseline-arm64-baylibre 2026-03-14 09:59:35,425 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b28e854bce73bcf0234afa 2026-03-14 09:59:35,426 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 09:59:35,439 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b28e854bce73bcf0234afa HTTP/1.1" 200 None 2026-03-14 09:59:35,441 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 09:59:35,455 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69afd839ae557f2600f0f045 HTTP/1.1" 200 None 2026-03-14 09:59:35,457 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 09:59:35,477 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b28e854bce73bcf0234afa HTTP/1.1" 200 None 2026-03-14 09:59:35,478 - lava_callback - ERROR - Error processing callback for node 69b28e854bce73bcf0234afa: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:34890 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34906 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54362 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57652 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41090 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:32868 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:32878 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40382 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40276 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40282 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41064 - "GET / HTTP/1.0" 200 OK 2026-03-14 10:00:55,308 - lava_callback - INFO - Received callback for node 69b28ecf4bce73bcf0234b08 INFO: 172.21.0.1:57698 - "POST /node/69b28ecf4bce73bcf0234b08 HTTP/1.0" 202 Accepted 2026-03-14 10:00:55,314 - lava_callback - INFO - Starting async job submit for node 69b28ecf4bce73bcf0234b08 2026-03-14 10:00:55,315 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 10:00:55,334 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b28ecf4bce73bcf0234b08 HTTP/1.1" 200 None 2026-03-14 10:00:55,335 - lava_callback - DEBUG - Processing node 69b28ecf4bce73bcf0234b08: baseline-arm64-baylibre 2026-03-14 10:00:55,335 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b28ecf4bce73bcf0234b08 2026-03-14 10:00:55,336 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 10:00:55,349 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b28ecf4bce73bcf0234b08 HTTP/1.1" 200 None 2026-03-14 10:00:55,351 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 10:00:55,364 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69afd839ae557f2600f0f045 HTTP/1.1" 200 None 2026-03-14 10:00:55,366 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 10:00:55,390 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b28ecf4bce73bcf0234b08 HTTP/1.1" 200 None 2026-03-14 10:00:55,392 - lava_callback - ERROR - Error processing callback for node 69b28ecf4bce73bcf0234b08: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:57702 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48344 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45352 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:45364 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52608 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60498 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60508 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41564 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50368 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46206 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35188 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:35204 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57398 - "GET / HTTP/1.0" 200 OK 2026-03-14 10:02:29,929 - lava_callback - INFO - Received callback for node 69b28f204bce73bcf0234b11 INFO: 172.21.0.1:40534 - "POST /node/69b28f204bce73bcf0234b11 HTTP/1.0" 202 Accepted 2026-03-14 10:02:29,935 - lava_callback - INFO - Starting async job submit for node 69b28f204bce73bcf0234b11 2026-03-14 10:02:29,936 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 10:02:29,962 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b28f204bce73bcf0234b11 HTTP/1.1" 200 None 2026-03-14 10:02:29,963 - lava_callback - DEBUG - Processing node 69b28f204bce73bcf0234b11: baseline-arm64-clabbe 2026-03-14 10:02:29,964 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b28f204bce73bcf0234b11 2026-03-14 10:02:29,964 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 10:02:29,978 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b28f204bce73bcf0234b11 HTTP/1.1" 200 None 2026-03-14 10:02:29,979 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 10:02:29,993 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69afd839ae557f2600f0f045 HTTP/1.1" 200 None 2026-03-14 10:02:29,995 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 10:02:30,023 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b28f204bce73bcf0234b11 HTTP/1.1" 200 None 2026-03-14 10:02:30,025 - lava_callback - ERROR - Error processing callback for node 69b28f204bce73bcf0234b11: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:40542 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40558 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45164 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58276 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38884 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:32958 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:32962 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58342 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59742 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59746 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48190 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36986 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41274 - "GET / HTTP/1.0" 200 OK 2026-03-14 10:04:09,941 - lava_callback - INFO - Received callback for node 69b28f8e4bce73bcf0234b2f INFO: 172.21.0.1:39632 - "POST /node/69b28f8e4bce73bcf0234b2f HTTP/1.0" 202 Accepted 2026-03-14 10:04:09,946 - lava_callback - INFO - Starting async job submit for node 69b28f8e4bce73bcf0234b2f 2026-03-14 10:04:09,947 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 10:04:09,970 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b28f8e4bce73bcf0234b2f HTTP/1.1" 200 None 2026-03-14 10:04:09,971 - lava_callback - DEBUG - Processing node 69b28f8e4bce73bcf0234b2f: baseline-arm64-clabbe 2026-03-14 10:04:09,971 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b28f8e4bce73bcf0234b2f 2026-03-14 10:04:09,972 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 10:04:09,985 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b28f8e4bce73bcf0234b2f HTTP/1.1" 200 None 2026-03-14 10:04:09,987 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 10:04:10,000 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69afd839ae557f2600f0f045 HTTP/1.1" 200 None 2026-03-14 10:04:10,002 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 10:04:10,023 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b28f8e4bce73bcf0234b2f HTTP/1.1" 200 None 2026-03-14 10:04:10,024 - lava_callback - ERROR - Error processing callback for node 69b28f8e4bce73bcf0234b2f: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:39634 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:39648 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51844 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37380 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37382 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37024 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48012 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49578 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33380 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:33392 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56650 - "GET / HTTP/1.0" 200 OK 2026-03-14 10:05:30,041 - lava_callback - INFO - Received callback for node 69b28fda4bce73bcf0234b40 INFO: 172.21.0.1:35746 - "POST /node/69b28fda4bce73bcf0234b40 HTTP/1.0" 202 Accepted 2026-03-14 10:05:30,047 - lava_callback - INFO - Starting async job submit for node 69b28fda4bce73bcf0234b40 2026-03-14 10:05:30,048 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 10:05:30,071 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b28fda4bce73bcf0234b40 HTTP/1.1" 200 None 2026-03-14 10:05:30,072 - lava_callback - DEBUG - Processing node 69b28fda4bce73bcf0234b40: baseline-arm64-clabbe 2026-03-14 10:05:30,072 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b28fda4bce73bcf0234b40 2026-03-14 10:05:30,072 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 10:05:30,086 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b28fda4bce73bcf0234b40 HTTP/1.1" 200 None 2026-03-14 10:05:30,087 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 10:05:30,101 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69afd839ae557f2600f0f045 HTTP/1.1" 200 None 2026-03-14 10:05:30,103 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 10:05:30,128 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b28fda4bce73bcf0234b40 HTTP/1.1" 200 None 2026-03-14 10:05:30,129 - lava_callback - ERROR - Error processing callback for node 69b28fda4bce73bcf0234b40: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:35760 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35774 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35378 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44000 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49836 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46314 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:46318 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36490 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45922 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45930 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42042 - "GET / HTTP/1.0" 200 OK 2026-03-14 10:06:50,094 - lava_callback - INFO - Received callback for node 69b290284bce73bcf0234b47 INFO: 172.21.0.1:51212 - "POST /node/69b290284bce73bcf0234b47 HTTP/1.0" 202 Accepted 2026-03-14 10:06:50,099 - lava_callback - INFO - Starting async job submit for node 69b290284bce73bcf0234b47 2026-03-14 10:06:50,100 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 10:06:50,116 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b290284bce73bcf0234b47 HTTP/1.1" 200 None 2026-03-14 10:06:50,117 - lava_callback - DEBUG - Processing node 69b290284bce73bcf0234b47: baseline-arm64-clabbe 2026-03-14 10:06:50,117 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b290284bce73bcf0234b47 2026-03-14 10:06:50,118 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 10:06:50,144 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b290284bce73bcf0234b47 HTTP/1.1" 200 None 2026-03-14 10:06:50,145 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 10:06:50,159 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69afd839ae557f2600f0f045 HTTP/1.1" 200 None 2026-03-14 10:06:50,160 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 10:06:50,181 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b290284bce73bcf0234b47 HTTP/1.1" 200 None 2026-03-14 10:06:50,183 - lava_callback - ERROR - Error processing callback for node 69b290284bce73bcf0234b47: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:51228 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40560 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56680 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:56682 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36342 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46090 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46092 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46364 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56490 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37354 - "GET / HTTP/1.0" 200 OK 2026-03-14 10:08:10,173 - lava_callback - INFO - Received callback for node 69b290754bce73bcf0234b57 INFO: 172.21.0.1:33722 - "POST /node/69b290754bce73bcf0234b57 HTTP/1.0" 202 Accepted 2026-03-14 10:08:10,179 - lava_callback - INFO - Starting async job submit for node 69b290754bce73bcf0234b57 2026-03-14 10:08:10,180 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 10:08:10,194 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b290754bce73bcf0234b57 HTTP/1.1" 200 None 2026-03-14 10:08:10,194 - lava_callback - DEBUG - Processing node 69b290754bce73bcf0234b57: baseline-arm64-clabbe 2026-03-14 10:08:10,195 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b290754bce73bcf0234b57 2026-03-14 10:08:10,195 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 10:08:10,209 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b290754bce73bcf0234b57 HTTP/1.1" 200 None 2026-03-14 10:08:10,211 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 10:08:10,225 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69afd839ae557f2600f0f045 HTTP/1.1" 200 None 2026-03-14 10:08:10,227 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 10:08:10,247 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b290754bce73bcf0234b57 HTTP/1.1" 200 None 2026-03-14 10:08:10,249 - lava_callback - ERROR - Error processing callback for node 69b290754bce73bcf0234b57: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:33724 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:33736 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40142 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41730 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41740 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46250 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36518 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42820 - "GET / HTTP/1.0" 200 OK 2026-03-14 10:09:10,202 - lava_callback - INFO - Received callback for node 69b290c04bce73bcf0234b5d INFO: 172.21.0.1:44124 - "POST /node/69b290c04bce73bcf0234b5d HTTP/1.0" 202 Accepted 2026-03-14 10:09:10,207 - lava_callback - INFO - Starting async job submit for node 69b290c04bce73bcf0234b5d 2026-03-14 10:09:10,208 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 10:09:10,224 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b290c04bce73bcf0234b5d HTTP/1.1" 200 None 2026-03-14 10:09:10,225 - lava_callback - DEBUG - Processing node 69b290c04bce73bcf0234b5d: baseline-arm64-clabbe 2026-03-14 10:09:10,226 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b290c04bce73bcf0234b5d 2026-03-14 10:09:10,226 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 10:09:10,242 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b290c04bce73bcf0234b5d HTTP/1.1" 200 None 2026-03-14 10:09:10,243 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 10:09:10,257 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69afd839ae557f2600f0f045 HTTP/1.1" 200 None 2026-03-14 10:09:10,258 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 10:09:10,280 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b290c04bce73bcf0234b5d HTTP/1.1" 200 None 2026-03-14 10:09:10,281 - lava_callback - ERROR - Error processing callback for node 69b290c04bce73bcf0234b5d: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:44140 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:44144 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34658 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40850 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40858 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50296 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34562 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:32994 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:32870 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:32876 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36394 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43636 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43644 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33394 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55000 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40460 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33676 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:33682 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50192 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46286 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46300 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49262 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58918 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59762 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38150 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:38156 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49846 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33990 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34002 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39032 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53170 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35238 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50888 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:50902 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52508 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38174 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38188 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57552 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35146 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53628 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41230 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:41236 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38806 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53022 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53032 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44998 - "GET / HTTP/1.0" 200 OK 2026-03-14 10:14:50,395 - lava_callback - INFO - Received callback for node 69b292134bce73bcf0234ba2 INFO: 172.21.0.1:42152 - "POST /node/69b292134bce73bcf0234ba2 HTTP/1.0" 202 Accepted 2026-03-14 10:14:50,401 - lava_callback - INFO - Starting async job submit for node 69b292134bce73bcf0234ba2 2026-03-14 10:14:50,402 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 10:14:50,417 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b292134bce73bcf0234ba2 HTTP/1.1" 200 None 2026-03-14 10:14:50,418 - lava_callback - DEBUG - Processing node 69b292134bce73bcf0234ba2: baseline-arm64-clabbe 2026-03-14 10:14:50,418 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b292134bce73bcf0234ba2 2026-03-14 10:14:50,419 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 10:14:50,460 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b292134bce73bcf0234ba2 HTTP/1.1" 200 None 2026-03-14 10:14:50,461 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 10:14:50,482 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aa8df576ddd5d9e606d49a HTTP/1.1" 200 None 2026-03-14 10:14:50,484 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 10:14:50,504 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b292134bce73bcf0234ba2 HTTP/1.1" 200 None 2026-03-14 10:14:50,506 - lava_callback - ERROR - Error processing callback for node 69b292134bce73bcf0234ba2: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:42158 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47324 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35724 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:35728 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40726 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42332 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42338 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35544 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55170 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55156 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46148 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:46150 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57660 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52640 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52650 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50534 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54024 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53756 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37966 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:37974 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44598 - "GET / HTTP/1.0" 200 OK 2026-03-14 10:17:30,597 - lava_callback - INFO - Received callback for node 69b292a44bce73bcf0234bcb INFO: 172.21.0.1:46432 - "POST /node/69b292a44bce73bcf0234bcb HTTP/1.0" 202 Accepted 2026-03-14 10:17:30,603 - lava_callback - INFO - Starting async job submit for node 69b292a44bce73bcf0234bcb 2026-03-14 10:17:30,604 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 10:17:30,618 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b292a44bce73bcf0234bcb HTTP/1.1" 200 None 2026-03-14 10:17:30,619 - lava_callback - DEBUG - Processing node 69b292a44bce73bcf0234bcb: baseline-arm64-clabbe 2026-03-14 10:17:30,620 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b292a44bce73bcf0234bcb 2026-03-14 10:17:30,620 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 10:17:30,633 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b292a44bce73bcf0234bcb HTTP/1.1" 200 None 2026-03-14 10:17:30,634 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 10:17:30,647 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aa8df576ddd5d9e606d49a HTTP/1.1" 200 None 2026-03-14 10:17:30,648 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 10:17:30,669 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b292a44bce73bcf0234bcb HTTP/1.1" 200 None 2026-03-14 10:17:30,675 - lava_callback - ERROR - Error processing callback for node 69b292a44bce73bcf0234bcb: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:46434 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46438 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53346 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57786 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36822 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42284 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:42290 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53876 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35994 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35996 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57010 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38932 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42858 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39886 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:39888 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46886 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41304 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41308 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53540 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52158 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38382 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59034 - "GET /api/metrics HTTP/1.0" 200 OK 2026-03-14 10:20:16,411 - lava_callback - INFO - Received callback for node 69b2934c4bce73bcf0234bea INFO: 172.21.0.1:59046 - "POST /node/69b2934c4bce73bcf0234bea HTTP/1.0" 202 Accepted 2026-03-14 10:20:16,417 - lava_callback - INFO - Starting async job submit for node 69b2934c4bce73bcf0234bea 2026-03-14 10:20:16,417 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 10:20:16,432 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b2934c4bce73bcf0234bea HTTP/1.1" 200 None 2026-03-14 10:20:16,433 - lava_callback - DEBUG - Processing node 69b2934c4bce73bcf0234bea: baseline-arm64-baylibre 2026-03-14 10:20:16,433 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b2934c4bce73bcf0234bea 2026-03-14 10:20:16,434 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 10:20:16,448 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b2934c4bce73bcf0234bea HTTP/1.1" 200 None 2026-03-14 10:20:16,449 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 10:20:16,481 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ad30c9ed37758c525e15e4 HTTP/1.1" 200 None 2026-03-14 10:20:16,483 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 10:20:16,504 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b2934c4bce73bcf0234bea HTTP/1.1" 200 None 2026-03-14 10:20:16,506 - lava_callback - ERROR - Error processing callback for node 69b2934c4bce73bcf0234bea: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:59050 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46856 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47454 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47464 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55906 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42394 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49550 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45038 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:45048 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38168 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54200 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54208 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39358 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54862 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57750 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33068 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:33076 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54076 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53958 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53968 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52292 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46592 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40264 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50916 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:50926 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51720 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44894 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44898 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39452 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47470 - "GET / HTTP/1.0" 200 OK 2026-03-14 10:23:56,613 - lava_callback - INFO - Received callback for node 69b294324bce73bcf0234c1d INFO: 172.21.0.1:47480 - "POST /node/69b294324bce73bcf0234c1d HTTP/1.0" 202 Accepted 2026-03-14 10:23:56,619 - lava_callback - INFO - Starting async job submit for node 69b294324bce73bcf0234c1d 2026-03-14 10:23:56,620 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 10:23:56,644 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b294324bce73bcf0234c1d HTTP/1.1" 200 None 2026-03-14 10:23:56,644 - lava_callback - DEBUG - Processing node 69b294324bce73bcf0234c1d: baseline-arm64-baylibre 2026-03-14 10:23:56,645 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b294324bce73bcf0234c1d 2026-03-14 10:23:56,645 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 10:23:56,689 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b294324bce73bcf0234c1d HTTP/1.1" 200 None 2026-03-14 10:23:56,691 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 10:23:56,705 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ad30c9ed37758c525e15e4 HTTP/1.1" 200 None 2026-03-14 10:23:56,706 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 10:23:56,728 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b294324bce73bcf0234c1d HTTP/1.1" 200 None 2026-03-14 10:23:56,735 - lava_callback - ERROR - Error processing callback for node 69b294324bce73bcf0234c1d: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:37792 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47470 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:47472 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51348 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36564 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36568 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58658 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39282 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60746 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45862 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:45872 - "GET / HTTP/1.0" 200 OK 2026-03-14 10:25:16,710 - lava_callback - INFO - Received callback for node 69b2947c4bce73bcf0234c24 INFO: 172.21.0.1:45874 - "POST /node/69b2947c4bce73bcf0234c24 HTTP/1.0" 202 Accepted 2026-03-14 10:25:16,716 - lava_callback - INFO - Starting async job submit for node 69b2947c4bce73bcf0234c24 2026-03-14 10:25:16,717 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 10:25:16,736 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b2947c4bce73bcf0234c24 HTTP/1.1" 200 None 2026-03-14 10:25:16,737 - lava_callback - DEBUG - Processing node 69b2947c4bce73bcf0234c24: baseline-arm64-baylibre 2026-03-14 10:25:16,737 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b2947c4bce73bcf0234c24 2026-03-14 10:25:16,738 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 10:25:16,750 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b2947c4bce73bcf0234c24 HTTP/1.1" 200 None 2026-03-14 10:25:16,752 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 10:25:16,764 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ad30c9ed37758c525e15e4 HTTP/1.1" 200 None 2026-03-14 10:25:16,766 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 10:25:16,785 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b2947c4bce73bcf0234c24 HTTP/1.1" 200 None 2026-03-14 10:25:16,787 - lava_callback - ERROR - Error processing callback for node 69b2947c4bce73bcf0234c24: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:49432 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57936 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57950 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:32954 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58842 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44004 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36156 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:36170 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54516 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42044 - "GET / HTTP/1.0" 200 OK 2026-03-14 10:26:36,738 - lava_callback - INFO - Received callback for node 69b294c74bce73bcf0234c34 INFO: 172.21.0.1:42060 - "POST /node/69b294c74bce73bcf0234c34 HTTP/1.0" 202 Accepted 2026-03-14 10:26:36,744 - lava_callback - INFO - Starting async job submit for node 69b294c74bce73bcf0234c34 2026-03-14 10:26:36,745 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 10:26:36,764 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b294c74bce73bcf0234c34 HTTP/1.1" 200 None 2026-03-14 10:26:36,765 - lava_callback - DEBUG - Processing node 69b294c74bce73bcf0234c34: baseline-arm64-baylibre 2026-03-14 10:26:36,765 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b294c74bce73bcf0234c34 2026-03-14 10:26:36,765 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 10:26:36,779 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b294c74bce73bcf0234c34 HTTP/1.1" 200 None 2026-03-14 10:26:36,780 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 10:26:36,794 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ad30c9ed37758c525e15e4 HTTP/1.1" 200 None 2026-03-14 10:26:36,795 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 10:26:36,815 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b294c74bce73bcf0234c34 HTTP/1.1" 200 None 2026-03-14 10:26:36,822 - lava_callback - ERROR - Error processing callback for node 69b294c74bce73bcf0234c34: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:42064 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36754 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33126 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36960 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56774 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:56782 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39842 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34598 - "GET / HTTP/1.0" 200 OK 2026-03-14 10:27:36,790 - lava_callback - INFO - Received callback for node 69b295114bce73bcf0234c3e INFO: 172.21.0.1:34604 - "POST /node/69b295114bce73bcf0234c3e HTTP/1.0" 202 Accepted 2026-03-14 10:27:36,796 - lava_callback - INFO - Starting async job submit for node 69b295114bce73bcf0234c3e 2026-03-14 10:27:36,797 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 10:27:36,811 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b295114bce73bcf0234c3e HTTP/1.1" 200 None 2026-03-14 10:27:36,812 - lava_callback - DEBUG - Processing node 69b295114bce73bcf0234c3e: baseline-arm64-baylibre 2026-03-14 10:27:36,812 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b295114bce73bcf0234c3e 2026-03-14 10:27:36,813 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 10:27:36,836 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b295114bce73bcf0234c3e HTTP/1.1" 200 None 2026-03-14 10:27:36,838 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 10:27:36,850 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ad30c9ed37758c525e15e4 HTTP/1.1" 200 None 2026-03-14 10:27:36,852 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 10:27:36,873 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b295114bce73bcf0234c3e HTTP/1.1" 200 None 2026-03-14 10:27:36,874 - lava_callback - ERROR - Error processing callback for node 69b295114bce73bcf0234c3e: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:34620 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55722 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47646 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59282 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36038 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:36052 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38668 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36598 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36606 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40890 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55328 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33358 - "GET / HTTP/1.0" 200 OK 2026-03-14 10:29:11,018 - lava_callback - INFO - Received callback for node 69b295624bce73bcf0234c50 INFO: 172.21.0.1:41438 - "POST /node/69b295624bce73bcf0234c50 HTTP/1.0" 202 Accepted 2026-03-14 10:29:11,024 - lava_callback - INFO - Starting async job submit for node 69b295624bce73bcf0234c50 2026-03-14 10:29:11,024 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 10:29:11,050 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b295624bce73bcf0234c50 HTTP/1.1" 200 None 2026-03-14 10:29:11,051 - lava_callback - DEBUG - Processing node 69b295624bce73bcf0234c50: baseline-arm64-clabbe 2026-03-14 10:29:11,051 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b295624bce73bcf0234c50 2026-03-14 10:29:11,052 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 10:29:11,066 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b295624bce73bcf0234c50 HTTP/1.1" 200 None 2026-03-14 10:29:11,068 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 10:29:11,081 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ad30c9ed37758c525e15e4 HTTP/1.1" 200 None 2026-03-14 10:29:11,082 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 10:29:11,103 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b295624bce73bcf0234c50 HTTP/1.1" 200 None 2026-03-14 10:29:11,108 - lava_callback - ERROR - Error processing callback for node 69b295624bce73bcf0234c50: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:41448 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:41462 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45380 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53820 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53828 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35234 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39508 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47948 - "GET / HTTP/1.0" 200 OK 2026-03-14 10:30:11,120 - lava_callback - INFO - Received callback for node 69b295ac4bce73bcf0234c59 INFO: 172.21.0.1:32840 - "POST /node/69b295ac4bce73bcf0234c59 HTTP/1.0" 202 Accepted 2026-03-14 10:30:11,125 - lava_callback - INFO - Starting async job submit for node 69b295ac4bce73bcf0234c59 2026-03-14 10:30:11,127 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 10:30:11,140 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b295ac4bce73bcf0234c59 HTTP/1.1" 200 None 2026-03-14 10:30:11,141 - lava_callback - DEBUG - Processing node 69b295ac4bce73bcf0234c59: baseline-arm64-clabbe 2026-03-14 10:30:11,141 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b295ac4bce73bcf0234c59 2026-03-14 10:30:11,142 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 10:30:11,155 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b295ac4bce73bcf0234c59 HTTP/1.1" 200 None 2026-03-14 10:30:11,157 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 10:30:11,170 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ad30c9ed37758c525e15e4 HTTP/1.1" 200 None 2026-03-14 10:30:11,171 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 10:30:11,209 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b295ac4bce73bcf0234c59 HTTP/1.1" 200 None 2026-03-14 10:30:11,211 - lava_callback - ERROR - Error processing callback for node 69b295ac4bce73bcf0234c59: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:32844 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:32858 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58426 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51208 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51214 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44124 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34248 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48436 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39974 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:39980 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48074 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41422 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41432 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49676 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51586 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49800 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51994 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:52008 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60266 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55700 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55706 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38154 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35770 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33970 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60656 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:60666 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43628 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51742 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51754 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60698 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51604 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55388 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54300 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:54306 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43444 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42642 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42648 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42250 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54518 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34908 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42092 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:42104 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45424 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58604 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58616 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41876 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47048 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37546 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34028 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:34032 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42910 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57972 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57980 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47550 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47756 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41776 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57030 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:57044 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47514 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49450 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49456 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57504 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51888 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49186 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39838 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:39844 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45514 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47672 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47684 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42606 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42712 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50908 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46576 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:46580 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57202 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60850 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60854 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55166 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47734 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46502 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38288 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:38302 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60238 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60878 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60886 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36220 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55838 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59062 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37296 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:37310 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49316 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51468 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51484 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60918 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34356 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40934 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53388 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:53398 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59060 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54510 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54520 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54318 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49224 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47676 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35124 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:35134 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55928 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40012 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40024 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41892 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58822 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46348 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53888 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:53904 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35586 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41730 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41742 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40092 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46534 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37856 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35540 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:35550 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51264 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49970 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49972 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37148 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43408 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48446 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41554 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:41560 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54000 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55366 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55370 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54620 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45046 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53018 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50834 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:50848 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37380 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36500 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36510 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45058 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36598 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60860 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47196 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:47206 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45324 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42848 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42862 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38266 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58830 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33086 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41510 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:41516 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43226 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41146 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41150 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47356 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36782 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52818 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46806 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:46818 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55356 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50818 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50834 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56752 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52484 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57370 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47662 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:47676 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41398 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33382 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33386 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49338 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41090 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39644 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54302 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:54316 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46362 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45818 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45822 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49292 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53814 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38714 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34914 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:34918 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48422 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35944 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35948 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36726 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:32852 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45132 - "GET / HTTP/1.0" 200 OK 2026-03-14 10:54:12,159 - lava_callback - INFO - Received callback for node 69b29b434bce73bcf0234dbe INFO: 172.21.0.1:50408 - "POST /node/69b29b434bce73bcf0234dbe HTTP/1.0" 202 Accepted 2026-03-14 10:54:12,164 - lava_callback - INFO - Starting async job submit for node 69b29b434bce73bcf0234dbe 2026-03-14 10:54:12,165 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 10:54:12,183 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b29b434bce73bcf0234dbe HTTP/1.1" 200 None 2026-03-14 10:54:12,184 - lava_callback - DEBUG - Processing node 69b29b434bce73bcf0234dbe: baseline-arm-clabbe 2026-03-14 10:54:12,184 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b29b434bce73bcf0234dbe 2026-03-14 10:54:12,185 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 10:54:12,199 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b29b434bce73bcf0234dbe HTTP/1.1" 200 None 2026-03-14 10:54:12,200 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 10:54:12,214 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b195f7a26b422765ba3705 HTTP/1.1" 200 None 2026-03-14 10:54:12,215 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 10:54:12,236 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b29b434bce73bcf0234dbe HTTP/1.1" 200 None 2026-03-14 10:54:12,246 - lava_callback - ERROR - Error processing callback for node 69b29b434bce73bcf0234dbe: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:50424 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:50426 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40376 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37310 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37318 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37268 - "GET / HTTP/1.0" 200 OK 2026-03-14 10:54:52,104 - lava_callback - INFO - Received callback for node 69b29b674bce73bcf0234dc8 INFO: 172.21.0.1:42808 - "POST /node/69b29b674bce73bcf0234dc8 HTTP/1.0" 202 Accepted 2026-03-14 10:54:52,110 - lava_callback - INFO - Starting async job submit for node 69b29b674bce73bcf0234dc8 2026-03-14 10:54:52,110 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 10:54:52,126 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b29b674bce73bcf0234dc8 HTTP/1.1" 200 None 2026-03-14 10:54:52,127 - lava_callback - DEBUG - Processing node 69b29b674bce73bcf0234dc8: baseline-arm-clabbe 2026-03-14 10:54:52,127 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b29b674bce73bcf0234dc8 2026-03-14 10:54:52,128 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 10:54:52,141 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b29b674bce73bcf0234dc8 HTTP/1.1" 200 None 2026-03-14 10:54:52,142 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 10:54:52,155 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b195f7a26b422765ba3705 HTTP/1.1" 200 None 2026-03-14 10:54:52,157 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 10:54:52,177 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b29b674bce73bcf0234dc8 HTTP/1.1" 200 None 2026-03-14 10:54:52,178 - lava_callback - ERROR - Error processing callback for node 69b29b674bce73bcf0234dc8: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:42824 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52272 - "GET / HTTP/1.0" 200 OK 2026-03-14 10:55:12,079 - lava_callback - INFO - Received callback for node 69b29b8c4bce73bcf0234dd6 INFO: 172.21.0.1:37086 - "POST /node/69b29b8c4bce73bcf0234dd6 HTTP/1.0" 202 Accepted 2026-03-14 10:55:12,085 - lava_callback - INFO - Starting async job submit for node 69b29b8c4bce73bcf0234dd6 2026-03-14 10:55:12,086 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 10:55:12,119 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b29b8c4bce73bcf0234dd6 HTTP/1.1" 200 None 2026-03-14 10:55:12,120 - lava_callback - DEBUG - Processing node 69b29b8c4bce73bcf0234dd6: baseline-arm-clabbe 2026-03-14 10:55:12,120 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b29b8c4bce73bcf0234dd6 2026-03-14 10:55:12,121 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 10:55:12,134 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b29b8c4bce73bcf0234dd6 HTTP/1.1" 200 None 2026-03-14 10:55:12,136 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 10:55:12,157 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b195f7a26b422765ba3705 HTTP/1.1" 200 None 2026-03-14 10:55:12,159 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 10:55:12,179 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b29b8c4bce73bcf0234dd6 HTTP/1.1" 200 None 2026-03-14 10:55:12,185 - lava_callback - ERROR - Error processing callback for node 69b29b8c4bce73bcf0234dd6: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:37096 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:37100 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37140 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44616 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44632 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37660 - "GET / HTTP/1.0" 200 OK 2026-03-14 10:55:52,171 - lava_callback - INFO - Received callback for node 69b29bb14bce73bcf0234dea INFO: 172.21.0.1:40328 - "POST /node/69b29bb14bce73bcf0234dea HTTP/1.0" 202 Accepted 2026-03-14 10:55:52,177 - lava_callback - INFO - Starting async job submit for node 69b29bb14bce73bcf0234dea 2026-03-14 10:55:52,177 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 10:55:52,212 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b29bb14bce73bcf0234dea HTTP/1.1" 200 None 2026-03-14 10:55:52,213 - lava_callback - DEBUG - Processing node 69b29bb14bce73bcf0234dea: baseline-arm-clabbe 2026-03-14 10:55:52,213 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b29bb14bce73bcf0234dea 2026-03-14 10:55:52,214 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 10:55:52,265 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b29bb14bce73bcf0234dea HTTP/1.1" 200 None 2026-03-14 10:55:52,267 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 10:55:52,281 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b195f7a26b422765ba3705 HTTP/1.1" 200 None 2026-03-14 10:55:52,282 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 10:55:52,332 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b29bb14bce73bcf0234dea HTTP/1.1" 200 None 2026-03-14 10:55:52,333 - lava_callback - ERROR - Error processing callback for node 69b29bb14bce73bcf0234dea: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:40342 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44818 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35220 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:35226 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37440 - "GET / HTTP/1.0" 200 OK 2026-03-14 10:56:32,229 - lava_callback - INFO - Received callback for node 69b29bd64bce73bcf0234df4 INFO: 172.21.0.1:56336 - "POST /node/69b29bd64bce73bcf0234df4 HTTP/1.0" 202 Accepted 2026-03-14 10:56:32,235 - lava_callback - INFO - Starting async job submit for node 69b29bd64bce73bcf0234df4 2026-03-14 10:56:32,236 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 10:56:32,250 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b29bd64bce73bcf0234df4 HTTP/1.1" 200 None 2026-03-14 10:56:32,251 - lava_callback - DEBUG - Processing node 69b29bd64bce73bcf0234df4: baseline-arm-clabbe 2026-03-14 10:56:32,251 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b29bd64bce73bcf0234df4 2026-03-14 10:56:32,252 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 10:56:32,266 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b29bd64bce73bcf0234df4 HTTP/1.1" 200 None 2026-03-14 10:56:32,268 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 10:56:32,282 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b195f7a26b422765ba3705 HTTP/1.1" 200 None 2026-03-14 10:56:32,283 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 10:56:32,307 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b29bd64bce73bcf0234df4 HTTP/1.1" 200 None 2026-03-14 10:56:32,312 - lava_callback - ERROR - Error processing callback for node 69b29bd64bce73bcf0234df4: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:56352 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56360 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46250 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55424 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40752 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37924 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:37940 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40646 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39498 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39504 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41770 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39412 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54076 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42232 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:42238 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55900 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37774 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37788 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37736 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47542 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47536 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57026 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:57042 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48670 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56226 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56240 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50074 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41938 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49838 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56866 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:56870 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36390 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33680 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33692 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46736 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42978 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55608 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40902 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:40916 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44854 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52788 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52802 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52538 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53700 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43226 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44448 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:44464 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51806 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60406 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60418 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48906 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40026 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42012 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33576 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:33582 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59012 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58668 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58676 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37140 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53288 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41760 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49522 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:49526 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41326 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60436 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60452 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57732 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56184 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52446 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46516 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:46524 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33074 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36002 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36012 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40810 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39134 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53500 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49592 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:49604 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41614 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58132 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58142 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60422 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54654 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41238 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34418 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:34424 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59134 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52414 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52418 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60930 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42758 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38174 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38008 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:38024 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41428 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57932 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57934 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44302 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44558 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41286 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52826 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:52834 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35886 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42950 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42952 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39506 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58990 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53350 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41904 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:41916 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48128 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35058 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35062 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36282 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59836 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45686 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42802 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:42812 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43906 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48250 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48262 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44630 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58248 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33394 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58312 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:58324 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37504 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37508 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55926 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55938 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43604 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59396 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59412 - "GET /favicon.ico HTTP/1.0" 404 Not Found INFO: 172.21.0.1:57190 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42020 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:42030 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60938 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53404 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53408 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59428 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50340 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55892 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54962 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:54970 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36920 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50122 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50138 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57114 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46946 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50388 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56516 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:56520 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55086 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53676 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53690 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37978 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41288 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54028 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54044 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:54046 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44334 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43336 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43340 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35062 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50324 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35458 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42110 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:42120 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55928 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36638 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36652 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38026 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39578 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44922 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57216 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:57232 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45718 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35868 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35870 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41666 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56682 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37892 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47194 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:47206 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36310 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50540 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50546 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53872 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36372 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46196 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38174 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:38188 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47240 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36730 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36736 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49124 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54240 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55398 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41532 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:41546 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51516 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37452 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37466 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33192 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33012 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41944 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60498 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:60512 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44358 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57158 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57164 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44246 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49944 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47610 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38554 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:38564 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42042 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34320 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34328 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51224 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42590 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53790 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56812 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:56820 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54392 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59336 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59342 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48728 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38694 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59746 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42070 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:42072 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57860 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36016 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36028 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34560 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51874 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33730 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45636 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:45652 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57118 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40366 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40380 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40074 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59886 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60180 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38176 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:38178 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43524 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46416 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46422 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35016 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35456 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38030 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49390 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:49392 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38982 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47736 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47748 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54708 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53278 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50562 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40184 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:40188 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44350 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35940 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35950 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33408 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56736 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39508 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49484 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:49494 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37756 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51650 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51666 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50418 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39300 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35508 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35584 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:35592 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54494 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47810 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47816 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55896 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59650 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34998 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54754 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:54766 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33108 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38914 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38930 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46040 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40070 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58242 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39350 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:39356 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53024 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53442 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53450 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44752 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53110 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44476 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33260 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:33268 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50648 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44806 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44820 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59250 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59760 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45376 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56048 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:56056 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40578 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39132 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39136 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57102 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33678 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42714 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34502 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:34514 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56862 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41534 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41550 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41860 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42952 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34098 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36170 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:36176 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56400 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60142 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60156 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59902 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51060 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49652 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40902 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:40910 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51296 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45934 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45948 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55764 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35942 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40472 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45022 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:45034 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41014 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37678 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37686 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33392 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42486 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51758 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40180 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:40186 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41988 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37780 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37784 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57748 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58752 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51884 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55716 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:55724 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59020 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56306 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56322 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49550 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57000 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41598 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58010 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:58024 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57896 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36882 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36888 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46756 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37662 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43966 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45974 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:45988 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37442 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38410 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38412 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51952 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37598 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47946 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55282 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:55294 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48402 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40696 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40706 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49128 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50240 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33508 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46118 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:46134 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60092 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60934 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60942 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60760 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57122 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41076 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45218 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:45222 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45816 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36174 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36182 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52482 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34604 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53744 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46470 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:46482 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52242 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33254 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33262 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39774 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36658 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56804 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46572 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:46580 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40846 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48974 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48988 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46350 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33616 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46150 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41796 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:41810 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33992 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57512 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57524 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41972 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34856 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51540 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40938 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:40940 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40434 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57696 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57702 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40426 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54216 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53080 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56850 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:56860 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45102 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38972 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38982 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37046 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50678 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56522 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58638 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:58652 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41506 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57934 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57942 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41386 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41334 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60560 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56474 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:56486 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38890 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51804 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51812 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48828 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52564 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52950 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43336 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:43346 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48248 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58828 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58834 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51812 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44086 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57676 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37578 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:37582 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48820 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58892 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58896 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53790 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34606 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36396 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55976 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:55990 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34318 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60624 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60632 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52720 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37144 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50746 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45782 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:45788 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60332 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34926 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34936 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36894 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49856 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54064 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42070 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:42072 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57760 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59702 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59712 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43646 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33066 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49008 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54464 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:54468 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42774 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44994 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45010 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48482 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44770 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43714 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50932 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:50940 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38640 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40724 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40740 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60074 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48032 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45072 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39076 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:39090 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53070 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43020 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43022 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39888 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35264 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42984 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54902 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:54914 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33258 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40868 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40878 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35582 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54678 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34000 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60372 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:60374 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38296 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39592 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39602 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51250 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48178 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55156 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47650 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:47658 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38588 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34142 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34152 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47420 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37388 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53248 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59530 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:59538 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37766 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42274 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42288 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36244 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44706 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36896 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51946 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:51954 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52510 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55750 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55756 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47008 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50732 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38860 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37024 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:37032 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52772 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35102 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35104 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47172 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59310 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34760 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40748 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:40764 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54532 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48472 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48478 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39108 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43308 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52678 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37308 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:37322 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39090 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38104 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38116 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48712 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50532 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48790 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37260 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37272 - "POST / HTTP/1.0" 405 Method Not Allowed INFO: 172.21.0.1:37278 - "POST / HTTP/1.0" 405 Method Not Allowed INFO: 172.21.0.1:37292 - "POST / HTTP/1.0" 405 Method Not Allowed INFO: 172.21.0.1:37302 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:37306 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39486 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40814 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40818 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46896 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53218 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34440 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:32890 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:32902 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59498 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46158 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46160 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46774 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60680 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34990 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34358 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:34360 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56112 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34502 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34510 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55952 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41392 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33740 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45802 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:45804 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60174 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33474 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50178 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50184 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36254 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43538 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46992 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:46998 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55624 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45474 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48344 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48360 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43774 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34938 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34310 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:34322 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52044 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56176 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38440 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38456 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47192 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59958 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51198 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:51210 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41864 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59866 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34804 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34812 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41568 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52076 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44488 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:44490 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49690 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59246 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45682 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45694 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51514 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37270 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33344 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:33354 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56198 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46214 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51718 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51732 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39442 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50016 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52370 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:52384 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54854 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60520 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52306 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52316 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34666 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49678 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41174 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:41186 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49096 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41578 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41656 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41668 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60770 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60232 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41100 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:41114 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48802 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60400 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55244 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55258 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47400 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45074 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35004 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:35018 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39844 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49198 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46058 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46066 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42556 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60804 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34770 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:34778 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53158 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56570 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49348 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49352 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49376 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46848 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49848 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:49852 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51526 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36748 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36246 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36250 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50454 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58934 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50310 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:50324 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42446 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59982 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44382 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44394 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35786 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47596 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60766 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:60780 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56344 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38530 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38124 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38134 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42238 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47564 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56788 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:56794 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55138 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39562 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36948 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36956 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40182 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38018 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36924 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:36926 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51888 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58848 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55044 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55052 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51492 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38236 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34512 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:34518 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37546 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48900 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55788 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55804 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47216 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40352 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43904 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:43908 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54198 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38086 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42332 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42340 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33248 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45130 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33204 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:33214 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60472 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38684 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52396 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52398 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59404 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35688 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33562 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:33574 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37296 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47852 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48108 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48112 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54418 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37212 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33476 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:33484 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55618 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41780 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34622 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34632 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33246 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41402 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58548 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:58556 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53170 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36400 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43638 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43646 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54868 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55132 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56242 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:56246 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48898 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57254 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52744 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52760 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44562 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47040 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43986 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:43996 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37976 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40460 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49328 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49344 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57118 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53936 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48166 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:48174 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58954 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35656 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59400 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59416 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44840 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51684 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46696 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:46698 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60896 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36212 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50216 - "GET / HTTP/1.0" 200 OK 2026-03-14 12:38:44,231 - lava_callback - INFO - Received callback for node 69b2b3c54bce73bcf0234ef9 INFO: 172.21.0.1:50220 - "POST /node/69b2b3c54bce73bcf0234ef9 HTTP/1.0" 202 Accepted 2026-03-14 12:38:44,236 - lava_callback - INFO - Starting async job submit for node 69b2b3c54bce73bcf0234ef9 2026-03-14 12:38:44,237 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 12:38:44,253 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b2b3c54bce73bcf0234ef9 HTTP/1.1" 200 None 2026-03-14 12:38:44,253 - lava_callback - DEBUG - Processing node 69b2b3c54bce73bcf0234ef9: baseline-arm-baylibre 2026-03-14 12:38:44,254 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b2b3c54bce73bcf0234ef9 2026-03-14 12:38:44,254 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 12:38:44,268 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b2b3c54bce73bcf0234ef9 HTTP/1.1" 200 None 2026-03-14 12:38:44,270 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 12:38:44,292 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69af632c275c8d3b79399db4 HTTP/1.1" 200 None 2026-03-14 12:38:44,293 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 12:38:44,332 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b2b3c54bce73bcf0234ef9 HTTP/1.1" 200 None 2026-03-14 12:38:44,342 - lava_callback - ERROR - Error processing callback for node 69b2b3c54bce73bcf0234ef9: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:50224 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44600 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34008 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52322 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:52338 - "GET / HTTP/1.0" 200 OK 2026-03-14 12:39:24,127 - lava_callback - INFO - Received callback for node 69b2b3f54bce73bcf0234f06 INFO: 172.21.0.1:42806 - "POST /node/69b2b3f54bce73bcf0234f06 HTTP/1.0" 202 Accepted 2026-03-14 12:39:24,132 - lava_callback - INFO - Starting async job submit for node 69b2b3f54bce73bcf0234f06 2026-03-14 12:39:24,133 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 12:39:24,152 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b2b3f54bce73bcf0234f06 HTTP/1.1" 200 None 2026-03-14 12:39:24,152 - lava_callback - DEBUG - Processing node 69b2b3f54bce73bcf0234f06: baseline-arm-baylibre 2026-03-14 12:39:24,153 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b2b3f54bce73bcf0234f06 2026-03-14 12:39:24,153 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 12:39:24,167 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b2b3f54bce73bcf0234f06 HTTP/1.1" 200 None 2026-03-14 12:39:24,168 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 12:39:24,181 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69af632c275c8d3b79399db4 HTTP/1.1" 200 None 2026-03-14 12:39:24,183 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 12:39:24,213 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b2b3f54bce73bcf0234f06 HTTP/1.1" 200 None 2026-03-14 12:39:24,221 - lava_callback - ERROR - Error processing callback for node 69b2b3f54bce73bcf0234f06: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:42812 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56950 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46258 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46264 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60512 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60726 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39692 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:39696 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41668 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59922 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56706 - "GET / HTTP/1.0" 200 OK 2026-03-14 12:40:44,261 - lava_callback - INFO - Received callback for node 69b2b4484bce73bcf0234f22 INFO: 172.21.0.1:56720 - "POST /node/69b2b4484bce73bcf0234f22 HTTP/1.0" 202 Accepted 2026-03-14 12:40:44,267 - lava_callback - INFO - Starting async job submit for node 69b2b4484bce73bcf0234f22 2026-03-14 12:40:44,268 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 12:40:44,294 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b2b4484bce73bcf0234f22 HTTP/1.1" 200 None 2026-03-14 12:40:44,294 - lava_callback - DEBUG - Processing node 69b2b4484bce73bcf0234f22: baseline-arm-baylibre 2026-03-14 12:40:44,295 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b2b4484bce73bcf0234f22 2026-03-14 12:40:44,295 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 12:40:44,313 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b2b4484bce73bcf0234f22 HTTP/1.1" 200 None 2026-03-14 12:40:44,314 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 12:40:44,327 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69af632c275c8d3b79399db4 HTTP/1.1" 200 None 2026-03-14 12:40:44,329 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 12:40:44,349 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b2b4484bce73bcf0234f22 HTTP/1.1" 200 None 2026-03-14 12:40:44,356 - lava_callback - ERROR - Error processing callback for node 69b2b4484bce73bcf0234f22: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:56734 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55334 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59686 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37984 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:37990 - "GET / HTTP/1.0" 200 OK 2026-03-14 12:41:24,254 - lava_callback - INFO - Received callback for node 69b2b4714bce73bcf0234f2e INFO: 172.21.0.1:32924 - "POST /node/69b2b4714bce73bcf0234f2e HTTP/1.0" 202 Accepted 2026-03-14 12:41:24,260 - lava_callback - INFO - Starting async job submit for node 69b2b4714bce73bcf0234f2e 2026-03-14 12:41:24,261 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 12:41:24,276 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b2b4714bce73bcf0234f2e HTTP/1.1" 200 None 2026-03-14 12:41:24,277 - lava_callback - DEBUG - Processing node 69b2b4714bce73bcf0234f2e: baseline-arm-baylibre 2026-03-14 12:41:24,277 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b2b4714bce73bcf0234f2e 2026-03-14 12:41:24,278 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 12:41:24,292 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b2b4714bce73bcf0234f2e HTTP/1.1" 200 None 2026-03-14 12:41:24,293 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 12:41:24,307 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69af632c275c8d3b79399db4 HTTP/1.1" 200 None 2026-03-14 12:41:24,308 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 12:41:24,328 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b2b4714bce73bcf0234f2e HTTP/1.1" 200 None 2026-03-14 12:41:24,330 - lava_callback - ERROR - Error processing callback for node 69b2b4714bce73bcf0234f2e: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:32940 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33502 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59426 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59434 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53068 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48928 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40758 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:40770 - "GET / HTTP/1.0" 200 OK 2026-03-14 12:42:24,402 - lava_callback - INFO - Received callback for node 69b2b49b4bce73bcf0234f3d INFO: 172.21.0.1:43800 - "POST /node/69b2b49b4bce73bcf0234f3d HTTP/1.0" 202 Accepted 2026-03-14 12:42:24,407 - lava_callback - INFO - Starting async job submit for node 69b2b49b4bce73bcf0234f3d 2026-03-14 12:42:24,408 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 12:42:24,443 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b2b49b4bce73bcf0234f3d HTTP/1.1" 200 None 2026-03-14 12:42:24,444 - lava_callback - DEBUG - Processing node 69b2b49b4bce73bcf0234f3d: baseline-arm-baylibre 2026-03-14 12:42:24,444 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b2b49b4bce73bcf0234f3d 2026-03-14 12:42:24,445 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 12:42:24,458 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b2b49b4bce73bcf0234f3d HTTP/1.1" 200 None 2026-03-14 12:42:24,459 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 12:42:24,473 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69af632c275c8d3b79399db4 HTTP/1.1" 200 None 2026-03-14 12:42:24,475 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 12:42:24,506 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b2b49b4bce73bcf0234f3d HTTP/1.1" 200 None 2026-03-14 12:42:24,511 - lava_callback - ERROR - Error processing callback for node 69b2b49b4bce73bcf0234f3d: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:43814 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44868 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56312 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56328 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41322 - "GET / HTTP/1.0" 200 OK 2026-03-14 12:43:04,357 - lava_callback - INFO - Received callback for node 69b2b4c84bce73bcf0234f4c INFO: 172.21.0.1:43436 - "POST /node/69b2b4c84bce73bcf0234f4c HTTP/1.0" 202 Accepted 2026-03-14 12:43:04,362 - lava_callback - INFO - Starting async job submit for node 69b2b4c84bce73bcf0234f4c 2026-03-14 12:43:04,363 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 12:43:04,377 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b2b4c84bce73bcf0234f4c HTTP/1.1" 200 None 2026-03-14 12:43:04,378 - lava_callback - DEBUG - Processing node 69b2b4c84bce73bcf0234f4c: baseline-arm-baylibre 2026-03-14 12:43:04,378 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b2b4c84bce73bcf0234f4c 2026-03-14 12:43:04,379 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 12:43:04,413 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b2b4c84bce73bcf0234f4c HTTP/1.1" 200 None 2026-03-14 12:43:04,415 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 12:43:04,428 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69af632c275c8d3b79399db4 HTTP/1.1" 200 None 2026-03-14 12:43:04,430 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 12:43:04,450 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b2b4c84bce73bcf0234f4c HTTP/1.1" 200 None 2026-03-14 12:43:04,455 - lava_callback - ERROR - Error processing callback for node 69b2b4c84bce73bcf0234f4c: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:43438 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44230 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:44238 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44536 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34288 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51544 - "GET / HTTP/1.0" 200 OK 2026-03-14 12:43:44,561 - lava_callback - INFO - Received callback for node 69b2b4f14bce73bcf0234f56 INFO: 172.21.0.1:51554 - "POST /node/69b2b4f14bce73bcf0234f56 HTTP/1.0" 202 Accepted 2026-03-14 12:43:44,566 - lava_callback - INFO - Starting async job submit for node 69b2b4f14bce73bcf0234f56 2026-03-14 12:43:44,568 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 12:43:44,582 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b2b4f14bce73bcf0234f56 HTTP/1.1" 200 None 2026-03-14 12:43:44,582 - lava_callback - DEBUG - Processing node 69b2b4f14bce73bcf0234f56: baseline-arm-baylibre 2026-03-14 12:43:44,583 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b2b4f14bce73bcf0234f56 2026-03-14 12:43:44,583 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 12:43:44,596 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b2b4f14bce73bcf0234f56 HTTP/1.1" 200 None 2026-03-14 12:43:44,597 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 12:43:44,632 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69af632c275c8d3b79399db4 HTTP/1.1" 200 None 2026-03-14 12:43:44,634 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 12:43:44,654 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b2b4f14bce73bcf0234f56 HTTP/1.1" 200 None 2026-03-14 12:43:44,661 - lava_callback - ERROR - Error processing callback for node 69b2b4f14bce73bcf0234f56: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:51568 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44478 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35030 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45192 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:45200 - "GET / HTTP/1.0" 200 OK 2026-03-14 12:44:24,501 - lava_callback - INFO - Received callback for node 69b2b51b4bce73bcf0234f63 INFO: 172.21.0.1:37496 - "POST /node/69b2b51b4bce73bcf0234f63 HTTP/1.0" 202 Accepted 2026-03-14 12:44:24,506 - lava_callback - INFO - Starting async job submit for node 69b2b51b4bce73bcf0234f63 2026-03-14 12:44:24,508 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 12:44:24,523 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b2b51b4bce73bcf0234f63 HTTP/1.1" 200 None 2026-03-14 12:44:24,524 - lava_callback - DEBUG - Processing node 69b2b51b4bce73bcf0234f63: baseline-arm-baylibre 2026-03-14 12:44:24,524 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b2b51b4bce73bcf0234f63 2026-03-14 12:44:24,525 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 12:44:24,539 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b2b51b4bce73bcf0234f63 HTTP/1.1" 200 None 2026-03-14 12:44:24,540 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 12:44:24,554 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69af632c275c8d3b79399db4 HTTP/1.1" 200 None 2026-03-14 12:44:24,556 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 12:44:24,577 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b2b51b4bce73bcf0234f63 HTTP/1.1" 200 None 2026-03-14 12:44:24,578 - lava_callback - ERROR - Error processing callback for node 69b2b51b4bce73bcf0234f63: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:37506 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45478 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37284 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37288 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42840 - "GET / HTTP/1.0" 200 OK 2026-03-14 12:45:04,500 - lava_callback - INFO - Received callback for node 69b2b5454bce73bcf0234f72 INFO: 172.21.0.1:55072 - "POST /node/69b2b5454bce73bcf0234f72 HTTP/1.0" 202 Accepted 2026-03-14 12:45:04,505 - lava_callback - INFO - Starting async job submit for node 69b2b5454bce73bcf0234f72 2026-03-14 12:45:04,506 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 12:45:04,520 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b2b5454bce73bcf0234f72 HTTP/1.1" 200 None 2026-03-14 12:45:04,521 - lava_callback - DEBUG - Processing node 69b2b5454bce73bcf0234f72: baseline-arm-baylibre 2026-03-14 12:45:04,521 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b2b5454bce73bcf0234f72 2026-03-14 12:45:04,522 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 12:45:04,540 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b2b5454bce73bcf0234f72 HTTP/1.1" 200 None 2026-03-14 12:45:04,542 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 12:45:04,555 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69af632c275c8d3b79399db4 HTTP/1.1" 200 None 2026-03-14 12:45:04,557 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 12:45:04,579 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b2b5454bce73bcf0234f72 HTTP/1.1" 200 None 2026-03-14 12:45:04,589 - lava_callback - ERROR - Error processing callback for node 69b2b5454bce73bcf0234f72: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:55080 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57612 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:57626 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47510 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57146 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39500 - "GET / HTTP/1.0" 200 OK 2026-03-14 12:45:44,528 - lava_callback - INFO - Received callback for node 69b2b56e4bce73bcf0234f7e INFO: 172.21.0.1:39512 - "POST /node/69b2b56e4bce73bcf0234f7e HTTP/1.0" 202 Accepted 2026-03-14 12:45:44,534 - lava_callback - INFO - Starting async job submit for node 69b2b56e4bce73bcf0234f7e 2026-03-14 12:45:44,534 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 12:45:44,574 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b2b56e4bce73bcf0234f7e HTTP/1.1" 200 None 2026-03-14 12:45:44,575 - lava_callback - DEBUG - Processing node 69b2b56e4bce73bcf0234f7e: baseline-arm-baylibre 2026-03-14 12:45:44,575 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b2b56e4bce73bcf0234f7e 2026-03-14 12:45:44,576 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 12:45:44,611 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b2b56e4bce73bcf0234f7e HTTP/1.1" 200 None 2026-03-14 12:45:44,613 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 12:45:44,627 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69af632c275c8d3b79399db4 HTTP/1.1" 200 None 2026-03-14 12:45:44,629 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 12:45:44,667 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b2b56e4bce73bcf0234f7e HTTP/1.1" 200 None 2026-03-14 12:45:44,668 - lava_callback - ERROR - Error processing callback for node 69b2b56e4bce73bcf0234f7e: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:39528 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40238 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40584 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41012 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:41028 - "GET / HTTP/1.0" 200 OK 2026-03-14 12:46:24,572 - lava_callback - INFO - Received callback for node 69b2b5954bce73bcf0234f8c INFO: 172.21.0.1:37032 - "POST /node/69b2b5954bce73bcf0234f8c HTTP/1.0" 202 Accepted 2026-03-14 12:46:24,577 - lava_callback - INFO - Starting async job submit for node 69b2b5954bce73bcf0234f8c 2026-03-14 12:46:24,578 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 12:46:24,592 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b2b5954bce73bcf0234f8c HTTP/1.1" 200 None 2026-03-14 12:46:24,593 - lava_callback - DEBUG - Processing node 69b2b5954bce73bcf0234f8c: baseline-arm-baylibre 2026-03-14 12:46:24,593 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b2b5954bce73bcf0234f8c 2026-03-14 12:46:24,594 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 12:46:24,607 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b2b5954bce73bcf0234f8c HTTP/1.1" 200 None 2026-03-14 12:46:24,608 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 12:46:24,644 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69af632c275c8d3b79399db4 HTTP/1.1" 200 None 2026-03-14 12:46:24,646 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 12:46:24,718 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b2b5954bce73bcf0234f8c HTTP/1.1" 200 None 2026-03-14 12:46:24,720 - lava_callback - ERROR - Error processing callback for node 69b2b5954bce73bcf0234f8c: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:37044 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50764 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38916 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38928 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34622 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43788 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40126 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:40128 - "GET / HTTP/1.0" 200 OK 2026-03-14 12:47:17,210 - lava_callback - INFO - Received callback for node 69b2b5c04bce73bcf0234f9c INFO: 172.21.0.1:40144 - "POST /node/69b2b5c04bce73bcf0234f9c HTTP/1.0" 202 Accepted 2026-03-14 12:47:17,216 - lava_callback - INFO - Starting async job submit for node 69b2b5c04bce73bcf0234f9c 2026-03-14 12:47:17,217 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 12:47:17,231 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b2b5c04bce73bcf0234f9c HTTP/1.1" 200 None 2026-03-14 12:47:17,232 - lava_callback - DEBUG - Processing node 69b2b5c04bce73bcf0234f9c: baseline-arm-clabbe 2026-03-14 12:47:17,232 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b2b5c04bce73bcf0234f9c 2026-03-14 12:47:17,233 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 12:47:17,249 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b2b5c04bce73bcf0234f9c HTTP/1.1" 200 None 2026-03-14 12:47:17,251 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 12:47:17,268 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69af632c275c8d3b79399db4 HTTP/1.1" 200 None 2026-03-14 12:47:17,270 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 12:47:17,294 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b2b5c04bce73bcf0234f9c HTTP/1.1" 200 None 2026-03-14 12:47:17,296 - lava_callback - ERROR - Error processing callback for node 69b2b5c04bce73bcf0234f9c: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:58854 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50246 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39466 - "GET / HTTP/1.0" 200 OK 2026-03-14 12:47:44,680 - lava_callback - INFO - Received callback for node 69b2b5e74bce73bcf0234fac INFO: 172.21.0.1:39476 - "POST /node/69b2b5e74bce73bcf0234fac HTTP/1.0" 202 Accepted 2026-03-14 12:47:44,685 - lava_callback - INFO - Starting async job submit for node 69b2b5e74bce73bcf0234fac 2026-03-14 12:47:44,686 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 12:47:44,706 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b2b5e74bce73bcf0234fac HTTP/1.1" 200 None 2026-03-14 12:47:44,707 - lava_callback - DEBUG - Processing node 69b2b5e74bce73bcf0234fac: baseline-arm-baylibre 2026-03-14 12:47:44,708 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b2b5e74bce73bcf0234fac 2026-03-14 12:47:44,708 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 12:47:44,750 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b2b5e74bce73bcf0234fac HTTP/1.1" 200 None 2026-03-14 12:47:44,751 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 12:47:44,765 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69af632c275c8d3b79399db4 HTTP/1.1" 200 None 2026-03-14 12:47:44,766 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 12:47:44,798 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b2b5e74bce73bcf0234fac HTTP/1.1" 200 None 2026-03-14 12:47:44,807 - lava_callback - ERROR - Error processing callback for node 69b2b5e74bce73bcf0234fac: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:39484 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51812 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52880 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44394 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:44408 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53592 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34282 - "GET / HTTP/1.0" 200 OK 2026-03-14 12:48:37,177 - lava_callback - INFO - Received callback for node 69b2b6114bce73bcf0234fba INFO: 172.21.0.1:34292 - "POST /node/69b2b6114bce73bcf0234fba HTTP/1.0" 202 Accepted 2026-03-14 12:48:37,182 - lava_callback - INFO - Starting async job submit for node 69b2b6114bce73bcf0234fba 2026-03-14 12:48:37,183 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 12:48:37,215 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b2b6114bce73bcf0234fba HTTP/1.1" 200 None 2026-03-14 12:48:37,216 - lava_callback - DEBUG - Processing node 69b2b6114bce73bcf0234fba: baseline-arm-clabbe 2026-03-14 12:48:37,217 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b2b6114bce73bcf0234fba 2026-03-14 12:48:37,217 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 12:48:37,235 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b2b6114bce73bcf0234fba HTTP/1.1" 200 None 2026-03-14 12:48:37,237 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 12:48:37,249 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69af632c275c8d3b79399db4 HTTP/1.1" 200 None 2026-03-14 12:48:37,251 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 12:48:37,286 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b2b6114bce73bcf0234fba HTTP/1.1" 200 None 2026-03-14 12:48:37,292 - lava_callback - ERROR - Error processing callback for node 69b2b6114bce73bcf0234fba: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:39828 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39842 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48344 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39510 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57792 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:57808 - "GET / HTTP/1.0" 200 OK 2026-03-14 12:49:17,204 - lava_callback - INFO - Received callback for node 69b2b63a4bce73bcf0234fc5 INFO: 172.21.0.1:57814 - "POST /node/69b2b63a4bce73bcf0234fc5 HTTP/1.0" 202 Accepted 2026-03-14 12:49:17,209 - lava_callback - INFO - Starting async job submit for node 69b2b63a4bce73bcf0234fc5 2026-03-14 12:49:17,210 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 12:49:17,266 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b2b63a4bce73bcf0234fc5 HTTP/1.1" 200 None 2026-03-14 12:49:17,267 - lava_callback - DEBUG - Processing node 69b2b63a4bce73bcf0234fc5: baseline-arm-clabbe 2026-03-14 12:49:17,267 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b2b63a4bce73bcf0234fc5 2026-03-14 12:49:17,268 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 12:49:17,281 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b2b63a4bce73bcf0234fc5 HTTP/1.1" 200 None 2026-03-14 12:49:17,282 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 12:49:17,305 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69af632c275c8d3b79399db4 HTTP/1.1" 200 None 2026-03-14 12:49:17,306 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 12:49:17,329 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b2b63a4bce73bcf0234fc5 HTTP/1.1" 200 None 2026-03-14 12:49:17,334 - lava_callback - ERROR - Error processing callback for node 69b2b63a4bce73bcf0234fc5: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:48260 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54690 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45412 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45416 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45056 - "GET / HTTP/1.0" 200 OK 2026-03-14 12:49:57,206 - lava_callback - INFO - Received callback for node 69b2b6654bce73bcf0234fd8 INFO: 172.21.0.1:45070 - "POST /node/69b2b6654bce73bcf0234fd8 HTTP/1.0" 202 Accepted 2026-03-14 12:49:57,212 - lava_callback - INFO - Starting async job submit for node 69b2b6654bce73bcf0234fd8 2026-03-14 12:49:57,213 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 12:49:57,231 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b2b6654bce73bcf0234fd8 HTTP/1.1" 200 None 2026-03-14 12:49:57,232 - lava_callback - DEBUG - Processing node 69b2b6654bce73bcf0234fd8: baseline-arm-clabbe 2026-03-14 12:49:57,233 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b2b6654bce73bcf0234fd8 2026-03-14 12:49:57,233 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 12:49:57,246 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b2b6654bce73bcf0234fd8 HTTP/1.1" 200 None 2026-03-14 12:49:57,247 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 12:49:57,270 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69af632c275c8d3b79399db4 HTTP/1.1" 200 None 2026-03-14 12:49:57,272 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 12:49:57,292 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b2b6654bce73bcf0234fd8 HTTP/1.1" 200 None 2026-03-14 12:49:57,297 - lava_callback - ERROR - Error processing callback for node 69b2b6654bce73bcf0234fd8: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:47142 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58106 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:58122 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58328 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49512 - "GET / HTTP/1.0" 200 OK 2026-03-14 12:50:37,599 - lava_callback - INFO - Received callback for node 69b2b68d4bce73bcf0234fdf INFO: 172.21.0.1:49528 - "POST /node/69b2b68d4bce73bcf0234fdf HTTP/1.0" 202 Accepted 2026-03-14 12:50:37,604 - lava_callback - INFO - Starting async job submit for node 69b2b68d4bce73bcf0234fdf 2026-03-14 12:50:37,605 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 12:50:37,633 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b2b68d4bce73bcf0234fdf HTTP/1.1" 200 None 2026-03-14 12:50:37,634 - lava_callback - DEBUG - Processing node 69b2b68d4bce73bcf0234fdf: baseline-arm-clabbe 2026-03-14 12:50:37,634 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b2b68d4bce73bcf0234fdf 2026-03-14 12:50:37,635 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 12:50:37,648 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b2b68d4bce73bcf0234fdf HTTP/1.1" 200 None 2026-03-14 12:50:37,650 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 12:50:37,664 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69af632c275c8d3b79399db4 HTTP/1.1" 200 None 2026-03-14 12:50:37,666 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 12:50:37,690 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b2b68d4bce73bcf0234fdf HTTP/1.1" 200 None 2026-03-14 12:50:37,691 - lava_callback - ERROR - Error processing callback for node 69b2b68d4bce73bcf0234fdf: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:43316 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43322 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50294 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41286 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36142 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:36148 - "GET / HTTP/1.0" 200 OK 2026-03-14 12:51:17,296 - lava_callback - INFO - Received callback for node 69b2b6b54bce73bcf0234fef INFO: 172.21.0.1:36152 - "POST /node/69b2b6b54bce73bcf0234fef HTTP/1.0" 202 Accepted 2026-03-14 12:51:17,302 - lava_callback - INFO - Starting async job submit for node 69b2b6b54bce73bcf0234fef 2026-03-14 12:51:17,303 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 12:51:17,317 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b2b6b54bce73bcf0234fef HTTP/1.1" 200 None 2026-03-14 12:51:17,318 - lava_callback - DEBUG - Processing node 69b2b6b54bce73bcf0234fef: baseline-arm-clabbe 2026-03-14 12:51:17,318 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b2b6b54bce73bcf0234fef 2026-03-14 12:51:17,318 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 12:51:17,341 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b2b6b54bce73bcf0234fef HTTP/1.1" 200 None 2026-03-14 12:51:17,342 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 12:51:17,355 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69af632c275c8d3b79399db4 HTTP/1.1" 200 None 2026-03-14 12:51:17,357 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 12:51:17,378 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b2b6b54bce73bcf0234fef HTTP/1.1" 200 None 2026-03-14 12:51:17,379 - lava_callback - ERROR - Error processing callback for node 69b2b6b54bce73bcf0234fef: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:59192 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57134 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36740 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36748 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47900 - "GET / HTTP/1.0" 200 OK 2026-03-14 12:51:57,267 - lava_callback - INFO - Received callback for node 69b2b6df4bce73bcf0235002 INFO: 172.21.0.1:47914 - "POST /node/69b2b6df4bce73bcf0235002 HTTP/1.0" 202 Accepted 2026-03-14 12:51:57,273 - lava_callback - INFO - Starting async job submit for node 69b2b6df4bce73bcf0235002 2026-03-14 12:51:57,273 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 12:51:57,288 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b2b6df4bce73bcf0235002 HTTP/1.1" 200 None 2026-03-14 12:51:57,288 - lava_callback - DEBUG - Processing node 69b2b6df4bce73bcf0235002: baseline-arm-clabbe 2026-03-14 12:51:57,289 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b2b6df4bce73bcf0235002 2026-03-14 12:51:57,289 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 12:51:57,303 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b2b6df4bce73bcf0235002 HTTP/1.1" 200 None 2026-03-14 12:51:57,305 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 12:51:57,317 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69af632c275c8d3b79399db4 HTTP/1.1" 200 None 2026-03-14 12:51:57,319 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 12:51:57,345 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b2b6df4bce73bcf0235002 HTTP/1.1" 200 None 2026-03-14 12:51:57,346 - lava_callback - ERROR - Error processing callback for node 69b2b6df4bce73bcf0235002: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:58760 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40790 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:40806 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37622 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36424 - "GET / HTTP/1.0" 200 OK 2026-03-14 12:52:37,360 - lava_callback - INFO - Received callback for node 69b2b7074bce73bcf0235009 INFO: 172.21.0.1:36438 - "POST /node/69b2b7074bce73bcf0235009 HTTP/1.0" 202 Accepted 2026-03-14 12:52:37,365 - lava_callback - INFO - Starting async job submit for node 69b2b7074bce73bcf0235009 2026-03-14 12:52:37,366 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 12:52:37,381 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b2b7074bce73bcf0235009 HTTP/1.1" 200 None 2026-03-14 12:52:37,381 - lava_callback - DEBUG - Processing node 69b2b7074bce73bcf0235009: baseline-arm-clabbe 2026-03-14 12:52:37,382 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b2b7074bce73bcf0235009 2026-03-14 12:52:37,382 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 12:52:37,421 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b2b7074bce73bcf0235009 HTTP/1.1" 200 None 2026-03-14 12:52:37,423 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 12:52:37,436 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69af632c275c8d3b79399db4 HTTP/1.1" 200 None 2026-03-14 12:52:37,438 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 12:52:37,471 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b2b7074bce73bcf0235009 HTTP/1.1" 200 None 2026-03-14 12:52:37,472 - lava_callback - ERROR - Error processing callback for node 69b2b7074bce73bcf0235009: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:35950 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35954 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37152 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44544 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49348 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:49350 - "GET / HTTP/1.0" 200 OK 2026-03-14 12:53:17,424 - lava_callback - INFO - Received callback for node 69b2b7304bce73bcf0235013 INFO: 172.21.0.1:49352 - "POST /node/69b2b7304bce73bcf0235013 HTTP/1.0" 202 Accepted 2026-03-14 12:53:17,429 - lava_callback - INFO - Starting async job submit for node 69b2b7304bce73bcf0235013 2026-03-14 12:53:17,430 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 12:53:17,448 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b2b7304bce73bcf0235013 HTTP/1.1" 200 None 2026-03-14 12:53:17,449 - lava_callback - DEBUG - Processing node 69b2b7304bce73bcf0235013: baseline-arm-clabbe 2026-03-14 12:53:17,449 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b2b7304bce73bcf0235013 2026-03-14 12:53:17,450 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 12:53:17,463 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b2b7304bce73bcf0235013 HTTP/1.1" 200 None 2026-03-14 12:53:17,465 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 12:53:17,490 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69af632c275c8d3b79399db4 HTTP/1.1" 200 None 2026-03-14 12:53:17,492 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 12:53:17,512 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b2b7304bce73bcf0235013 HTTP/1.1" 200 None 2026-03-14 12:53:17,518 - lava_callback - ERROR - Error processing callback for node 69b2b7304bce73bcf0235013: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:45272 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52016 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40172 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40188 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60684 - "GET / HTTP/1.0" 200 OK 2026-03-14 12:53:57,426 - lava_callback - INFO - Received callback for node 69b2b7584bce73bcf0235020 INFO: 172.21.0.1:60696 - "POST /node/69b2b7584bce73bcf0235020 HTTP/1.0" 202 Accepted 2026-03-14 12:53:57,431 - lava_callback - INFO - Starting async job submit for node 69b2b7584bce73bcf0235020 2026-03-14 12:53:57,432 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 12:53:57,455 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b2b7584bce73bcf0235020 HTTP/1.1" 200 None 2026-03-14 12:53:57,456 - lava_callback - DEBUG - Processing node 69b2b7584bce73bcf0235020: baseline-arm-clabbe 2026-03-14 12:53:57,456 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b2b7584bce73bcf0235020 2026-03-14 12:53:57,457 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 12:53:57,470 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b2b7584bce73bcf0235020 HTTP/1.1" 200 None 2026-03-14 12:53:57,471 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 12:53:57,494 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69af632c275c8d3b79399db4 HTTP/1.1" 200 None 2026-03-14 12:53:57,496 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 12:53:57,520 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b2b7584bce73bcf0235020 HTTP/1.1" 200 None 2026-03-14 12:53:57,525 - lava_callback - ERROR - Error processing callback for node 69b2b7584bce73bcf0235020: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:39992 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41236 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:41244 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41868 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58154 - "GET / HTTP/1.0" 200 OK 2026-03-14 12:54:37,414 - lava_callback - INFO - Received callback for node 69b2b7814bce73bcf0235027 INFO: 172.21.0.1:58168 - "POST /node/69b2b7814bce73bcf0235027 HTTP/1.0" 202 Accepted 2026-03-14 12:54:37,419 - lava_callback - INFO - Starting async job submit for node 69b2b7814bce73bcf0235027 2026-03-14 12:54:37,420 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 12:54:37,435 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b2b7814bce73bcf0235027 HTTP/1.1" 200 None 2026-03-14 12:54:37,436 - lava_callback - DEBUG - Processing node 69b2b7814bce73bcf0235027: baseline-arm-clabbe 2026-03-14 12:54:37,436 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b2b7814bce73bcf0235027 2026-03-14 12:54:37,437 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 12:54:37,449 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b2b7814bce73bcf0235027 HTTP/1.1" 200 None 2026-03-14 12:54:37,451 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 12:54:37,464 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69af632c275c8d3b79399db4 HTTP/1.1" 200 None 2026-03-14 12:54:37,466 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 12:54:37,486 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b2b7814bce73bcf0235027 HTTP/1.1" 200 None 2026-03-14 12:54:37,488 - lava_callback - ERROR - Error processing callback for node 69b2b7814bce73bcf0235027: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:46444 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46456 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50096 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36282 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60158 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:60166 - "GET / HTTP/1.0" 200 OK 2026-03-14 12:55:17,502 - lava_callback - INFO - Received callback for node 69b2b7a94bce73bcf0235031 INFO: 172.21.0.1:60170 - "POST /node/69b2b7a94bce73bcf0235031 HTTP/1.0" 202 Accepted 2026-03-14 12:55:17,508 - lava_callback - INFO - Starting async job submit for node 69b2b7a94bce73bcf0235031 2026-03-14 12:55:17,509 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 12:55:17,523 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b2b7a94bce73bcf0235031 HTTP/1.1" 200 None 2026-03-14 12:55:17,524 - lava_callback - DEBUG - Processing node 69b2b7a94bce73bcf0235031: baseline-arm-clabbe 2026-03-14 12:55:17,524 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b2b7a94bce73bcf0235031 2026-03-14 12:55:17,525 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 12:55:17,552 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b2b7a94bce73bcf0235031 HTTP/1.1" 200 None 2026-03-14 12:55:17,554 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 12:55:17,567 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69af632c275c8d3b79399db4 HTTP/1.1" 200 None 2026-03-14 12:55:17,569 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 12:55:17,589 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b2b7a94bce73bcf0235031 HTTP/1.1" 200 None 2026-03-14 12:55:17,590 - lava_callback - ERROR - Error processing callback for node 69b2b7a94bce73bcf0235031: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:53946 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45170 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34100 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34110 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51490 - "GET / HTTP/1.0" 200 OK 2026-03-14 12:55:57,590 - lava_callback - INFO - Received callback for node 69b2b7d24bce73bcf023503e INFO: 172.21.0.1:51498 - "POST /node/69b2b7d24bce73bcf023503e HTTP/1.0" 202 Accepted 2026-03-14 12:55:57,596 - lava_callback - INFO - Starting async job submit for node 69b2b7d24bce73bcf023503e 2026-03-14 12:55:57,596 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 12:55:57,611 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b2b7d24bce73bcf023503e HTTP/1.1" 200 None 2026-03-14 12:55:57,612 - lava_callback - DEBUG - Processing node 69b2b7d24bce73bcf023503e: baseline-arm-clabbe 2026-03-14 12:55:57,612 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b2b7d24bce73bcf023503e 2026-03-14 12:55:57,613 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 12:55:57,633 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b2b7d24bce73bcf023503e HTTP/1.1" 200 None 2026-03-14 12:55:57,635 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 12:55:57,648 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69af632c275c8d3b79399db4 HTTP/1.1" 200 None 2026-03-14 12:55:57,650 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 12:55:57,670 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b2b7d24bce73bcf023503e HTTP/1.1" 200 None 2026-03-14 12:55:57,671 - lava_callback - ERROR - Error processing callback for node 69b2b7d24bce73bcf023503e: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:44732 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35654 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:35656 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46746 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59450 - "GET / HTTP/1.0" 200 OK 2026-03-14 12:56:37,524 - lava_callback - INFO - Received callback for node 69b2b7fb4bce73bcf0235045 INFO: 172.21.0.1:59460 - "POST /node/69b2b7fb4bce73bcf0235045 HTTP/1.0" 202 Accepted 2026-03-14 12:56:37,529 - lava_callback - INFO - Starting async job submit for node 69b2b7fb4bce73bcf0235045 2026-03-14 12:56:37,530 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 12:56:37,545 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b2b7fb4bce73bcf0235045 HTTP/1.1" 200 None 2026-03-14 12:56:37,546 - lava_callback - DEBUG - Processing node 69b2b7fb4bce73bcf0235045: baseline-arm-clabbe 2026-03-14 12:56:37,546 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b2b7fb4bce73bcf0235045 2026-03-14 12:56:37,547 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 12:56:37,560 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b2b7fb4bce73bcf0235045 HTTP/1.1" 200 None 2026-03-14 12:56:37,561 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 12:56:37,580 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69af632c275c8d3b79399db4 HTTP/1.1" 200 None 2026-03-14 12:56:37,581 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 12:56:37,606 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b2b7fb4bce73bcf0235045 HTTP/1.1" 200 None 2026-03-14 12:56:37,608 - lava_callback - ERROR - Error processing callback for node 69b2b7fb4bce73bcf0235045: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:58936 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58952 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52996 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40344 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38206 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:38216 - "GET / HTTP/1.0" 200 OK 2026-03-14 12:57:17,568 - lava_callback - INFO - Received callback for node 69b2b8244bce73bcf0235055 INFO: 172.21.0.1:38226 - "POST /node/69b2b8244bce73bcf0235055 HTTP/1.0" 202 Accepted 2026-03-14 12:57:17,575 - lava_callback - INFO - Starting async job submit for node 69b2b8244bce73bcf0235055 2026-03-14 12:57:17,576 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 12:57:17,590 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b2b8244bce73bcf0235055 HTTP/1.1" 200 None 2026-03-14 12:57:17,591 - lava_callback - DEBUG - Processing node 69b2b8244bce73bcf0235055: baseline-arm-clabbe 2026-03-14 12:57:17,592 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b2b8244bce73bcf0235055 2026-03-14 12:57:17,592 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 12:57:17,616 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b2b8244bce73bcf0235055 HTTP/1.1" 200 None 2026-03-14 12:57:17,618 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 12:57:17,631 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69af632c275c8d3b79399db4 HTTP/1.1" 200 None 2026-03-14 12:57:17,633 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 12:57:17,653 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b2b8244bce73bcf0235055 HTTP/1.1" 200 None 2026-03-14 12:57:17,654 - lava_callback - ERROR - Error processing callback for node 69b2b8244bce73bcf0235055: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:43926 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33932 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43228 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43234 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33160 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39184 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49744 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:49760 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47916 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60044 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37452 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37462 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45736 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50856 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50032 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:50038 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59722 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48640 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34644 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34652 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56012 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34564 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56652 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:56660 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59746 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37964 - "GET / HTTP/1.0" 200 OK 2026-03-14 13:00:37,750 - lava_callback - INFO - Received callback for node 69b2b8ed4bce73bcf023509c INFO: 172.21.0.1:37968 - "POST /node/69b2b8ed4bce73bcf023509c HTTP/1.0" 202 Accepted 2026-03-14 13:00:37,756 - lava_callback - INFO - Starting async job submit for node 69b2b8ed4bce73bcf023509c 2026-03-14 13:00:37,757 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 13:00:37,776 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b2b8ed4bce73bcf023509c HTTP/1.1" 200 None 2026-03-14 13:00:37,777 - lava_callback - DEBUG - Processing node 69b2b8ed4bce73bcf023509c: baseline-arm-clabbe 2026-03-14 13:00:37,777 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b2b8ed4bce73bcf023509c 2026-03-14 13:00:37,778 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 13:00:37,799 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b2b8ed4bce73bcf023509c HTTP/1.1" 200 None 2026-03-14 13:00:37,800 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 13:00:37,813 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b2060ab0f5558b5d7cc5e3 HTTP/1.1" 200 None 2026-03-14 13:00:37,814 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 13:00:37,835 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b2b8ed4bce73bcf023509c HTTP/1.1" 200 None 2026-03-14 13:00:37,839 - lava_callback - ERROR - Error processing callback for node 69b2b8ed4bce73bcf023509c: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:50342 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50346 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55830 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53966 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35066 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:35080 - "GET / HTTP/1.0" 200 OK 2026-03-14 13:01:17,782 - lava_callback - INFO - Received callback for node 69b2b9164bce73bcf02350a8 INFO: 172.21.0.1:35094 - "POST /node/69b2b9164bce73bcf02350a8 HTTP/1.0" 202 Accepted 2026-03-14 13:01:17,788 - lava_callback - INFO - Starting async job submit for node 69b2b9164bce73bcf02350a8 2026-03-14 13:01:17,789 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 13:01:17,825 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b2b9164bce73bcf02350a8 HTTP/1.1" 200 None 2026-03-14 13:01:17,826 - lava_callback - DEBUG - Processing node 69b2b9164bce73bcf02350a8: baseline-arm-clabbe 2026-03-14 13:01:17,826 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b2b9164bce73bcf02350a8 2026-03-14 13:01:17,827 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 13:01:17,843 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b2b9164bce73bcf02350a8 HTTP/1.1" 200 None 2026-03-14 13:01:17,845 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 13:01:17,858 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b2060ab0f5558b5d7cc5e3 HTTP/1.1" 200 None 2026-03-14 13:01:17,859 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 13:01:17,879 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b2b9164bce73bcf02350a8 HTTP/1.1" 200 None 2026-03-14 13:01:17,889 - lava_callback - ERROR - Error processing callback for node 69b2b9164bce73bcf02350a8: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:58418 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37186 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51052 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51060 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53256 - "GET / HTTP/1.0" 200 OK 2026-03-14 13:01:57,809 - lava_callback - INFO - Received callback for node 69b2b9404bce73bcf02350b5 INFO: 172.21.0.1:53270 - "POST /node/69b2b9404bce73bcf02350b5 HTTP/1.0" 202 Accepted 2026-03-14 13:01:57,814 - lava_callback - INFO - Starting async job submit for node 69b2b9404bce73bcf02350b5 2026-03-14 13:01:57,815 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 13:01:57,829 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b2b9404bce73bcf02350b5 HTTP/1.1" 200 None 2026-03-14 13:01:57,830 - lava_callback - DEBUG - Processing node 69b2b9404bce73bcf02350b5: baseline-arm-clabbe 2026-03-14 13:01:57,830 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b2b9404bce73bcf02350b5 2026-03-14 13:01:57,831 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 13:01:57,845 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b2b9404bce73bcf02350b5 HTTP/1.1" 200 None 2026-03-14 13:01:57,846 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 13:01:57,859 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b2060ab0f5558b5d7cc5e3 HTTP/1.1" 200 None 2026-03-14 13:01:57,861 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 13:01:57,882 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b2b9404bce73bcf02350b5 HTTP/1.1" 200 None 2026-03-14 13:01:57,883 - lava_callback - ERROR - Error processing callback for node 69b2b9404bce73bcf02350b5: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:55754 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41964 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:41970 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42844 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35508 - "GET / HTTP/1.0" 200 OK 2026-03-14 13:02:37,781 - lava_callback - INFO - Received callback for node 69b2b96a4bce73bcf02350c1 INFO: 172.21.0.1:35524 - "POST /node/69b2b96a4bce73bcf02350c1 HTTP/1.0" 202 Accepted 2026-03-14 13:02:37,787 - lava_callback - INFO - Starting async job submit for node 69b2b96a4bce73bcf02350c1 2026-03-14 13:02:37,788 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 13:02:37,805 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b2b96a4bce73bcf02350c1 HTTP/1.1" 200 None 2026-03-14 13:02:37,805 - lava_callback - DEBUG - Processing node 69b2b96a4bce73bcf02350c1: baseline-arm-clabbe 2026-03-14 13:02:37,806 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b2b96a4bce73bcf02350c1 2026-03-14 13:02:37,806 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 13:02:37,819 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b2b96a4bce73bcf02350c1 HTTP/1.1" 200 None 2026-03-14 13:02:37,821 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 13:02:37,834 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b2060ab0f5558b5d7cc5e3 HTTP/1.1" 200 None 2026-03-14 13:02:37,836 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 13:02:37,866 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b2b96a4bce73bcf02350c1 HTTP/1.1" 200 None 2026-03-14 13:02:37,867 - lava_callback - ERROR - Error processing callback for node 69b2b96a4bce73bcf02350c1: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:54862 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54872 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51116 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48728 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52724 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:52736 - "GET / HTTP/1.0" 200 OK 2026-03-14 13:03:17,895 - lava_callback - INFO - Received callback for node 69b2b9934bce73bcf02350cf INFO: 172.21.0.1:52740 - "POST /node/69b2b9934bce73bcf02350cf HTTP/1.0" 202 Accepted 2026-03-14 13:03:17,900 - lava_callback - INFO - Starting async job submit for node 69b2b9934bce73bcf02350cf 2026-03-14 13:03:17,901 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 13:03:17,914 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b2b9934bce73bcf02350cf HTTP/1.1" 200 None 2026-03-14 13:03:17,915 - lava_callback - DEBUG - Processing node 69b2b9934bce73bcf02350cf: baseline-arm-clabbe 2026-03-14 13:03:17,915 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b2b9934bce73bcf02350cf 2026-03-14 13:03:17,916 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 13:03:17,929 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b2b9934bce73bcf02350cf HTTP/1.1" 200 None 2026-03-14 13:03:17,930 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 13:03:17,943 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b2060ab0f5558b5d7cc5e3 HTTP/1.1" 200 None 2026-03-14 13:03:17,945 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 13:03:17,975 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b2b9934bce73bcf02350cf HTTP/1.1" 200 None 2026-03-14 13:03:17,977 - lava_callback - ERROR - Error processing callback for node 69b2b9934bce73bcf02350cf: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:48046 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51500 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41036 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41050 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35486 - "GET / HTTP/1.0" 200 OK 2026-03-14 13:04:05,594 - lava_callback - INFO - Received callback for node 69b2b9c14bce73bcf02350d9 INFO: 172.21.0.1:55312 - "POST /node/69b2b9c14bce73bcf02350d9 HTTP/1.0" 202 Accepted 2026-03-14 13:04:05,599 - lava_callback - INFO - Starting async job submit for node 69b2b9c14bce73bcf02350d9 2026-03-14 13:04:05,600 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 13:04:05,621 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b2b9c14bce73bcf02350d9 HTTP/1.1" 200 None 2026-03-14 13:04:05,622 - lava_callback - DEBUG - Processing node 69b2b9c14bce73bcf02350d9: baseline-arm64-baylibre 2026-03-14 13:04:05,623 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b2b9c14bce73bcf02350d9 2026-03-14 13:04:05,623 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 13:04:05,636 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b2b9c14bce73bcf02350d9 HTTP/1.1" 200 None 2026-03-14 13:04:05,638 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 13:04:05,651 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69af6340275c8d3b79399dc3 HTTP/1.1" 200 None 2026-03-14 13:04:05,652 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 13:04:05,673 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b2b9c14bce73bcf02350d9 HTTP/1.1" 200 None 2026-03-14 13:04:05,674 - lava_callback - ERROR - Error processing callback for node 69b2b9c14bce73bcf02350d9: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:55324 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54282 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:54298 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57896 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51958 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46626 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46630 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33108 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48474 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41476 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:41486 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59708 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37420 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35030 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35038 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36018 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49914 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55810 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:55812 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41438 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37776 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59804 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59806 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44928 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48450 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56926 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:56930 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52400 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44488 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52864 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52874 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47672 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44564 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39018 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:39024 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41330 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36374 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48482 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48492 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47066 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36844 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36430 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:36442 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41630 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37250 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52734 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52736 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46744 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53074 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57078 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:57090 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41830 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37730 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38322 - "GET / HTTP/1.0" 200 OK 2026-03-14 13:10:45,961 - lava_callback - INFO - Received callback for node 69b2bb4f4bce73bcf023511d INFO: 172.21.0.1:38336 - "POST /node/69b2bb4f4bce73bcf023511d HTTP/1.0" 202 Accepted 2026-03-14 13:10:45,967 - lava_callback - INFO - Starting async job submit for node 69b2bb4f4bce73bcf023511d 2026-03-14 13:10:45,967 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 13:10:45,984 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b2bb4f4bce73bcf023511d HTTP/1.1" 200 None 2026-03-14 13:10:45,984 - lava_callback - DEBUG - Processing node 69b2bb4f4bce73bcf023511d: baseline-arm64-baylibre 2026-03-14 13:10:45,985 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b2bb4f4bce73bcf023511d 2026-03-14 13:10:45,985 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 13:10:45,998 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b2bb4f4bce73bcf023511d HTTP/1.1" 200 None 2026-03-14 13:10:46,000 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 13:10:46,013 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69af6340275c8d3b79399dc3 HTTP/1.1" 200 None 2026-03-14 13:10:46,014 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 13:10:46,034 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b2bb4f4bce73bcf023511d HTTP/1.1" 200 None 2026-03-14 13:10:46,040 - lava_callback - ERROR - Error processing callback for node 69b2bb4f4bce73bcf023511d: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:38348 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42678 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47108 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33602 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:33606 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51454 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55320 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56060 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56068 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34856 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34650 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35410 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:35414 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47356 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53658 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43794 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43796 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33316 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56830 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46480 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:46496 - "GET / HTTP/1.0" 200 OK 2026-03-14 13:13:26,122 - lava_callback - INFO - Received callback for node 69b2bbef4bce73bcf0235138 INFO: 172.21.0.1:47540 - "POST /node/69b2bbef4bce73bcf0235138 HTTP/1.0" 202 Accepted 2026-03-14 13:13:26,127 - lava_callback - INFO - Starting async job submit for node 69b2bbef4bce73bcf0235138 2026-03-14 13:13:26,128 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 13:13:26,143 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b2bbef4bce73bcf0235138 HTTP/1.1" 200 None 2026-03-14 13:13:26,145 - lava_callback - DEBUG - Processing node 69b2bbef4bce73bcf0235138: baseline-arm64-baylibre 2026-03-14 13:13:26,145 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b2bbef4bce73bcf0235138 2026-03-14 13:13:26,145 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 13:13:26,163 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b2bbef4bce73bcf0235138 HTTP/1.1" 200 None 2026-03-14 13:13:26,165 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 13:13:26,180 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69af6340275c8d3b79399dc3 HTTP/1.1" 200 None 2026-03-14 13:13:26,181 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 13:13:26,205 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b2bbef4bce73bcf0235138 HTTP/1.1" 200 None 2026-03-14 13:13:26,206 - lava_callback - ERROR - Error processing callback for node 69b2bbef4bce73bcf0235138: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:47542 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52782 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59186 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59198 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40950 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44508 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59352 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:59364 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43268 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48638 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59140 - "GET / HTTP/1.0" 200 OK 2026-03-14 13:14:46,334 - lava_callback - INFO - Received callback for node 69b2bc394bce73bcf0235144 INFO: 172.21.0.1:59142 - "POST /node/69b2bc394bce73bcf0235144 HTTP/1.0" 202 Accepted 2026-03-14 13:14:46,340 - lava_callback - INFO - Starting async job submit for node 69b2bc394bce73bcf0235144 2026-03-14 13:14:46,341 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 13:14:46,354 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b2bc394bce73bcf0235144 HTTP/1.1" 200 None 2026-03-14 13:14:46,355 - lava_callback - DEBUG - Processing node 69b2bc394bce73bcf0235144: baseline-arm64-baylibre 2026-03-14 13:14:46,355 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b2bc394bce73bcf0235144 2026-03-14 13:14:46,356 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 13:14:46,375 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b2bc394bce73bcf0235144 HTTP/1.1" 200 None 2026-03-14 13:14:46,377 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 13:14:46,391 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b2061ab0f5558b5d7cc5f2 HTTP/1.1" 200 None 2026-03-14 13:14:46,392 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 13:14:46,413 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b2bc394bce73bcf0235144 HTTP/1.1" 200 None 2026-03-14 13:14:46,415 - lava_callback - ERROR - Error processing callback for node 69b2bc394bce73bcf0235144: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:59148 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35434 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45938 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46188 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:46202 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34846 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49884 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41256 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41272 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51004 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53196 - "GET / HTTP/1.0" 200 OK 2026-03-14 13:16:06,593 - lava_callback - INFO - Received callback for node 69b2bc874bce73bcf0235152 INFO: 172.21.0.1:53210 - "POST /node/69b2bc874bce73bcf0235152 HTTP/1.0" 202 Accepted 2026-03-14 13:16:06,598 - lava_callback - INFO - Starting async job submit for node 69b2bc874bce73bcf0235152 2026-03-14 13:16:06,599 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 13:16:06,615 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b2bc874bce73bcf0235152 HTTP/1.1" 200 None 2026-03-14 13:16:06,616 - lava_callback - DEBUG - Processing node 69b2bc874bce73bcf0235152: baseline-arm64-baylibre 2026-03-14 13:16:06,617 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b2bc874bce73bcf0235152 2026-03-14 13:16:06,617 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 13:16:06,631 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b2bc874bce73bcf0235152 HTTP/1.1" 200 None 2026-03-14 13:16:06,632 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 13:16:06,649 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b2061ab0f5558b5d7cc5f2 HTTP/1.1" 200 None 2026-03-14 13:16:06,650 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 13:16:06,678 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b2bc874bce73bcf0235152 HTTP/1.1" 200 None 2026-03-14 13:16:06,679 - lava_callback - ERROR - Error processing callback for node 69b2bc874bce73bcf0235152: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:55566 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:55576 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57658 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50708 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48304 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48308 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45490 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57546 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48960 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:48964 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50002 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38760 - "GET / HTTP/1.0" 200 OK 2026-03-14 13:17:38,514 - lava_callback - INFO - Received callback for node 69b2bcde4bce73bcf0235161 INFO: 172.21.0.1:38766 - "POST /node/69b2bcde4bce73bcf0235161 HTTP/1.0" 202 Accepted 2026-03-14 13:17:38,519 - lava_callback - INFO - Starting async job submit for node 69b2bcde4bce73bcf0235161 2026-03-14 13:17:38,520 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 13:17:38,534 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b2bcde4bce73bcf0235161 HTTP/1.1" 200 None 2026-03-14 13:17:38,534 - lava_callback - DEBUG - Processing node 69b2bcde4bce73bcf0235161: baseline-arm64-clabbe 2026-03-14 13:17:38,535 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b2bcde4bce73bcf0235161 2026-03-14 13:17:38,535 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 13:17:38,548 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b2bcde4bce73bcf0235161 HTTP/1.1" 200 None 2026-03-14 13:17:38,549 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 13:17:38,562 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69af6340275c8d3b79399dc3 HTTP/1.1" 200 None 2026-03-14 13:17:38,564 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 13:17:38,589 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b2bcde4bce73bcf0235161 HTTP/1.1" 200 None 2026-03-14 13:17:38,591 - lava_callback - ERROR - Error processing callback for node 69b2bcde4bce73bcf0235161: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:58834 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58840 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50942 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57380 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39040 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:39046 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52144 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57588 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60412 - "GET / HTTP/1.0" 200 OK 2026-03-14 13:18:46,372 - lava_callback - INFO - Received callback for node 69b2bd224bce73bcf023516b INFO: 172.21.0.1:60420 - "POST /node/69b2bd224bce73bcf023516b HTTP/1.0" 202 Accepted 2026-03-14 13:18:46,377 - lava_callback - INFO - Starting async job submit for node 69b2bd224bce73bcf023516b 2026-03-14 13:18:46,378 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 13:18:46,392 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b2bd224bce73bcf023516b HTTP/1.1" 200 None 2026-03-14 13:18:46,393 - lava_callback - DEBUG - Processing node 69b2bd224bce73bcf023516b: baseline-arm64-baylibre 2026-03-14 13:18:46,394 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b2bd224bce73bcf023516b 2026-03-14 13:18:46,394 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 13:18:46,407 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b2bd224bce73bcf023516b HTTP/1.1" 200 None 2026-03-14 13:18:46,408 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 13:18:46,421 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b2061ab0f5558b5d7cc5f2 HTTP/1.1" 200 None 2026-03-14 13:18:46,423 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 13:18:46,449 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b2bd224bce73bcf023516b HTTP/1.1" 200 None 2026-03-14 13:18:46,454 - lava_callback - ERROR - Error processing callback for node 69b2bd224bce73bcf023516b: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:60436 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56140 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50056 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44636 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:44650 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58478 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33268 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47350 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47366 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42126 - "GET / HTTP/1.0" 200 OK 2026-03-14 13:19:58,608 - lava_callback - INFO - Received callback for node 69b2bd774bce73bcf023517c INFO: 172.21.0.1:42140 - "POST /node/69b2bd774bce73bcf023517c HTTP/1.0" 202 Accepted 2026-03-14 13:19:58,614 - lava_callback - INFO - Starting async job submit for node 69b2bd774bce73bcf023517c 2026-03-14 13:19:58,615 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 13:19:58,628 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b2bd774bce73bcf023517c HTTP/1.1" 200 None 2026-03-14 13:19:58,629 - lava_callback - DEBUG - Processing node 69b2bd774bce73bcf023517c: baseline-arm64-clabbe 2026-03-14 13:19:58,629 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b2bd774bce73bcf023517c 2026-03-14 13:19:58,630 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 13:19:58,643 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b2bd774bce73bcf023517c HTTP/1.1" 200 None 2026-03-14 13:19:58,645 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 13:19:58,679 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69af6340275c8d3b79399dc3 HTTP/1.1" 200 None 2026-03-14 13:19:58,680 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 13:19:58,710 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b2bd774bce73bcf023517c HTTP/1.1" 200 None 2026-03-14 13:19:58,712 - lava_callback - ERROR - Error processing callback for node 69b2bd774bce73bcf023517c: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:49204 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48494 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:48504 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43106 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38116 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58936 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58952 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37298 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51266 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49792 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:49808 - "GET / HTTP/1.0" 200 OK 2026-03-14 13:21:18,590 - lava_callback - INFO - Received callback for node 69b2bdc44bce73bcf0235187 INFO: 172.21.0.1:49820 - "POST /node/69b2bdc44bce73bcf0235187 HTTP/1.0" 202 Accepted 2026-03-14 13:21:18,596 - lava_callback - INFO - Starting async job submit for node 69b2bdc44bce73bcf0235187 2026-03-14 13:21:18,597 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 13:21:18,611 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b2bdc44bce73bcf0235187 HTTP/1.1" 200 None 2026-03-14 13:21:18,612 - lava_callback - DEBUG - Processing node 69b2bdc44bce73bcf0235187: baseline-arm64-clabbe 2026-03-14 13:21:18,612 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b2bdc44bce73bcf0235187 2026-03-14 13:21:18,613 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 13:21:18,631 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b2bdc44bce73bcf0235187 HTTP/1.1" 200 None 2026-03-14 13:21:18,633 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 13:21:18,657 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69af6340275c8d3b79399dc3 HTTP/1.1" 200 None 2026-03-14 13:21:18,660 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 13:21:18,681 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b2bdc44bce73bcf0235187 HTTP/1.1" 200 None 2026-03-14 13:21:18,682 - lava_callback - ERROR - Error processing callback for node 69b2bdc44bce73bcf0235187: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:37930 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36856 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60880 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60888 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59898 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42412 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56574 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:56578 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50024 - "GET / HTTP/1.0" 200 OK 2026-03-14 13:22:26,582 - lava_callback - INFO - Received callback for node 69b2be0b4bce73bcf0235192 INFO: 172.21.0.1:50036 - "POST /node/69b2be0b4bce73bcf0235192 HTTP/1.0" 202 Accepted 2026-03-14 13:22:26,587 - lava_callback - INFO - Starting async job submit for node 69b2be0b4bce73bcf0235192 2026-03-14 13:22:26,588 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 13:22:26,602 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b2be0b4bce73bcf0235192 HTTP/1.1" 200 None 2026-03-14 13:22:26,603 - lava_callback - DEBUG - Processing node 69b2be0b4bce73bcf0235192: baseline-arm64-baylibre 2026-03-14 13:22:26,603 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b2be0b4bce73bcf0235192 2026-03-14 13:22:26,604 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 13:22:26,624 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b2be0b4bce73bcf0235192 HTTP/1.1" 200 None 2026-03-14 13:22:26,626 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 13:22:26,639 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b2061ab0f5558b5d7cc5f2 HTTP/1.1" 200 None 2026-03-14 13:22:26,640 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 13:22:26,699 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b2be0b4bce73bcf0235192 HTTP/1.1" 200 None 2026-03-14 13:22:26,701 - lava_callback - ERROR - Error processing callback for node 69b2be0b4bce73bcf0235192: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:38156 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60750 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60764 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54656 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33474 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50958 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:50968 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45086 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36882 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54180 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54184 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51562 - "GET / HTTP/1.0" 200 OK 2026-03-14 13:23:58,762 - lava_callback - INFO - Received callback for node 69b2be5d4bce73bcf023519a INFO: 172.21.0.1:51570 - "POST /node/69b2be5d4bce73bcf023519a HTTP/1.0" 202 Accepted 2026-03-14 13:23:58,767 - lava_callback - INFO - Starting async job submit for node 69b2be5d4bce73bcf023519a 2026-03-14 13:23:58,768 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 13:23:58,782 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b2be5d4bce73bcf023519a HTTP/1.1" 200 None 2026-03-14 13:23:58,783 - lava_callback - DEBUG - Processing node 69b2be5d4bce73bcf023519a: baseline-arm64-clabbe 2026-03-14 13:23:58,783 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b2be5d4bce73bcf023519a 2026-03-14 13:23:58,784 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 13:23:58,822 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b2be5d4bce73bcf023519a HTTP/1.1" 200 None 2026-03-14 13:23:58,824 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 13:23:58,837 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69af6340275c8d3b79399dc3 HTTP/1.1" 200 None 2026-03-14 13:23:58,839 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 13:23:58,859 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b2be5d4bce73bcf023519a HTTP/1.1" 200 None 2026-03-14 13:23:58,864 - lava_callback - ERROR - Error processing callback for node 69b2be5d4bce73bcf023519a: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:50476 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48960 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:48970 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48526 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45524 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51858 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51860 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39860 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39702 - "GET / HTTP/1.0" 200 OK 2026-03-14 13:25:06,687 - lava_callback - INFO - Received callback for node 69b2bea44bce73bcf02351a6 INFO: 172.21.0.1:39710 - "POST /node/69b2bea44bce73bcf02351a6 HTTP/1.0" 202 Accepted 2026-03-14 13:25:06,692 - lava_callback - INFO - Starting async job submit for node 69b2bea44bce73bcf02351a6 2026-03-14 13:25:06,693 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 13:25:06,709 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b2bea44bce73bcf02351a6 HTTP/1.1" 200 None 2026-03-14 13:25:06,710 - lava_callback - DEBUG - Processing node 69b2bea44bce73bcf02351a6: baseline-arm64-baylibre 2026-03-14 13:25:06,710 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b2bea44bce73bcf02351a6 2026-03-14 13:25:06,711 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 13:25:06,725 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b2bea44bce73bcf02351a6 HTTP/1.1" 200 None 2026-03-14 13:25:06,726 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 13:25:06,739 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b2061ab0f5558b5d7cc5f2 HTTP/1.1" 200 None 2026-03-14 13:25:06,741 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 13:25:06,762 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b2bea44bce73bcf02351a6 HTTP/1.1" 200 None 2026-03-14 13:25:06,763 - lava_callback - ERROR - Error processing callback for node 69b2bea44bce73bcf02351a6: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:54590 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:54602 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59372 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57000 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50208 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50218 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41670 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33046 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59576 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:59590 - "GET / HTTP/1.0" 200 OK 2026-03-14 13:26:18,823 - lava_callback - INFO - Received callback for node 69b2bef64bce73bcf02351b1 INFO: 172.21.0.1:59602 - "POST /node/69b2bef64bce73bcf02351b1 HTTP/1.0" 202 Accepted 2026-03-14 13:26:18,828 - lava_callback - INFO - Starting async job submit for node 69b2bef64bce73bcf02351b1 2026-03-14 13:26:18,829 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 13:26:18,845 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b2bef64bce73bcf02351b1 HTTP/1.1" 200 None 2026-03-14 13:26:18,846 - lava_callback - DEBUG - Processing node 69b2bef64bce73bcf02351b1: baseline-arm64-clabbe 2026-03-14 13:26:18,846 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b2bef64bce73bcf02351b1 2026-03-14 13:26:18,846 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 13:26:18,859 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b2bef64bce73bcf02351b1 HTTP/1.1" 200 None 2026-03-14 13:26:18,861 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 13:26:18,874 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69af6340275c8d3b79399dc3 HTTP/1.1" 200 None 2026-03-14 13:26:18,876 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 13:26:18,900 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b2bef64bce73bcf02351b1 HTTP/1.1" 200 None 2026-03-14 13:26:18,905 - lava_callback - ERROR - Error processing callback for node 69b2bef64bce73bcf02351b1: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:41452 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54560 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36352 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36356 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46658 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58494 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57996 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:58000 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50728 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58654 - "GET / HTTP/1.0" 200 OK 2026-03-14 13:27:38,879 - lava_callback - INFO - Received callback for node 69b2bf424bce73bcf02351bd INFO: 172.21.0.1:58656 - "POST /node/69b2bf424bce73bcf02351bd HTTP/1.0" 202 Accepted 2026-03-14 13:27:38,885 - lava_callback - INFO - Starting async job submit for node 69b2bf424bce73bcf02351bd 2026-03-14 13:27:38,886 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 13:27:38,901 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b2bf424bce73bcf02351bd HTTP/1.1" 200 None 2026-03-14 13:27:38,901 - lava_callback - DEBUG - Processing node 69b2bf424bce73bcf02351bd: baseline-arm64-clabbe 2026-03-14 13:27:38,902 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b2bf424bce73bcf02351bd 2026-03-14 13:27:38,902 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 13:27:38,917 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b2bf424bce73bcf02351bd HTTP/1.1" 200 None 2026-03-14 13:27:38,919 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 13:27:38,934 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b2061ab0f5558b5d7cc5f2 HTTP/1.1" 200 None 2026-03-14 13:27:38,936 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 13:27:38,957 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b2bf424bce73bcf02351bd HTTP/1.1" 200 None 2026-03-14 13:27:38,962 - lava_callback - ERROR - Error processing callback for node 69b2bf424bce73bcf02351bd: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:37910 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37914 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48714 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52176 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33364 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:33380 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46110 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47134 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45374 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45384 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50042 - "GET / HTTP/1.0" 200 OK 2026-03-14 13:28:58,914 - lava_callback - INFO - Received callback for node 69b2bf934bce73bcf02351cc INFO: 172.21.0.1:50052 - "POST /node/69b2bf934bce73bcf02351cc HTTP/1.0" 202 Accepted 2026-03-14 13:28:58,920 - lava_callback - INFO - Starting async job submit for node 69b2bf934bce73bcf02351cc 2026-03-14 13:28:58,920 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 13:28:58,937 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b2bf934bce73bcf02351cc HTTP/1.1" 200 None 2026-03-14 13:28:58,938 - lava_callback - DEBUG - Processing node 69b2bf934bce73bcf02351cc: baseline-arm64-clabbe 2026-03-14 13:28:58,938 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b2bf934bce73bcf02351cc 2026-03-14 13:28:58,938 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 13:28:58,951 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b2bf934bce73bcf02351cc HTTP/1.1" 200 None 2026-03-14 13:28:58,953 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 13:28:58,966 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69af6340275c8d3b79399dc3 HTTP/1.1" 200 None 2026-03-14 13:28:58,968 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 13:28:58,998 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b2bf934bce73bcf02351cc HTTP/1.1" 200 None 2026-03-14 13:28:59,005 - lava_callback - ERROR - Error processing callback for node 69b2bf934bce73bcf02351cc: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:58694 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38636 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:38650 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51346 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54820 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58922 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58938 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52464 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59186 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36686 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:36688 - "GET / HTTP/1.0" 200 OK 2026-03-14 13:30:18,872 - lava_callback - INFO - Received callback for node 69b2bfe44bce73bcf02351d4 INFO: 172.21.0.1:36700 - "POST /node/69b2bfe44bce73bcf02351d4 HTTP/1.0" 202 Accepted 2026-03-14 13:30:18,878 - lava_callback - INFO - Starting async job submit for node 69b2bfe44bce73bcf02351d4 2026-03-14 13:30:18,879 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 13:30:18,905 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b2bfe44bce73bcf02351d4 HTTP/1.1" 200 None 2026-03-14 13:30:18,906 - lava_callback - DEBUG - Processing node 69b2bfe44bce73bcf02351d4: baseline-arm64-clabbe 2026-03-14 13:30:18,906 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b2bfe44bce73bcf02351d4 2026-03-14 13:30:18,906 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 13:30:18,920 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b2bfe44bce73bcf02351d4 HTTP/1.1" 200 None 2026-03-14 13:30:18,921 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 13:30:18,935 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b2061ab0f5558b5d7cc5f2 HTTP/1.1" 200 None 2026-03-14 13:30:18,936 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 13:30:18,960 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b2bfe44bce73bcf02351d4 HTTP/1.1" 200 None 2026-03-14 13:30:18,961 - lava_callback - ERROR - Error processing callback for node 69b2bfe44bce73bcf02351d4: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:47662 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38866 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41858 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41864 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37284 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40074 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48836 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:48844 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53602 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40588 - "GET / HTTP/1.0" 200 OK 2026-03-14 13:31:38,989 - lava_callback - INFO - Received callback for node 69b2c0374bce73bcf02351e2 INFO: 172.21.0.1:40592 - "POST /node/69b2c0374bce73bcf02351e2 HTTP/1.0" 202 Accepted 2026-03-14 13:31:38,994 - lava_callback - INFO - Starting async job submit for node 69b2c0374bce73bcf02351e2 2026-03-14 13:31:38,995 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 13:31:39,012 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b2c0374bce73bcf02351e2 HTTP/1.1" 200 None 2026-03-14 13:31:39,013 - lava_callback - DEBUG - Processing node 69b2c0374bce73bcf02351e2: baseline-arm64-clabbe 2026-03-14 13:31:39,014 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b2c0374bce73bcf02351e2 2026-03-14 13:31:39,014 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 13:31:39,028 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b2c0374bce73bcf02351e2 HTTP/1.1" 200 None 2026-03-14 13:31:39,029 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 13:31:39,046 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b2061ab0f5558b5d7cc5f2 HTTP/1.1" 200 None 2026-03-14 13:31:39,048 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 13:31:39,068 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b2c0374bce73bcf02351e2 HTTP/1.1" 200 None 2026-03-14 13:31:39,075 - lava_callback - ERROR - Error processing callback for node 69b2c0374bce73bcf02351e2: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:44332 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44336 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39894 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55158 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37220 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:37224 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44454 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43190 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40724 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40738 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51240 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53852 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41590 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:41598 - "GET / HTTP/1.0" 200 OK 2026-03-14 13:33:19,096 - lava_callback - INFO - Received callback for node 69b2c0894bce73bcf02351ec INFO: 172.21.0.1:41610 - "POST /node/69b2c0894bce73bcf02351ec HTTP/1.0" 202 Accepted 2026-03-14 13:33:19,101 - lava_callback - INFO - Starting async job submit for node 69b2c0894bce73bcf02351ec 2026-03-14 13:33:19,103 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 13:33:19,117 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b2c0894bce73bcf02351ec HTTP/1.1" 200 None 2026-03-14 13:33:19,118 - lava_callback - DEBUG - Processing node 69b2c0894bce73bcf02351ec: baseline-arm64-clabbe 2026-03-14 13:33:19,118 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b2c0894bce73bcf02351ec 2026-03-14 13:33:19,119 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 13:33:19,133 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b2c0894bce73bcf02351ec HTTP/1.1" 200 None 2026-03-14 13:33:19,134 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 13:33:19,148 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b2061ab0f5558b5d7cc5f2 HTTP/1.1" 200 None 2026-03-14 13:33:19,149 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 13:33:19,170 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b2c0894bce73bcf02351ec HTTP/1.1" 200 None 2026-03-14 13:33:19,171 - lava_callback - ERROR - Error processing callback for node 69b2c0894bce73bcf02351ec: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:49430 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42558 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43352 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43354 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47860 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38608 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50620 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:50624 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40798 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45164 - "GET / HTTP/1.0" 200 OK 2026-03-14 13:34:39,147 - lava_callback - INFO - Received callback for node 69b2c0dc4bce73bcf02351f9 INFO: 172.21.0.1:45174 - "POST /node/69b2c0dc4bce73bcf02351f9 HTTP/1.0" 202 Accepted 2026-03-14 13:34:39,152 - lava_callback - INFO - Starting async job submit for node 69b2c0dc4bce73bcf02351f9 2026-03-14 13:34:39,153 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 13:34:39,167 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b2c0dc4bce73bcf02351f9 HTTP/1.1" 200 None 2026-03-14 13:34:39,168 - lava_callback - DEBUG - Processing node 69b2c0dc4bce73bcf02351f9: baseline-arm64-clabbe 2026-03-14 13:34:39,168 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b2c0dc4bce73bcf02351f9 2026-03-14 13:34:39,169 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 13:34:39,182 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b2c0dc4bce73bcf02351f9 HTTP/1.1" 200 None 2026-03-14 13:34:39,183 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 13:34:39,197 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b2061ab0f5558b5d7cc5f2 HTTP/1.1" 200 None 2026-03-14 13:34:39,198 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 13:34:39,218 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b2c0dc4bce73bcf02351f9 HTTP/1.1" 200 None 2026-03-14 13:34:39,223 - lava_callback - ERROR - Error processing callback for node 69b2c0dc4bce73bcf02351f9: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:38738 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38748 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56968 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49440 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55780 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:55790 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50506 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33104 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47154 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47168 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60774 - "GET / HTTP/1.0" 200 OK 2026-03-14 13:35:59,262 - lava_callback - INFO - Received callback for node 69b2c1304bce73bcf0235204 INFO: 172.21.0.1:60790 - "POST /node/69b2c1304bce73bcf0235204 HTTP/1.0" 202 Accepted 2026-03-14 13:35:59,268 - lava_callback - INFO - Starting async job submit for node 69b2c1304bce73bcf0235204 2026-03-14 13:35:59,269 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 13:35:59,283 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b2c1304bce73bcf0235204 HTTP/1.1" 200 None 2026-03-14 13:35:59,285 - lava_callback - DEBUG - Processing node 69b2c1304bce73bcf0235204: baseline-arm64-clabbe 2026-03-14 13:35:59,285 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b2c1304bce73bcf0235204 2026-03-14 13:35:59,285 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 13:35:59,300 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b2c1304bce73bcf0235204 HTTP/1.1" 200 None 2026-03-14 13:35:59,302 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 13:35:59,316 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b2061ab0f5558b5d7cc5f2 HTTP/1.1" 200 None 2026-03-14 13:35:59,318 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 13:35:59,347 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b2c1304bce73bcf0235204 HTTP/1.1" 200 None 2026-03-14 13:35:59,350 - lava_callback - ERROR - Error processing callback for node 69b2c1304bce73bcf0235204: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:35158 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60674 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:60686 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34916 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45266 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33284 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33298 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34018 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39572 - "GET / HTTP/1.0" 200 OK 2026-03-14 13:37:07,390 - lava_callback - INFO - Received callback for node 69b2c17b4bce73bcf023520e INFO: 172.21.0.1:39582 - "POST /node/69b2c17b4bce73bcf023520e HTTP/1.0" 202 Accepted 2026-03-14 13:37:07,395 - lava_callback - INFO - Starting async job submit for node 69b2c17b4bce73bcf023520e 2026-03-14 13:37:07,396 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 13:37:07,411 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b2c17b4bce73bcf023520e HTTP/1.1" 200 None 2026-03-14 13:37:07,412 - lava_callback - DEBUG - Processing node 69b2c17b4bce73bcf023520e: baseline-arm64-baylibre 2026-03-14 13:37:07,412 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b2c17b4bce73bcf023520e 2026-03-14 13:37:07,413 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 13:37:07,429 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b2c17b4bce73bcf023520e HTTP/1.1" 200 None 2026-03-14 13:37:07,430 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 13:37:07,444 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69af6340275c8d3b79399dc3 HTTP/1.1" 200 None 2026-03-14 13:37:07,446 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 13:37:07,466 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b2c17b4bce73bcf023520e HTTP/1.1" 200 None 2026-03-14 13:37:07,467 - lava_callback - ERROR - Error processing callback for node 69b2c17b4bce73bcf023520e: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:48062 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:48070 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42544 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56694 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43830 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43838 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54434 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41008 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40166 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:40170 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37180 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43638 - "GET / HTTP/1.0" 200 OK 2026-03-14 13:38:39,495 - lava_callback - INFO - Received callback for node 69b2c1d34bce73bcf023521c INFO: 172.21.0.1:43654 - "POST /node/69b2c1d34bce73bcf023521c HTTP/1.0" 202 Accepted 2026-03-14 13:38:39,501 - lava_callback - INFO - Starting async job submit for node 69b2c1d34bce73bcf023521c 2026-03-14 13:38:39,502 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 13:38:39,516 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b2c1d34bce73bcf023521c HTTP/1.1" 200 None 2026-03-14 13:38:39,517 - lava_callback - DEBUG - Processing node 69b2c1d34bce73bcf023521c: baseline-arm64-clabbe 2026-03-14 13:38:39,517 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b2c1d34bce73bcf023521c 2026-03-14 13:38:39,518 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 13:38:39,536 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b2c1d34bce73bcf023521c HTTP/1.1" 200 None 2026-03-14 13:38:39,537 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 13:38:39,551 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69af6340275c8d3b79399dc3 HTTP/1.1" 200 None 2026-03-14 13:38:39,552 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 13:38:39,577 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b2c1d34bce73bcf023521c HTTP/1.1" 200 None 2026-03-14 13:38:39,578 - lava_callback - ERROR - Error processing callback for node 69b2c1d34bce73bcf023521c: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:44542 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44558 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44562 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57906 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56316 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54776 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:54792 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46828 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52458 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46226 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46228 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53976 - "GET / HTTP/1.0" 200 OK 2026-03-14 13:39:59,419 - lava_callback - INFO - Received callback for node 69b2c2264bce73bcf023522d INFO: 172.21.0.1:53992 - "POST /node/69b2c2264bce73bcf023522d HTTP/1.0" 202 Accepted 2026-03-14 13:39:59,424 - lava_callback - INFO - Starting async job submit for node 69b2c2264bce73bcf023522d 2026-03-14 13:39:59,425 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 13:39:59,440 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b2c2264bce73bcf023522d HTTP/1.1" 200 None 2026-03-14 13:39:59,440 - lava_callback - DEBUG - Processing node 69b2c2264bce73bcf023522d: baseline-arm64-clabbe 2026-03-14 13:39:59,441 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b2c2264bce73bcf023522d 2026-03-14 13:39:59,441 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 13:39:59,455 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b2c2264bce73bcf023522d HTTP/1.1" 200 None 2026-03-14 13:39:59,456 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 13:39:59,470 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69af6340275c8d3b79399dc3 HTTP/1.1" 200 None 2026-03-14 13:39:59,471 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 13:39:59,492 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b2c2264bce73bcf023522d HTTP/1.1" 200 None 2026-03-14 13:39:59,494 - lava_callback - ERROR - Error processing callback for node 69b2c2264bce73bcf023522d: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:52846 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55170 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:55174 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34448 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51280 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58108 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58120 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51300 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43644 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55326 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:55332 - "GET / HTTP/1.0" 200 OK 2026-03-14 13:41:19,465 - lava_callback - INFO - Received callback for node 69b2c2784bce73bcf0235236 INFO: 172.21.0.1:55334 - "POST /node/69b2c2784bce73bcf0235236 HTTP/1.0" 202 Accepted 2026-03-14 13:41:19,470 - lava_callback - INFO - Starting async job submit for node 69b2c2784bce73bcf0235236 2026-03-14 13:41:19,471 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 13:41:19,486 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b2c2784bce73bcf0235236 HTTP/1.1" 200 None 2026-03-14 13:41:19,486 - lava_callback - DEBUG - Processing node 69b2c2784bce73bcf0235236: baseline-arm64-clabbe 2026-03-14 13:41:19,487 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b2c2784bce73bcf0235236 2026-03-14 13:41:19,487 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 13:41:19,500 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b2c2784bce73bcf0235236 HTTP/1.1" 200 None 2026-03-14 13:41:19,502 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 13:41:19,514 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69af6340275c8d3b79399dc3 HTTP/1.1" 200 None 2026-03-14 13:41:19,516 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 13:41:19,536 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b2c2784bce73bcf0235236 HTTP/1.1" 200 None 2026-03-14 13:41:19,537 - lava_callback - ERROR - Error processing callback for node 69b2c2784bce73bcf0235236: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:39144 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45446 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48460 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48472 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44644 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46918 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47344 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:47354 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48512 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39506 - "GET / HTTP/1.0" 200 OK 2026-03-14 13:42:39,508 - lava_callback - INFO - Received callback for node 69b2c2c84bce73bcf0235245 INFO: 172.21.0.1:39520 - "POST /node/69b2c2c84bce73bcf0235245 HTTP/1.0" 202 Accepted 2026-03-14 13:42:39,513 - lava_callback - INFO - Starting async job submit for node 69b2c2c84bce73bcf0235245 2026-03-14 13:42:39,514 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 13:42:39,529 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b2c2c84bce73bcf0235245 HTTP/1.1" 200 None 2026-03-14 13:42:39,530 - lava_callback - DEBUG - Processing node 69b2c2c84bce73bcf0235245: baseline-arm64-clabbe 2026-03-14 13:42:39,530 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b2c2c84bce73bcf0235245 2026-03-14 13:42:39,531 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 13:42:39,545 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b2c2c84bce73bcf0235245 HTTP/1.1" 200 None 2026-03-14 13:42:39,546 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 13:42:39,560 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69af6340275c8d3b79399dc3 HTTP/1.1" 200 None 2026-03-14 13:42:39,562 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 13:42:39,583 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b2c2c84bce73bcf0235245 HTTP/1.1" 200 None 2026-03-14 13:42:39,584 - lava_callback - ERROR - Error processing callback for node 69b2c2c84bce73bcf0235245: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:46682 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46692 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41014 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54356 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35850 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:35862 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58978 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60658 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49330 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49334 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56956 - "GET / HTTP/1.0" 200 OK 2026-03-14 13:43:59,549 - lava_callback - INFO - Received callback for node 69b2c3194bce73bcf0235256 INFO: 172.21.0.1:56958 - "POST /node/69b2c3194bce73bcf0235256 HTTP/1.0" 202 Accepted 2026-03-14 13:43:59,554 - lava_callback - INFO - Starting async job submit for node 69b2c3194bce73bcf0235256 2026-03-14 13:43:59,555 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 13:43:59,575 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b2c3194bce73bcf0235256 HTTP/1.1" 200 None 2026-03-14 13:43:59,576 - lava_callback - DEBUG - Processing node 69b2c3194bce73bcf0235256: baseline-arm64-clabbe 2026-03-14 13:43:59,576 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b2c3194bce73bcf0235256 2026-03-14 13:43:59,576 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 13:43:59,590 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b2c3194bce73bcf0235256 HTTP/1.1" 200 None 2026-03-14 13:43:59,591 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 13:43:59,604 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69af6340275c8d3b79399dc3 HTTP/1.1" 200 None 2026-03-14 13:43:59,606 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 13:43:59,626 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b2c3194bce73bcf0235256 HTTP/1.1" 200 None 2026-03-14 13:43:59,632 - lava_callback - ERROR - Error processing callback for node 69b2c3194bce73bcf0235256: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:34470 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55112 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:55126 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60714 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45158 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59168 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59180 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36514 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42064 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59698 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:59710 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57660 - "GET / HTTP/1.0" 200 OK 2026-03-14 13:45:27,825 - lava_callback - INFO - Received callback for node 69b2c3624bce73bcf023525d INFO: 172.21.0.1:57674 - "POST /node/69b2c3624bce73bcf023525d HTTP/1.0" 202 Accepted 2026-03-14 13:45:27,831 - lava_callback - INFO - Starting async job submit for node 69b2c3624bce73bcf023525d 2026-03-14 13:45:27,832 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 13:45:27,845 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b2c3624bce73bcf023525d HTTP/1.1" 200 None 2026-03-14 13:45:27,846 - lava_callback - DEBUG - Processing node 69b2c3624bce73bcf023525d: baseline-arm64-baylibre 2026-03-14 13:45:27,847 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b2c3624bce73bcf023525d 2026-03-14 13:45:27,847 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 13:45:27,865 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b2c3624bce73bcf023525d HTTP/1.1" 200 None 2026-03-14 13:45:27,866 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 13:45:27,883 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69af6340275c8d3b79399dc3 HTTP/1.1" 200 None 2026-03-14 13:45:27,884 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 13:45:27,924 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b2c3624bce73bcf023525d HTTP/1.1" 200 None 2026-03-14 13:45:27,929 - lava_callback - ERROR - Error processing callback for node 69b2c3624bce73bcf023525d: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:52204 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36800 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36816 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54958 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47564 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48490 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:48492 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53228 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36060 - "GET / HTTP/1.0" 200 OK 2026-03-14 13:46:39,673 - lava_callback - INFO - Received callback for node 69b2c3bb4bce73bcf023526b INFO: 172.21.0.1:36076 - "POST /node/69b2c3bb4bce73bcf023526b HTTP/1.0" 202 Accepted 2026-03-14 13:46:39,679 - lava_callback - INFO - Starting async job submit for node 69b2c3bb4bce73bcf023526b 2026-03-14 13:46:39,680 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 13:46:39,702 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b2c3bb4bce73bcf023526b HTTP/1.1" 200 None 2026-03-14 13:46:39,703 - lava_callback - DEBUG - Processing node 69b2c3bb4bce73bcf023526b: baseline-arm64-clabbe 2026-03-14 13:46:39,704 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b2c3bb4bce73bcf023526b 2026-03-14 13:46:39,704 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 13:46:39,718 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b2c3bb4bce73bcf023526b HTTP/1.1" 200 None 2026-03-14 13:46:39,719 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 13:46:39,733 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69af6340275c8d3b79399dc3 HTTP/1.1" 200 None 2026-03-14 13:46:39,735 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 13:46:39,764 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b2c3bb4bce73bcf023526b HTTP/1.1" 200 None 2026-03-14 13:46:39,765 - lava_callback - ERROR - Error processing callback for node 69b2c3bb4bce73bcf023526b: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:44230 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44232 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58612 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:32832 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51998 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:52012 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35344 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54334 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46818 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46828 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53442 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41898 - "GET / HTTP/1.0" 200 OK 2026-03-14 13:48:07,992 - lava_callback - INFO - Received callback for node 69b2c4054bce73bcf023527a INFO: 172.21.0.1:41908 - "POST /node/69b2c4054bce73bcf023527a HTTP/1.0" 202 Accepted 2026-03-14 13:48:07,997 - lava_callback - INFO - Starting async job submit for node 69b2c4054bce73bcf023527a 2026-03-14 13:48:07,998 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 13:48:08,013 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b2c4054bce73bcf023527a HTTP/1.1" 200 None 2026-03-14 13:48:08,013 - lava_callback - DEBUG - Processing node 69b2c4054bce73bcf023527a: baseline-arm64-baylibre 2026-03-14 13:48:08,014 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b2c4054bce73bcf023527a 2026-03-14 13:48:08,014 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 13:48:08,028 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b2c4054bce73bcf023527a HTTP/1.1" 200 None 2026-03-14 13:48:08,029 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 13:48:08,042 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69af6340275c8d3b79399dc3 HTTP/1.1" 200 None 2026-03-14 13:48:08,043 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 13:48:08,064 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b2c4054bce73bcf023527a HTTP/1.1" 200 None 2026-03-14 13:48:08,066 - lava_callback - ERROR - Error processing callback for node 69b2c4054bce73bcf023527a: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:57074 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:57076 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34770 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48632 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44028 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44034 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38772 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47902 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38798 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:38814 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59378 - "GET / HTTP/1.0" 200 OK 2026-03-14 13:49:28,290 - lava_callback - INFO - Received callback for node 69b2c4564bce73bcf0235282 INFO: 172.21.0.1:59388 - "POST /node/69b2c4564bce73bcf0235282 HTTP/1.0" 202 Accepted 2026-03-14 13:49:28,296 - lava_callback - INFO - Starting async job submit for node 69b2c4564bce73bcf0235282 2026-03-14 13:49:28,296 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 13:49:28,311 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b2c4564bce73bcf0235282 HTTP/1.1" 200 None 2026-03-14 13:49:28,312 - lava_callback - DEBUG - Processing node 69b2c4564bce73bcf0235282: baseline-arm64-baylibre 2026-03-14 13:49:28,312 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b2c4564bce73bcf0235282 2026-03-14 13:49:28,313 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 13:49:28,326 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b2c4564bce73bcf0235282 HTTP/1.1" 200 None 2026-03-14 13:49:28,327 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 13:49:28,340 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69af6340275c8d3b79399dc3 HTTP/1.1" 200 None 2026-03-14 13:49:28,342 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 13:49:28,362 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b2c4564bce73bcf0235282 HTTP/1.1" 200 None 2026-03-14 13:49:28,363 - lava_callback - ERROR - Error processing callback for node 69b2c4564bce73bcf0235282: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:36088 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55716 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55722 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47688 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58198 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47244 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:47248 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35372 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54072 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46366 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46370 - "GET / HTTP/1.0" 200 OK 2026-03-14 13:50:48,104 - lava_callback - INFO - Received callback for node 69b2c4a84bce73bcf023528e INFO: 172.21.0.1:46378 - "POST /node/69b2c4a84bce73bcf023528e HTTP/1.0" 202 Accepted 2026-03-14 13:50:48,110 - lava_callback - INFO - Starting async job submit for node 69b2c4a84bce73bcf023528e 2026-03-14 13:50:48,111 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 13:50:48,136 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b2c4a84bce73bcf023528e HTTP/1.1" 200 None 2026-03-14 13:50:48,137 - lava_callback - DEBUG - Processing node 69b2c4a84bce73bcf023528e: baseline-arm64-baylibre 2026-03-14 13:50:48,138 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b2c4a84bce73bcf023528e 2026-03-14 13:50:48,138 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 13:50:48,153 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b2c4a84bce73bcf023528e HTTP/1.1" 200 None 2026-03-14 13:50:48,155 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 13:50:48,168 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69af6340275c8d3b79399dc3 HTTP/1.1" 200 None 2026-03-14 13:50:48,169 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 13:50:48,214 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b2c4a84bce73bcf023528e HTTP/1.1" 200 None 2026-03-14 13:50:48,222 - lava_callback - ERROR - Error processing callback for node 69b2c4a84bce73bcf023528e: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:51764 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50272 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49538 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:49546 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38668 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50082 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40624 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40626 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58212 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39056 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36426 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:36436 - "GET / HTTP/1.0" 200 OK 2026-03-14 13:52:19,978 - lava_callback - INFO - Received callback for node 69b2c4fe4bce73bcf02352a3 INFO: 172.21.0.1:52772 - "POST /node/69b2c4fe4bce73bcf02352a3 HTTP/1.0" 202 Accepted 2026-03-14 13:52:19,984 - lava_callback - INFO - Starting async job submit for node 69b2c4fe4bce73bcf02352a3 2026-03-14 13:52:19,985 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 13:52:19,999 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b2c4fe4bce73bcf02352a3 HTTP/1.1" 200 None 2026-03-14 13:52:20,000 - lava_callback - DEBUG - Processing node 69b2c4fe4bce73bcf02352a3: baseline-arm64-clabbe 2026-03-14 13:52:20,000 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b2c4fe4bce73bcf02352a3 2026-03-14 13:52:20,001 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 13:52:20,015 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b2c4fe4bce73bcf02352a3 HTTP/1.1" 200 None 2026-03-14 13:52:20,017 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 13:52:20,038 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69af6340275c8d3b79399dc3 HTTP/1.1" 200 None 2026-03-14 13:52:20,040 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 13:52:20,061 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b2c4fe4bce73bcf02352a3 HTTP/1.1" 200 None 2026-03-14 13:52:20,063 - lava_callback - ERROR - Error processing callback for node 69b2c4fe4bce73bcf02352a3: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:52788 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42510 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44460 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44476 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44658 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34486 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54100 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:54106 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56356 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59014 - "GET / HTTP/1.0" 200 OK 2026-03-14 13:53:39,880 - lava_callback - INFO - Received callback for node 69b2c54f4bce73bcf02352b0 INFO: 172.21.0.1:35576 - "POST /node/69b2c54f4bce73bcf02352b0 HTTP/1.0" 202 Accepted 2026-03-14 13:53:39,886 - lava_callback - INFO - Starting async job submit for node 69b2c54f4bce73bcf02352b0 2026-03-14 13:53:39,887 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 13:53:39,901 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b2c54f4bce73bcf02352b0 HTTP/1.1" 200 None 2026-03-14 13:53:39,902 - lava_callback - DEBUG - Processing node 69b2c54f4bce73bcf02352b0: baseline-arm64-clabbe 2026-03-14 13:53:39,902 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b2c54f4bce73bcf02352b0 2026-03-14 13:53:39,903 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 13:53:39,916 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b2c54f4bce73bcf02352b0 HTTP/1.1" 200 None 2026-03-14 13:53:39,917 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 13:53:39,942 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69af6340275c8d3b79399dc3 HTTP/1.1" 200 None 2026-03-14 13:53:39,944 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 13:53:39,965 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b2c54f4bce73bcf02352b0 HTTP/1.1" 200 None 2026-03-14 13:53:39,966 - lava_callback - ERROR - Error processing callback for node 69b2c54f4bce73bcf02352b0: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:35580 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35592 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39948 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55808 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45664 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:45678 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42410 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58658 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44484 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44492 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51886 - "GET / HTTP/1.0" 200 OK 2026-03-14 13:55:00,086 - lava_callback - INFO - Received callback for node 69b2c5a14bce73bcf02352b9 INFO: 172.21.0.1:56612 - "POST /node/69b2c5a14bce73bcf02352b9 HTTP/1.0" 202 Accepted 2026-03-14 13:55:00,091 - lava_callback - INFO - Starting async job submit for node 69b2c5a14bce73bcf02352b9 2026-03-14 13:55:00,092 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 13:55:00,107 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b2c5a14bce73bcf02352b9 HTTP/1.1" 200 None 2026-03-14 13:55:00,108 - lava_callback - DEBUG - Processing node 69b2c5a14bce73bcf02352b9: baseline-arm64-clabbe 2026-03-14 13:55:00,108 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b2c5a14bce73bcf02352b9 2026-03-14 13:55:00,109 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 13:55:00,145 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b2c5a14bce73bcf02352b9 HTTP/1.1" 200 None 2026-03-14 13:55:00,146 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 13:55:00,159 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69af6340275c8d3b79399dc3 HTTP/1.1" 200 None 2026-03-14 13:55:00,161 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 13:55:00,188 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b2c5a14bce73bcf02352b9 HTTP/1.1" 200 None 2026-03-14 13:55:00,190 - lava_callback - ERROR - Error processing callback for node 69b2c5a14bce73bcf02352b9: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:56626 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58598 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:58612 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37936 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36322 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42476 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42492 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43522 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33618 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33822 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:33838 - "GET / HTTP/1.0" 200 OK 2026-03-14 13:56:20,158 - lava_callback - INFO - Received callback for node 69b2c5f24bce73bcf02352c3 INFO: 172.21.0.1:35146 - "POST /node/69b2c5f24bce73bcf02352c3 HTTP/1.0" 202 Accepted 2026-03-14 13:56:20,164 - lava_callback - INFO - Starting async job submit for node 69b2c5f24bce73bcf02352c3 2026-03-14 13:56:20,164 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 13:56:20,179 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b2c5f24bce73bcf02352c3 HTTP/1.1" 200 None 2026-03-14 13:56:20,180 - lava_callback - DEBUG - Processing node 69b2c5f24bce73bcf02352c3: baseline-arm64-clabbe 2026-03-14 13:56:20,180 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b2c5f24bce73bcf02352c3 2026-03-14 13:56:20,180 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 13:56:20,193 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b2c5f24bce73bcf02352c3 HTTP/1.1" 200 None 2026-03-14 13:56:20,195 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 13:56:20,208 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69af6340275c8d3b79399dc3 HTTP/1.1" 200 None 2026-03-14 13:56:20,210 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 13:56:20,230 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b2c5f24bce73bcf02352c3 HTTP/1.1" 200 None 2026-03-14 13:56:20,238 - lava_callback - ERROR - Error processing callback for node 69b2c5f24bce73bcf02352c3: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:35162 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34694 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51974 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51988 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38274 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57378 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57038 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:57046 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49184 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35106 - "GET / HTTP/1.0" 200 OK 2026-03-14 13:57:40,197 - lava_callback - INFO - Received callback for node 69b2c6434bce73bcf02352cf INFO: 172.21.0.1:46266 - "POST /node/69b2c6434bce73bcf02352cf HTTP/1.0" 202 Accepted 2026-03-14 13:57:40,202 - lava_callback - INFO - Starting async job submit for node 69b2c6434bce73bcf02352cf 2026-03-14 13:57:40,203 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 13:57:40,239 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b2c6434bce73bcf02352cf HTTP/1.1" 200 None 2026-03-14 13:57:40,240 - lava_callback - DEBUG - Processing node 69b2c6434bce73bcf02352cf: baseline-arm64-clabbe 2026-03-14 13:57:40,240 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b2c6434bce73bcf02352cf 2026-03-14 13:57:40,241 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 13:57:40,254 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b2c6434bce73bcf02352cf HTTP/1.1" 200 None 2026-03-14 13:57:40,255 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 13:57:40,277 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69af6340275c8d3b79399dc3 HTTP/1.1" 200 None 2026-03-14 13:57:40,279 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 13:57:40,305 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b2c6434bce73bcf02352cf HTTP/1.1" 200 None 2026-03-14 13:57:40,307 - lava_callback - ERROR - Error processing callback for node 69b2c6434bce73bcf02352cf: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:46276 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46292 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56182 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44800 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52436 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:52438 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59480 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49150 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37278 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37292 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50636 - "GET / HTTP/1.0" 200 OK 2026-03-14 13:59:00,247 - lava_callback - INFO - Received callback for node 69b2c6934bce73bcf02352e0 INFO: 172.21.0.1:56858 - "POST /node/69b2c6934bce73bcf02352e0 HTTP/1.0" 202 Accepted 2026-03-14 13:59:00,253 - lava_callback - INFO - Starting async job submit for node 69b2c6934bce73bcf02352e0 2026-03-14 13:59:00,253 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 13:59:00,275 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b2c6934bce73bcf02352e0 HTTP/1.1" 200 None 2026-03-14 13:59:00,276 - lava_callback - DEBUG - Processing node 69b2c6934bce73bcf02352e0: baseline-arm64-clabbe 2026-03-14 13:59:00,276 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b2c6934bce73bcf02352e0 2026-03-14 13:59:00,276 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 13:59:00,311 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b2c6934bce73bcf02352e0 HTTP/1.1" 200 None 2026-03-14 13:59:00,312 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 13:59:00,325 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69af6340275c8d3b79399dc3 HTTP/1.1" 200 None 2026-03-14 13:59:00,327 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 13:59:00,347 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b2c6934bce73bcf02352e0 HTTP/1.1" 200 None 2026-03-14 13:59:00,348 - lava_callback - ERROR - Error processing callback for node 69b2c6934bce73bcf02352e0: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:56866 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44892 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:44908 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33724 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54686 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60740 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60746 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43288 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58794 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38386 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:38394 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52180 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42790 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44488 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44500 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36998 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52450 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46918 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:46926 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50192 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43120 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40832 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40836 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50998 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39260 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52174 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:52176 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36200 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60222 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38724 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38734 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47890 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47000 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34488 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:34498 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50552 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56914 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55192 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55194 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42150 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60142 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47636 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:47652 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38590 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53464 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44908 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44914 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59906 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53976 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54562 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:54564 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42916 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40188 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57746 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57756 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51484 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57250 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38734 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:38742 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56692 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48080 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47816 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47826 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53400 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57166 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51602 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:51612 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36578 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53178 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48014 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48024 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60086 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43102 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59930 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:59938 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38356 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38126 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60196 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60200 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48836 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57712 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54090 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:54102 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46376 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59200 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44518 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44520 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38974 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57290 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36284 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:36290 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40882 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44468 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54854 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54856 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42368 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52374 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34254 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:34268 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40056 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53420 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:32944 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:32960 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42234 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38394 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52830 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:52846 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41368 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49898 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35634 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35644 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54520 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40946 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38424 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:38430 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53854 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38626 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48708 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48716 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48820 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41582 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34116 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:34124 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57876 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60368 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36858 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36868 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38146 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35596 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41892 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:41906 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59286 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54222 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58400 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58414 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54088 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57620 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38576 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:38592 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33238 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45928 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56974 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56982 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41810 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51226 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49944 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:49956 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43444 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34538 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35772 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35784 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57782 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49230 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34794 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:34806 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59144 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39008 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53206 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53208 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59806 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41980 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50650 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:50652 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42646 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35484 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33504 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33508 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41364 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39856 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35604 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:35606 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57332 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:32878 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38714 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38726 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58652 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41738 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41446 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:41458 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34286 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56590 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35896 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35904 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35616 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46280 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60902 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:60914 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46528 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52756 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56894 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56896 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45352 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47570 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43926 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:43936 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51694 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:32932 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38068 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38072 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36290 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59428 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55922 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:55936 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50654 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36226 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33148 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33154 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38126 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41766 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59140 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:59142 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40578 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46966 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59790 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59792 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50598 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37062 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38418 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:38420 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47952 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33294 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58444 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58448 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47528 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54564 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35216 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:35220 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38252 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47722 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43502 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43504 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59638 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42532 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55028 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:55042 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37010 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39268 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44332 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44336 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54860 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38570 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60204 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:60218 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43826 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60928 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53190 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53204 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42476 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41018 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42696 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:42710 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55966 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37714 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52030 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52046 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41032 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43056 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43408 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:43410 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42672 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37034 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49498 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49508 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41684 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34274 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59546 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:59556 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51812 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56858 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42082 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42088 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46930 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33770 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56532 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:56542 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55646 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49328 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52494 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52498 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54692 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59588 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44564 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:44578 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33052 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54816 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34256 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34266 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54856 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40418 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42664 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:42672 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55740 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53166 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45184 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45190 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46920 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45206 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53844 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:53860 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57308 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57160 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41460 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41468 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51704 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42284 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38246 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:38262 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42886 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36526 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53030 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53046 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42524 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36370 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37866 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:37868 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42340 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47068 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33670 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33686 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47970 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48642 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45616 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:45618 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41186 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52302 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41430 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41436 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37228 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34524 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34872 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:34886 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35014 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39320 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58026 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58034 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49466 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60598 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54528 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:54538 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59048 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38666 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45888 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45892 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53828 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38260 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51722 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:51736 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40048 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54598 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35400 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35414 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51630 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58214 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47398 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:47412 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60462 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42462 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39642 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39648 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57356 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47244 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59110 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:59122 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43800 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51720 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49600 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49604 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37476 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60840 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:32846 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:32850 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39902 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51046 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47204 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47220 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59718 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39024 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:32870 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:32878 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43204 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33392 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47208 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47224 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44988 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49300 - "GET / HTTP/1.0" 200 OK 2026-03-14 14:47:11,336 - lava_callback - INFO - Received callback for node 69b2d1e74bce73bcf023538d INFO: 172.21.0.1:44000 - "POST /node/69b2d1e74bce73bcf023538d HTTP/1.0" 202 Accepted 2026-03-14 14:47:11,342 - lava_callback - INFO - Starting async job submit for node 69b2d1e74bce73bcf023538d 2026-03-14 14:47:11,343 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 14:47:11,357 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b2d1e74bce73bcf023538d HTTP/1.1" 200 None 2026-03-14 14:47:11,358 - lava_callback - DEBUG - Processing node 69b2d1e74bce73bcf023538d: baseline-arm-baylibre 2026-03-14 14:47:11,359 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b2d1e74bce73bcf023538d 2026-03-14 14:47:11,359 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 14:47:11,380 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b2d1e74bce73bcf023538d HTTP/1.1" 200 None 2026-03-14 14:47:11,381 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 14:47:11,395 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b276654bce73bcf0233d14 HTTP/1.1" 200 None 2026-03-14 14:47:11,396 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 14:47:11,422 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b2d1e74bce73bcf023538d HTTP/1.1" 200 None 2026-03-14 14:47:11,423 - lava_callback - ERROR - Error processing callback for node 69b2d1e74bce73bcf023538d: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:44012 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:44014 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33130 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43414 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40492 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40496 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59698 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45448 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42462 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:42474 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56922 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48128 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50690 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50700 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44906 - "GET / HTTP/1.0" 200 OK 2026-03-14 14:49:02,450 - lava_callback - INFO - Received callback for node 69b2d25b4bce73bcf02353ad INFO: 172.21.0.1:53456 - "POST /node/69b2d25b4bce73bcf02353ad HTTP/1.0" 202 Accepted 2026-03-14 14:49:02,456 - lava_callback - INFO - Starting async job submit for node 69b2d25b4bce73bcf02353ad 2026-03-14 14:49:02,457 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 14:49:02,496 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b2d25b4bce73bcf02353ad HTTP/1.1" 200 None 2026-03-14 14:49:02,497 - lava_callback - DEBUG - Processing node 69b2d25b4bce73bcf02353ad: baseline-arm-clabbe 2026-03-14 14:49:02,497 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b2d25b4bce73bcf02353ad 2026-03-14 14:49:02,498 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 14:49:02,512 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b2d25b4bce73bcf02353ad HTTP/1.1" 200 None 2026-03-14 14:49:02,513 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 14:49:02,526 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b276654bce73bcf0233d14 HTTP/1.1" 200 None 2026-03-14 14:49:02,528 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 14:49:02,551 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b2d25b4bce73bcf02353ad HTTP/1.1" 200 None 2026-03-14 14:49:02,558 - lava_callback - ERROR - Error processing callback for node 69b2d25b4bce73bcf02353ad: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:53460 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48280 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:48296 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48398 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56744 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41562 - "GET / HTTP/1.0" 200 OK 2026-03-14 14:49:42,430 - lava_callback - INFO - Received callback for node 69b2d2824bce73bcf02353ba INFO: 172.21.0.1:41572 - "POST /node/69b2d2824bce73bcf02353ba HTTP/1.0" 202 Accepted 2026-03-14 14:49:42,435 - lava_callback - INFO - Starting async job submit for node 69b2d2824bce73bcf02353ba 2026-03-14 14:49:42,436 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 14:49:42,450 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b2d2824bce73bcf02353ba HTTP/1.1" 200 None 2026-03-14 14:49:42,452 - lava_callback - DEBUG - Processing node 69b2d2824bce73bcf02353ba: baseline-arm-clabbe 2026-03-14 14:49:42,452 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b2d2824bce73bcf02353ba 2026-03-14 14:49:42,452 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 14:49:42,466 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b2d2824bce73bcf02353ba HTTP/1.1" 200 None 2026-03-14 14:49:42,468 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 14:49:42,482 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b276654bce73bcf0233d14 HTTP/1.1" 200 None 2026-03-14 14:49:42,484 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 14:49:42,512 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b2d2824bce73bcf02353ba HTTP/1.1" 200 None 2026-03-14 14:49:42,514 - lava_callback - ERROR - Error processing callback for node 69b2d2824bce73bcf02353ba: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:41582 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33482 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51660 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52294 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:52296 - "GET / HTTP/1.0" 200 OK 2026-03-14 14:50:22,469 - lava_callback - INFO - Received callback for node 69b2d2ab4bce73bcf02353c7 INFO: 172.21.0.1:56370 - "POST /node/69b2d2ab4bce73bcf02353c7 HTTP/1.0" 202 Accepted 2026-03-14 14:50:22,474 - lava_callback - INFO - Starting async job submit for node 69b2d2ab4bce73bcf02353c7 2026-03-14 14:50:22,475 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 14:50:22,507 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b2d2ab4bce73bcf02353c7 HTTP/1.1" 200 None 2026-03-14 14:50:22,508 - lava_callback - DEBUG - Processing node 69b2d2ab4bce73bcf02353c7: baseline-arm-clabbe 2026-03-14 14:50:22,508 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b2d2ab4bce73bcf02353c7 2026-03-14 14:50:22,509 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 14:50:22,522 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b2d2ab4bce73bcf02353c7 HTTP/1.1" 200 None 2026-03-14 14:50:22,523 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 14:50:22,537 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b276654bce73bcf0233d14 HTTP/1.1" 200 None 2026-03-14 14:50:22,538 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 14:50:22,560 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b2d2ab4bce73bcf02353c7 HTTP/1.1" 200 None 2026-03-14 14:50:22,570 - lava_callback - ERROR - Error processing callback for node 69b2d2ab4bce73bcf02353c7: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:56380 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34538 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49168 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49172 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55392 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36116 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51958 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:51974 - "GET / HTTP/1.0" 200 OK 2026-03-14 14:51:22,511 - lava_callback - INFO - Received callback for node 69b2d2d34bce73bcf02353d0 INFO: 172.21.0.1:53646 - "POST /node/69b2d2d34bce73bcf02353d0 HTTP/1.0" 202 Accepted 2026-03-14 14:51:22,517 - lava_callback - INFO - Starting async job submit for node 69b2d2d34bce73bcf02353d0 2026-03-14 14:51:22,517 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 14:51:22,588 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b2d2d34bce73bcf02353d0 HTTP/1.1" 200 None 2026-03-14 14:51:22,589 - lava_callback - DEBUG - Processing node 69b2d2d34bce73bcf02353d0: baseline-arm-clabbe 2026-03-14 14:51:22,589 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b2d2d34bce73bcf02353d0 2026-03-14 14:51:22,590 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 14:51:22,613 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b2d2d34bce73bcf02353d0 HTTP/1.1" 200 None 2026-03-14 14:51:22,614 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 14:51:22,628 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b276654bce73bcf0233d14 HTTP/1.1" 200 None 2026-03-14 14:51:22,629 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 14:51:22,651 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b2d2d34bce73bcf02353d0 HTTP/1.1" 200 None 2026-03-14 14:51:22,657 - lava_callback - ERROR - Error processing callback for node 69b2d2d34bce73bcf02353d0: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:53654 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55574 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57342 - "GET / HTTP/1.0" 200 OK 2026-03-14 14:51:42,541 - lava_callback - INFO - Received callback for node 69b2d2fb4bce73bcf02353de INFO: 172.21.0.1:57346 - "POST /node/69b2d2fb4bce73bcf02353de HTTP/1.0" 202 Accepted 2026-03-14 14:51:42,546 - lava_callback - INFO - Starting async job submit for node 69b2d2fb4bce73bcf02353de 2026-03-14 14:51:42,547 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 14:51:42,561 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b2d2fb4bce73bcf02353de HTTP/1.1" 200 None 2026-03-14 14:51:42,562 - lava_callback - DEBUG - Processing node 69b2d2fb4bce73bcf02353de: baseline-arm-clabbe 2026-03-14 14:51:42,562 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b2d2fb4bce73bcf02353de 2026-03-14 14:51:42,563 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 14:51:42,576 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b2d2fb4bce73bcf02353de HTTP/1.1" 200 None 2026-03-14 14:51:42,578 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 14:51:42,592 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b276654bce73bcf0233d14 HTTP/1.1" 200 None 2026-03-14 14:51:42,594 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 14:51:42,614 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b2d2fb4bce73bcf02353de HTTP/1.1" 200 None 2026-03-14 14:51:42,620 - lava_callback - ERROR - Error processing callback for node 69b2d2fb4bce73bcf02353de: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:57360 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47650 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41046 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48152 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:48160 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43900 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33590 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40428 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40432 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41300 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58020 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49074 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:49082 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47632 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37376 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60298 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60310 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45268 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33182 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43020 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:43026 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37792 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33064 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57152 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57158 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43302 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60302 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56886 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:56890 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47406 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52108 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40976 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40980 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48866 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43930 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35424 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:35430 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46782 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55426 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44424 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44426 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54740 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56924 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49618 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:49632 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38346 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47946 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51768 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51778 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50446 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35362 - "GET / HTTP/1.0" 200 OK 2026-03-14 14:58:11,733 - lava_callback - INFO - Received callback for node 69b2d4714bce73bcf02353f5 INFO: 172.21.0.1:43932 - "POST /node/69b2d4714bce73bcf02353f5 HTTP/1.0" 202 Accepted 2026-03-14 14:58:11,739 - lava_callback - INFO - Starting async job submit for node 69b2d4714bce73bcf02353f5 2026-03-14 14:58:11,739 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 14:58:11,765 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b2d4714bce73bcf02353f5 HTTP/1.1" 200 None 2026-03-14 14:58:11,766 - lava_callback - DEBUG - Processing node 69b2d4714bce73bcf02353f5: baseline-arm64-baylibre 2026-03-14 14:58:11,766 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b2d4714bce73bcf02353f5 2026-03-14 14:58:11,767 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 14:58:11,780 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b2d4714bce73bcf02353f5 HTTP/1.1" 200 None 2026-03-14 14:58:11,781 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 14:58:11,820 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69afd3b0c9209b146d8e1d77 HTTP/1.1" 200 None 2026-03-14 14:58:11,822 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 14:58:11,864 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b2d4714bce73bcf02353f5 HTTP/1.1" 200 None 2026-03-14 14:58:11,869 - lava_callback - ERROR - Error processing callback for node 69b2d4714bce73bcf02353f5: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:43944 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:43950 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53892 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60274 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40084 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40100 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39186 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52324 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57956 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:57960 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37398 - "GET / HTTP/1.0" 200 OK 2026-03-14 14:59:31,804 - lava_callback - INFO - Received callback for node 69b2d4c24bce73bcf0235405 INFO: 172.21.0.1:55478 - "POST /node/69b2d4c24bce73bcf0235405 HTTP/1.0" 202 Accepted 2026-03-14 14:59:31,810 - lava_callback - INFO - Starting async job submit for node 69b2d4c24bce73bcf0235405 2026-03-14 14:59:31,811 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 14:59:31,830 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b2d4c24bce73bcf0235405 HTTP/1.1" 200 None 2026-03-14 14:59:31,831 - lava_callback - DEBUG - Processing node 69b2d4c24bce73bcf0235405: baseline-arm64-baylibre 2026-03-14 14:59:31,831 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b2d4c24bce73bcf0235405 2026-03-14 14:59:31,832 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 14:59:31,846 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b2d4c24bce73bcf0235405 HTTP/1.1" 200 None 2026-03-14 14:59:31,847 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 14:59:31,862 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69afd3b0c9209b146d8e1d77 HTTP/1.1" 200 None 2026-03-14 14:59:31,863 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 14:59:31,886 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b2d4c24bce73bcf0235405 HTTP/1.1" 200 None 2026-03-14 14:59:31,891 - lava_callback - ERROR - Error processing callback for node 69b2d4c24bce73bcf0235405: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:55490 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53168 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53182 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53558 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38330 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45640 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:45642 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54274 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:32932 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49580 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49584 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44916 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58468 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46304 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:46312 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45970 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60520 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43016 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43024 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51256 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40574 - "GET / HTTP/1.0" 200 OK 2026-03-14 15:02:11,968 - lava_callback - INFO - Received callback for node 69b2d5614bce73bcf0235421 INFO: 172.21.0.1:38750 - "POST /node/69b2d5614bce73bcf0235421 HTTP/1.0" 202 Accepted 2026-03-14 15:02:11,974 - lava_callback - INFO - Starting async job submit for node 69b2d5614bce73bcf0235421 2026-03-14 15:02:11,975 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 15:02:11,989 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b2d5614bce73bcf0235421 HTTP/1.1" 200 None 2026-03-14 15:02:11,990 - lava_callback - DEBUG - Processing node 69b2d5614bce73bcf0235421: baseline-arm64-baylibre 2026-03-14 15:02:11,990 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b2d5614bce73bcf0235421 2026-03-14 15:02:11,991 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 15:02:12,005 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b2d5614bce73bcf0235421 HTTP/1.1" 200 None 2026-03-14 15:02:12,006 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 15:02:12,029 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69afd3b0c9209b146d8e1d77 HTTP/1.1" 200 None 2026-03-14 15:02:12,031 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 15:02:12,071 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b2d5614bce73bcf0235421 HTTP/1.1" 200 None 2026-03-14 15:02:12,073 - lava_callback - ERROR - Error processing callback for node 69b2d5614bce73bcf0235421: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:38760 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:38764 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51362 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52788 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33922 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33926 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46504 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53960 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49070 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:49082 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45348 - "GET / HTTP/1.0" 200 OK 2026-03-14 15:03:32,032 - lava_callback - INFO - Received callback for node 69b2d5b04bce73bcf023542c INFO: 172.21.0.1:51896 - "POST /node/69b2d5b04bce73bcf023542c HTTP/1.0" 202 Accepted 2026-03-14 15:03:32,038 - lava_callback - INFO - Starting async job submit for node 69b2d5b04bce73bcf023542c 2026-03-14 15:03:32,039 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 15:03:32,063 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b2d5b04bce73bcf023542c HTTP/1.1" 200 None 2026-03-14 15:03:32,064 - lava_callback - DEBUG - Processing node 69b2d5b04bce73bcf023542c: baseline-arm64-baylibre 2026-03-14 15:03:32,064 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b2d5b04bce73bcf023542c 2026-03-14 15:03:32,065 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 15:03:32,097 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b2d5b04bce73bcf023542c HTTP/1.1" 200 None 2026-03-14 15:03:32,099 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 15:03:32,114 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69afd3b0c9209b146d8e1d77 HTTP/1.1" 200 None 2026-03-14 15:03:32,116 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 15:03:32,137 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b2d5b04bce73bcf023542c HTTP/1.1" 200 None 2026-03-14 15:03:32,148 - lava_callback - ERROR - Error processing callback for node 69b2d5b04bce73bcf023542c: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:51910 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49258 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49262 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41844 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51382 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44918 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:44920 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49796 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44418 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43712 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43716 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59234 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34028 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37344 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:37348 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60016 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57604 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48952 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48958 - "GET / HTTP/1.0" 200 OK 2026-03-14 15:05:52,197 - lava_callback - INFO - Received callback for node 69b2d64b4bce73bcf0235446 INFO: 172.21.0.1:59394 - "POST /node/69b2d64b4bce73bcf0235446 HTTP/1.0" 202 Accepted 2026-03-14 15:05:52,203 - lava_callback - INFO - Starting async job submit for node 69b2d64b4bce73bcf0235446 2026-03-14 15:05:52,204 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 15:05:52,219 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b2d64b4bce73bcf0235446 HTTP/1.1" 200 None 2026-03-14 15:05:52,220 - lava_callback - DEBUG - Processing node 69b2d64b4bce73bcf0235446: baseline-arm64-baylibre 2026-03-14 15:05:52,220 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b2d64b4bce73bcf0235446 2026-03-14 15:05:52,220 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 15:05:52,233 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b2d64b4bce73bcf0235446 HTTP/1.1" 200 None 2026-03-14 15:05:52,235 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 15:05:52,248 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69afd3b0c9209b146d8e1d77 HTTP/1.1" 200 None 2026-03-14 15:05:52,249 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 15:05:52,270 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b2d64b4bce73bcf0235446 HTTP/1.1" 200 None 2026-03-14 15:05:52,276 - lava_callback - ERROR - Error processing callback for node 69b2d64b4bce73bcf0235446: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:59404 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40882 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37466 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:37476 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52596 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39324 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33204 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33210 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52794 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49616 - "GET / HTTP/1.0" 200 OK 2026-03-14 15:07:12,268 - lava_callback - INFO - Received callback for node 69b2d6984bce73bcf0235451 INFO: 172.21.0.1:38100 - "POST /node/69b2d6984bce73bcf0235451 HTTP/1.0" 202 Accepted 2026-03-14 15:07:12,275 - lava_callback - INFO - Starting async job submit for node 69b2d6984bce73bcf0235451 2026-03-14 15:07:12,276 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 15:07:12,292 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b2d6984bce73bcf0235451 HTTP/1.1" 200 None 2026-03-14 15:07:12,293 - lava_callback - DEBUG - Processing node 69b2d6984bce73bcf0235451: baseline-arm64-baylibre 2026-03-14 15:07:12,293 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b2d6984bce73bcf0235451 2026-03-14 15:07:12,293 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 15:07:12,308 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b2d6984bce73bcf0235451 HTTP/1.1" 200 None 2026-03-14 15:07:12,310 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 15:07:12,329 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69afd3b0c9209b146d8e1d77 HTTP/1.1" 200 None 2026-03-14 15:07:12,331 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 15:07:12,352 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b2d6984bce73bcf0235451 HTTP/1.1" 200 None 2026-03-14 15:07:12,357 - lava_callback - ERROR - Error processing callback for node 69b2d6984bce73bcf0235451: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:38108 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:38110 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60512 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49202 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44560 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44568 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49176 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57662 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36628 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:36638 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53298 - "GET / HTTP/1.0" 200 OK 2026-03-14 15:08:32,558 - lava_callback - INFO - Received callback for node 69b2d6e34bce73bcf0235462 INFO: 172.21.0.1:32952 - "POST /node/69b2d6e34bce73bcf0235462 HTTP/1.0" 202 Accepted 2026-03-14 15:08:32,564 - lava_callback - INFO - Starting async job submit for node 69b2d6e34bce73bcf0235462 2026-03-14 15:08:32,564 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 15:08:32,578 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b2d6e34bce73bcf0235462 HTTP/1.1" 200 None 2026-03-14 15:08:32,579 - lava_callback - DEBUG - Processing node 69b2d6e34bce73bcf0235462: baseline-arm64-baylibre 2026-03-14 15:08:32,579 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b2d6e34bce73bcf0235462 2026-03-14 15:08:32,580 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 15:08:32,621 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b2d6e34bce73bcf0235462 HTTP/1.1" 200 None 2026-03-14 15:08:32,623 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 15:08:32,636 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69afd3b0c9209b146d8e1d77 HTTP/1.1" 200 None 2026-03-14 15:08:32,637 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 15:08:32,664 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b2d6e34bce73bcf0235462 HTTP/1.1" 200 None 2026-03-14 15:08:32,666 - lava_callback - ERROR - Error processing callback for node 69b2d6e34bce73bcf0235462: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:32964 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35478 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35484 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37444 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48558 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52280 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:52290 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46528 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33236 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36440 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36442 - "GET / HTTP/1.0" 200 OK 2026-03-14 15:09:52,560 - lava_callback - INFO - Received callback for node 69b2d72f4bce73bcf023546e INFO: 172.21.0.1:34946 - "POST /node/69b2d72f4bce73bcf023546e HTTP/1.0" 202 Accepted 2026-03-14 15:09:52,565 - lava_callback - INFO - Starting async job submit for node 69b2d72f4bce73bcf023546e 2026-03-14 15:09:52,566 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 15:09:52,582 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b2d72f4bce73bcf023546e HTTP/1.1" 200 None 2026-03-14 15:09:52,583 - lava_callback - DEBUG - Processing node 69b2d72f4bce73bcf023546e: baseline-arm64-baylibre 2026-03-14 15:09:52,583 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b2d72f4bce73bcf023546e 2026-03-14 15:09:52,584 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 15:09:52,603 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b2d72f4bce73bcf023546e HTTP/1.1" 200 None 2026-03-14 15:09:52,604 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 15:09:52,618 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69afd3b0c9209b146d8e1d77 HTTP/1.1" 200 None 2026-03-14 15:09:52,619 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 15:09:52,640 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b2d72f4bce73bcf023546e HTTP/1.1" 200 None 2026-03-14 15:09:52,641 - lava_callback - ERROR - Error processing callback for node 69b2d72f4bce73bcf023546e: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:34956 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52440 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52264 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:52274 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52922 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50032 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41186 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41196 - "GET / HTTP/1.0" 200 OK 2026-03-14 15:10:52,358 - lava_callback - INFO - Received callback for node 69b2d77a4bce73bcf0235480 INFO: 172.21.0.1:50128 - "POST /node/69b2d77a4bce73bcf0235480 HTTP/1.0" 202 Accepted 2026-03-14 15:10:52,364 - lava_callback - INFO - Starting async job submit for node 69b2d77a4bce73bcf0235480 2026-03-14 15:10:52,365 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 15:10:52,379 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b2d77a4bce73bcf0235480 HTTP/1.1" 200 None 2026-03-14 15:10:52,380 - lava_callback - DEBUG - Processing node 69b2d77a4bce73bcf0235480: baseline-arm64-baylibre 2026-03-14 15:10:52,380 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b2d77a4bce73bcf0235480 2026-03-14 15:10:52,380 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 15:10:52,394 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b2d77a4bce73bcf0235480 HTTP/1.1" 200 None 2026-03-14 15:10:52,395 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 15:10:52,412 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69afd3b0c9209b146d8e1d77 HTTP/1.1" 200 None 2026-03-14 15:10:52,414 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 15:10:52,435 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b2d77a4bce73bcf0235480 HTTP/1.1" 200 None 2026-03-14 15:10:52,436 - lava_callback - ERROR - Error processing callback for node 69b2d77a4bce73bcf0235480: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:50136 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37144 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39066 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:39068 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54836 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60838 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55472 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55484 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44736 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48914 - "GET / HTTP/1.0" 200 OK 2026-03-14 15:12:12,512 - lava_callback - INFO - Received callback for node 69b2d7c54bce73bcf023548d INFO: 172.21.0.1:57350 - "POST /node/69b2d7c54bce73bcf023548d HTTP/1.0" 202 Accepted 2026-03-14 15:12:12,517 - lava_callback - INFO - Starting async job submit for node 69b2d7c54bce73bcf023548d 2026-03-14 15:12:12,518 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 15:12:12,532 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b2d7c54bce73bcf023548d HTTP/1.1" 200 None 2026-03-14 15:12:12,533 - lava_callback - DEBUG - Processing node 69b2d7c54bce73bcf023548d: baseline-arm64-baylibre 2026-03-14 15:12:12,534 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b2d7c54bce73bcf023548d 2026-03-14 15:12:12,534 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 15:12:12,553 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b2d7c54bce73bcf023548d HTTP/1.1" 200 None 2026-03-14 15:12:12,554 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 15:12:12,568 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69afd3b0c9209b146d8e1d77 HTTP/1.1" 200 None 2026-03-14 15:12:12,570 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 15:12:12,590 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b2d7c54bce73bcf023548d HTTP/1.1" 200 None 2026-03-14 15:12:12,601 - lava_callback - ERROR - Error processing callback for node 69b2d7c54bce73bcf023548d: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:57354 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:57356 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41102 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38860 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55784 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55786 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52976 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39286 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37290 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:37294 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40434 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49350 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40190 - "GET / HTTP/1.0" 200 OK 2026-03-14 15:13:43,597 - lava_callback - INFO - Received callback for node 69b2d8164bce73bcf023549e INFO: 172.21.0.1:40200 - "POST /node/69b2d8164bce73bcf023549e HTTP/1.0" 202 Accepted 2026-03-14 15:13:43,602 - lava_callback - INFO - Starting async job submit for node 69b2d8164bce73bcf023549e 2026-03-14 15:13:43,603 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 15:13:43,622 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b2d8164bce73bcf023549e HTTP/1.1" 200 None 2026-03-14 15:13:43,622 - lava_callback - DEBUG - Processing node 69b2d8164bce73bcf023549e: baseline-arm64-clabbe 2026-03-14 15:13:43,623 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b2d8164bce73bcf023549e 2026-03-14 15:13:43,623 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 15:13:43,648 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b2d8164bce73bcf023549e HTTP/1.1" 200 None 2026-03-14 15:13:43,649 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 15:13:43,662 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69afd3b0c9209b146d8e1d77 HTTP/1.1" 200 None 2026-03-14 15:13:43,664 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 15:13:43,685 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b2d8164bce73bcf023549e HTTP/1.1" 200 None 2026-03-14 15:13:43,686 - lava_callback - ERROR - Error processing callback for node 69b2d8164bce73bcf023549e: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:40202 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:32986 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58578 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53670 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:53682 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59260 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45446 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50840 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50850 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44022 - "GET / HTTP/1.0" 200 OK 2026-03-14 15:15:03,717 - lava_callback - INFO - Received callback for node 69b2d8614bce73bcf02354b3 INFO: 172.21.0.1:40498 - "POST /node/69b2d8614bce73bcf02354b3 HTTP/1.0" 202 Accepted 2026-03-14 15:15:03,722 - lava_callback - INFO - Starting async job submit for node 69b2d8614bce73bcf02354b3 2026-03-14 15:15:03,723 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 15:15:03,743 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b2d8614bce73bcf02354b3 HTTP/1.1" 200 None 2026-03-14 15:15:03,744 - lava_callback - DEBUG - Processing node 69b2d8614bce73bcf02354b3: baseline-arm64-clabbe 2026-03-14 15:15:03,744 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b2d8614bce73bcf02354b3 2026-03-14 15:15:03,745 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 15:15:03,762 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b2d8614bce73bcf02354b3 HTTP/1.1" 200 None 2026-03-14 15:15:03,763 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 15:15:03,777 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69afd3b0c9209b146d8e1d77 HTTP/1.1" 200 None 2026-03-14 15:15:03,778 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 15:15:03,805 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b2d8614bce73bcf02354b3 HTTP/1.1" 200 None 2026-03-14 15:15:03,813 - lava_callback - ERROR - Error processing callback for node 69b2d8614bce73bcf02354b3: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:40508 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58418 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:58432 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51198 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53588 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58770 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58778 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33038 - "GET / HTTP/1.0" 200 OK 2026-03-14 15:16:03,692 - lava_callback - INFO - Received callback for node 69b2d8ad4bce73bcf02354df INFO: 172.21.0.1:34614 - "POST /node/69b2d8ad4bce73bcf02354df HTTP/1.0" 202 Accepted 2026-03-14 15:16:03,698 - lava_callback - INFO - Starting async job submit for node 69b2d8ad4bce73bcf02354df 2026-03-14 15:16:03,699 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 15:16:03,713 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b2d8ad4bce73bcf02354df HTTP/1.1" 200 None 2026-03-14 15:16:03,714 - lava_callback - DEBUG - Processing node 69b2d8ad4bce73bcf02354df: baseline-arm64-clabbe 2026-03-14 15:16:03,714 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b2d8ad4bce73bcf02354df 2026-03-14 15:16:03,715 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 15:16:03,728 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b2d8ad4bce73bcf02354df HTTP/1.1" 200 None 2026-03-14 15:16:03,730 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 15:16:03,743 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69afd3b0c9209b146d8e1d77 HTTP/1.1" 200 None 2026-03-14 15:16:03,744 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 15:16:03,765 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b2d8ad4bce73bcf02354df HTTP/1.1" 200 None 2026-03-14 15:16:03,776 - lava_callback - ERROR - Error processing callback for node 69b2d8ad4bce73bcf02354df: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:34620 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60612 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:60624 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46786 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50020 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43664 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43674 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53128 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51038 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52852 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:52864 - "GET / HTTP/1.0" 200 OK 2026-03-14 15:17:23,719 - lava_callback - INFO - Received callback for node 69b2d8f94bce73bcf02354f9 INFO: 172.21.0.1:41560 - "POST /node/69b2d8f94bce73bcf02354f9 HTTP/1.0" 202 Accepted 2026-03-14 15:17:23,725 - lava_callback - INFO - Starting async job submit for node 69b2d8f94bce73bcf02354f9 2026-03-14 15:17:23,726 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 15:17:23,741 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b2d8f94bce73bcf02354f9 HTTP/1.1" 200 None 2026-03-14 15:17:23,743 - lava_callback - DEBUG - Processing node 69b2d8f94bce73bcf02354f9: baseline-arm64-clabbe 2026-03-14 15:17:23,743 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b2d8f94bce73bcf02354f9 2026-03-14 15:17:23,744 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 15:17:23,759 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b2d8f94bce73bcf02354f9 HTTP/1.1" 200 None 2026-03-14 15:17:23,760 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 15:17:23,796 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69afd3b0c9209b146d8e1d77 HTTP/1.1" 200 None 2026-03-14 15:17:23,798 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 15:17:23,822 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b2d8f94bce73bcf02354f9 HTTP/1.1" 200 None 2026-03-14 15:17:23,831 - lava_callback - ERROR - Error processing callback for node 69b2d8f94bce73bcf02354f9: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:41564 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55166 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58774 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58790 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52216 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55740 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37028 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:37044 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51786 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59514 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59528 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52206 - "GET / HTTP/1.0" 200 OK 2026-03-14 15:18:43,788 - lava_callback - INFO - Received callback for node 69b2d9444bce73bcf023550c INFO: 172.21.0.1:52208 - "POST /node/69b2d9444bce73bcf023550c HTTP/1.0" 202 Accepted 2026-03-14 15:18:43,796 - lava_callback - INFO - Starting async job submit for node 69b2d9444bce73bcf023550c 2026-03-14 15:18:43,797 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 15:18:43,814 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b2d9444bce73bcf023550c HTTP/1.1" 200 None 2026-03-14 15:18:43,815 - lava_callback - DEBUG - Processing node 69b2d9444bce73bcf023550c: baseline-arm64-clabbe 2026-03-14 15:18:43,815 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b2d9444bce73bcf023550c 2026-03-14 15:18:43,816 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 15:18:43,831 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b2d9444bce73bcf023550c HTTP/1.1" 200 None 2026-03-14 15:18:43,832 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 15:18:43,847 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69afd3b0c9209b146d8e1d77 HTTP/1.1" 200 None 2026-03-14 15:18:43,849 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 15:18:43,871 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b2d9444bce73bcf023550c HTTP/1.1" 200 None 2026-03-14 15:18:43,880 - lava_callback - ERROR - Error processing callback for node 69b2d9444bce73bcf023550c: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:52218 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41300 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41314 - "GET /favicon.ico HTTP/1.0" 404 Not Found INFO: 172.21.0.1:36202 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51976 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:51980 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55902 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60930 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42072 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42084 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53184 - "GET / HTTP/1.0" 200 OK 2026-03-14 15:20:04,046 - lava_callback - INFO - Received callback for node 69b2d9904bce73bcf023551e INFO: 172.21.0.1:45946 - "POST /node/69b2d9904bce73bcf023551e HTTP/1.0" 202 Accepted 2026-03-14 15:20:04,051 - lava_callback - INFO - Starting async job submit for node 69b2d9904bce73bcf023551e 2026-03-14 15:20:04,052 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 15:20:04,077 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b2d9904bce73bcf023551e HTTP/1.1" 200 None 2026-03-14 15:20:04,078 - lava_callback - DEBUG - Processing node 69b2d9904bce73bcf023551e: baseline-arm64-clabbe 2026-03-14 15:20:04,078 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b2d9904bce73bcf023551e 2026-03-14 15:20:04,079 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 15:20:04,092 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b2d9904bce73bcf023551e HTTP/1.1" 200 None 2026-03-14 15:20:04,093 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 15:20:04,106 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69afd3b0c9209b146d8e1d77 HTTP/1.1" 200 None 2026-03-14 15:20:04,107 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 15:20:04,128 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b2d9904bce73bcf023551e HTTP/1.1" 200 None 2026-03-14 15:20:04,139 - lava_callback - ERROR - Error processing callback for node 69b2d9904bce73bcf023551e: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:45952 - "GET /favicon.ico HTTP/1.0" 404 Not Found INFO: 172.21.0.1:45968 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49734 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:49738 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39870 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33884 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41704 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41718 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40574 - "GET / HTTP/1.0" 200 OK 2026-03-14 15:21:03,918 - lava_callback - INFO - Received callback for node 69b2d9dd4bce73bcf0235534 INFO: 172.21.0.1:55604 - "POST /node/69b2d9dd4bce73bcf0235534 HTTP/1.0" 202 Accepted 2026-03-14 15:21:03,924 - lava_callback - INFO - Starting async job submit for node 69b2d9dd4bce73bcf0235534 2026-03-14 15:21:03,925 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 15:21:03,948 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b2d9dd4bce73bcf0235534 HTTP/1.1" 200 None 2026-03-14 15:21:03,949 - lava_callback - DEBUG - Processing node 69b2d9dd4bce73bcf0235534: baseline-arm64-clabbe 2026-03-14 15:21:03,949 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b2d9dd4bce73bcf0235534 2026-03-14 15:21:03,950 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 15:21:03,970 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b2d9dd4bce73bcf0235534 HTTP/1.1" 200 None 2026-03-14 15:21:03,972 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 15:21:04,004 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69afd3b0c9209b146d8e1d77 HTTP/1.1" 200 None 2026-03-14 15:21:04,006 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 15:21:04,031 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b2d9dd4bce73bcf0235534 HTTP/1.1" 200 None 2026-03-14 15:21:04,033 - lava_callback - ERROR - Error processing callback for node 69b2d9dd4bce73bcf0235534: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:55610 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34834 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:34844 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33728 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41686 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42184 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42188 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47050 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33360 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42396 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:42412 - "GET / HTTP/1.0" 200 OK 2026-03-14 15:22:24,189 - lava_callback - INFO - Received callback for node 69b2da2b4bce73bcf023554c INFO: 172.21.0.1:48250 - "POST /node/69b2da2b4bce73bcf023554c HTTP/1.0" 202 Accepted 2026-03-14 15:22:24,195 - lava_callback - INFO - Starting async job submit for node 69b2da2b4bce73bcf023554c 2026-03-14 15:22:24,196 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 15:22:24,211 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b2da2b4bce73bcf023554c HTTP/1.1" 200 None 2026-03-14 15:22:24,212 - lava_callback - DEBUG - Processing node 69b2da2b4bce73bcf023554c: baseline-arm64-clabbe 2026-03-14 15:22:24,212 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b2da2b4bce73bcf023554c 2026-03-14 15:22:24,212 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 15:22:24,254 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b2da2b4bce73bcf023554c HTTP/1.1" 200 None 2026-03-14 15:22:24,256 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 15:22:24,270 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69afd3b0c9209b146d8e1d77 HTTP/1.1" 200 None 2026-03-14 15:22:24,271 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 15:22:24,292 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b2da2b4bce73bcf023554c HTTP/1.1" 200 None 2026-03-14 15:22:24,297 - lava_callback - ERROR - Error processing callback for node 69b2da2b4bce73bcf023554c: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:48256 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59036 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57738 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57746 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60634 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53490 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40030 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:40044 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59178 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42214 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34794 - "GET / HTTP/1.0" 200 OK 2026-03-14 15:23:44,043 - lava_callback - INFO - Received callback for node 69b2da7b4bce73bcf0235553 INFO: 172.21.0.1:34806 - "POST /node/69b2da7b4bce73bcf0235553 HTTP/1.0" 202 Accepted 2026-03-14 15:23:44,049 - lava_callback - INFO - Starting async job submit for node 69b2da7b4bce73bcf0235553 2026-03-14 15:23:44,050 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 15:23:44,064 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b2da7b4bce73bcf0235553 HTTP/1.1" 200 None 2026-03-14 15:23:44,065 - lava_callback - DEBUG - Processing node 69b2da7b4bce73bcf0235553: baseline-arm64-clabbe 2026-03-14 15:23:44,065 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b2da7b4bce73bcf0235553 2026-03-14 15:23:44,066 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 15:23:44,079 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b2da7b4bce73bcf0235553 HTTP/1.1" 200 None 2026-03-14 15:23:44,081 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 15:23:44,098 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69afd3b0c9209b146d8e1d77 HTTP/1.1" 200 None 2026-03-14 15:23:44,099 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 15:23:44,120 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b2da7b4bce73bcf0235553 HTTP/1.1" 200 None 2026-03-14 15:23:44,122 - lava_callback - ERROR - Error processing callback for node 69b2da7b4bce73bcf0235553: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:34810 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33796 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51244 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41986 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:41994 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36308 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46186 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46188 - "GET /favicon.ico HTTP/1.0" 404 Not Found INFO: 172.21.0.1:46202 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55110 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55122 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53292 - "GET / HTTP/1.0" 200 OK 2026-03-14 15:25:04,379 - lava_callback - INFO - Received callback for node 69b2dacb4bce73bcf023556a INFO: 172.21.0.1:32822 - "POST /node/69b2dacb4bce73bcf023556a HTTP/1.0" 202 Accepted 2026-03-14 15:25:04,385 - lava_callback - INFO - Starting async job submit for node 69b2dacb4bce73bcf023556a 2026-03-14 15:25:04,386 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 15:25:04,400 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b2dacb4bce73bcf023556a HTTP/1.1" 200 None 2026-03-14 15:25:04,401 - lava_callback - DEBUG - Processing node 69b2dacb4bce73bcf023556a: baseline-arm64-clabbe 2026-03-14 15:25:04,401 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b2dacb4bce73bcf023556a 2026-03-14 15:25:04,401 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 15:25:04,414 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b2dacb4bce73bcf023556a HTTP/1.1" 200 None 2026-03-14 15:25:04,416 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 15:25:04,429 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69afd3b0c9209b146d8e1d77 HTTP/1.1" 200 None 2026-03-14 15:25:04,430 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 15:25:04,459 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b2dacb4bce73bcf023556a HTTP/1.1" 200 None 2026-03-14 15:25:04,461 - lava_callback - ERROR - Error processing callback for node 69b2dacb4bce73bcf023556a: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:32836 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51540 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:51544 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49902 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60950 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60584 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60600 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60098 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44580 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49144 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:49148 - "GET / HTTP/1.0" 200 OK 2026-03-14 15:26:24,151 - lava_callback - INFO - Received callback for node 69b2db1b4bce73bcf0235579 INFO: 172.21.0.1:48684 - "POST /node/69b2db1b4bce73bcf0235579 HTTP/1.0" 202 Accepted 2026-03-14 15:26:24,156 - lava_callback - INFO - Starting async job submit for node 69b2db1b4bce73bcf0235579 2026-03-14 15:26:24,157 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 15:26:24,171 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b2db1b4bce73bcf0235579 HTTP/1.1" 200 None 2026-03-14 15:26:24,172 - lava_callback - DEBUG - Processing node 69b2db1b4bce73bcf0235579: baseline-arm64-clabbe 2026-03-14 15:26:24,173 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b2db1b4bce73bcf0235579 2026-03-14 15:26:24,173 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 15:26:24,187 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b2db1b4bce73bcf0235579 HTTP/1.1" 200 None 2026-03-14 15:26:24,188 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 15:26:24,201 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69afd3b0c9209b146d8e1d77 HTTP/1.1" 200 None 2026-03-14 15:26:24,202 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 15:26:24,223 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b2db1b4bce73bcf0235579 HTTP/1.1" 200 None 2026-03-14 15:26:24,229 - lava_callback - ERROR - Error processing callback for node 69b2db1b4bce73bcf0235579: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:48694 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43882 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52572 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52574 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51494 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38522 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60036 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:60042 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53332 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57124 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44510 - "GET / HTTP/1.0" 200 OK 2026-03-14 15:27:44,162 - lava_callback - INFO - Received callback for node 69b2db6b4bce73bcf0235583 INFO: 172.21.0.1:44518 - "POST /node/69b2db6b4bce73bcf0235583 HTTP/1.0" 202 Accepted 2026-03-14 15:27:44,167 - lava_callback - INFO - Starting async job submit for node 69b2db6b4bce73bcf0235583 2026-03-14 15:27:44,168 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 15:27:44,184 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b2db6b4bce73bcf0235583 HTTP/1.1" 200 None 2026-03-14 15:27:44,186 - lava_callback - DEBUG - Processing node 69b2db6b4bce73bcf0235583: baseline-arm64-clabbe 2026-03-14 15:27:44,186 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b2db6b4bce73bcf0235583 2026-03-14 15:27:44,187 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 15:27:44,201 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b2db6b4bce73bcf0235583 HTTP/1.1" 200 None 2026-03-14 15:27:44,202 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 15:27:44,216 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69afd3b0c9209b146d8e1d77 HTTP/1.1" 200 None 2026-03-14 15:27:44,217 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 15:27:44,242 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b2db6b4bce73bcf0235583 HTTP/1.1" 200 None 2026-03-14 15:27:44,243 - lava_callback - ERROR - Error processing callback for node 69b2db6b4bce73bcf0235583: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:44526 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52346 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55720 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57004 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:57006 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35340 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46246 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50734 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50746 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42658 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59424 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55602 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:55608 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42016 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37686 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48062 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48072 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57744 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40688 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49202 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:49208 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54806 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34156 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37158 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37174 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38700 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59994 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51528 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:51532 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47192 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49522 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37154 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37158 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52194 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39664 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50634 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:50644 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44958 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50714 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40050 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40058 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44908 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52754 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40666 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:40674 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49134 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34646 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38116 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38120 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40100 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48744 - "GET / HTTP/1.0" 200 OK 2026-03-14 15:34:13,897 - lava_callback - INFO - Received callback for node 69b2dcf24bce73bcf02355d7 INFO: 172.21.0.1:41586 - "POST /node/69b2dcf24bce73bcf02355d7 HTTP/1.0" 202 Accepted 2026-03-14 15:34:13,902 - lava_callback - INFO - Starting async job submit for node 69b2dcf24bce73bcf02355d7 2026-03-14 15:34:13,903 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 15:34:13,918 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b2dcf24bce73bcf02355d7 HTTP/1.1" 200 None 2026-03-14 15:34:13,919 - lava_callback - DEBUG - Processing node 69b2dcf24bce73bcf02355d7: baseline-arm64-baylibre 2026-03-14 15:34:13,919 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b2dcf24bce73bcf02355d7 2026-03-14 15:34:13,920 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 15:34:13,934 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b2dcf24bce73bcf02355d7 HTTP/1.1" 200 None 2026-03-14 15:34:13,935 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 15:34:13,949 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b276764bce73bcf0233d23 HTTP/1.1" 200 None 2026-03-14 15:34:13,950 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 15:34:13,977 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b2dcf24bce73bcf02355d7 HTTP/1.1" 200 None 2026-03-14 15:34:13,978 - lava_callback - ERROR - Error processing callback for node 69b2dcf24bce73bcf02355d7: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:41590 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:41592 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44664 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55436 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43830 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43844 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42496 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60294 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47148 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:47154 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34764 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57794 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38588 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38600 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58690 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56336 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36510 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:36516 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43180 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44602 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48704 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48720 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54876 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48864 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56474 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:56488 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48056 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41228 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55586 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59382 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59396 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55866 - "GET / HTTP/1.0" 200 OK 2026-03-14 15:38:13,890 - lava_callback - INFO - Received callback for node 69b2ddd04bce73bcf02355fc INFO: 172.21.0.1:46150 - "POST /node/69b2ddd04bce73bcf02355fc HTTP/1.0" 202 Accepted 2026-03-14 15:38:13,896 - lava_callback - INFO - Starting async job submit for node 69b2ddd04bce73bcf02355fc 2026-03-14 15:38:13,897 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 15:38:13,923 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b2ddd04bce73bcf02355fc HTTP/1.1" 200 None 2026-03-14 15:38:13,924 - lava_callback - DEBUG - Processing node 69b2ddd04bce73bcf02355fc: baseline-arm-baylibre 2026-03-14 15:38:13,924 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b2ddd04bce73bcf02355fc 2026-03-14 15:38:13,925 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 15:38:13,938 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b2ddd04bce73bcf02355fc HTTP/1.1" 200 None 2026-03-14 15:38:13,939 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 15:38:13,961 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69afd3a3c9209b146d8e1d68 HTTP/1.1" 200 None 2026-03-14 15:38:13,962 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 15:38:13,983 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b2ddd04bce73bcf02355fc HTTP/1.1" 200 None 2026-03-14 15:38:13,985 - lava_callback - ERROR - Error processing callback for node 69b2ddd04bce73bcf02355fc: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:46152 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:46154 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46544 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47270 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49176 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49188 - "GET / HTTP/1.0" 200 OK 2026-03-14 15:38:53,876 - lava_callback - INFO - Received callback for node 69b2de034bce73bcf0235608 INFO: 172.21.0.1:44286 - "POST /node/69b2de034bce73bcf0235608 HTTP/1.0" 202 Accepted 2026-03-14 15:38:53,882 - lava_callback - INFO - Starting async job submit for node 69b2de034bce73bcf0235608 2026-03-14 15:38:53,883 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 15:38:53,897 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b2de034bce73bcf0235608 HTTP/1.1" 200 None 2026-03-14 15:38:53,898 - lava_callback - DEBUG - Processing node 69b2de034bce73bcf0235608: baseline-arm64-baylibre 2026-03-14 15:38:53,898 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b2de034bce73bcf0235608 2026-03-14 15:38:53,899 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 15:38:53,911 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b2de034bce73bcf0235608 HTTP/1.1" 200 None 2026-03-14 15:38:53,913 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 15:38:53,926 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b276764bce73bcf0233d23 HTTP/1.1" 200 None 2026-03-14 15:38:53,928 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 15:38:53,962 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b2de034bce73bcf0235608 HTTP/1.1" 200 None 2026-03-14 15:38:53,964 - lava_callback - ERROR - Error processing callback for node 69b2de034bce73bcf0235608: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:44300 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42608 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58068 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:58070 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49780 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55736 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40424 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40436 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37466 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60480 - "GET / HTTP/1.0" 200 OK 2026-03-14 15:40:14,010 - lava_callback - INFO - Received callback for node 69b2de504bce73bcf0235621 INFO: 172.21.0.1:33176 - "POST /node/69b2de504bce73bcf0235621 HTTP/1.0" 202 Accepted 2026-03-14 15:40:14,016 - lava_callback - INFO - Starting async job submit for node 69b2de504bce73bcf0235621 2026-03-14 15:40:14,017 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 15:40:14,034 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b2de504bce73bcf0235621 HTTP/1.1" 200 None 2026-03-14 15:40:14,035 - lava_callback - DEBUG - Processing node 69b2de504bce73bcf0235621: baseline-arm64-baylibre 2026-03-14 15:40:14,035 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b2de504bce73bcf0235621 2026-03-14 15:40:14,036 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 15:40:14,049 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b2de504bce73bcf0235621 HTTP/1.1" 200 None 2026-03-14 15:40:14,051 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 15:40:14,066 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b276764bce73bcf0233d23 HTTP/1.1" 200 None 2026-03-14 15:40:14,067 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 15:40:14,090 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b2de504bce73bcf0235621 HTTP/1.1" 200 None 2026-03-14 15:40:14,092 - lava_callback - ERROR - Error processing callback for node 69b2de504bce73bcf0235621: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:33192 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:33200 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44834 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47304 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56266 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56280 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44078 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53074 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46562 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:46570 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58910 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33594 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33740 - "GET / HTTP/1.0" 200 OK 2026-03-14 15:41:44,799 - lava_callback - INFO - Received callback for node 69b2dea54bce73bcf0235633 INFO: 172.21.0.1:33742 - "POST /node/69b2dea54bce73bcf0235633 HTTP/1.0" 202 Accepted 2026-03-14 15:41:44,804 - lava_callback - INFO - Starting async job submit for node 69b2dea54bce73bcf0235633 2026-03-14 15:41:44,805 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 15:41:44,820 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b2dea54bce73bcf0235633 HTTP/1.1" 200 None 2026-03-14 15:41:44,820 - lava_callback - DEBUG - Processing node 69b2dea54bce73bcf0235633: baseline-arm64-clabbe 2026-03-14 15:41:44,821 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b2dea54bce73bcf0235633 2026-03-14 15:41:44,821 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 15:41:44,842 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b2dea54bce73bcf0235633 HTTP/1.1" 200 None 2026-03-14 15:41:44,843 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 15:41:44,857 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b276764bce73bcf0233d23 HTTP/1.1" 200 None 2026-03-14 15:41:44,859 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 15:41:44,879 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b2dea54bce73bcf0235633 HTTP/1.1" 200 None 2026-03-14 15:41:44,885 - lava_callback - ERROR - Error processing callback for node 69b2dea54bce73bcf0235633: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:33750 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45566 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43358 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47686 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:47702 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56082 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59266 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38784 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38790 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53908 - "GET / HTTP/1.0" 200 OK 2026-03-14 15:43:04,870 - lava_callback - INFO - Received callback for node 69b2def44bce73bcf0235643 INFO: 172.21.0.1:50436 - "POST /node/69b2def44bce73bcf0235643 HTTP/1.0" 202 Accepted 2026-03-14 15:43:04,876 - lava_callback - INFO - Starting async job submit for node 69b2def44bce73bcf0235643 2026-03-14 15:43:04,876 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 15:43:04,898 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b2def44bce73bcf0235643 HTTP/1.1" 200 None 2026-03-14 15:43:04,899 - lava_callback - DEBUG - Processing node 69b2def44bce73bcf0235643: baseline-arm64-clabbe 2026-03-14 15:43:04,899 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b2def44bce73bcf0235643 2026-03-14 15:43:04,900 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 15:43:04,914 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b2def44bce73bcf0235643 HTTP/1.1" 200 None 2026-03-14 15:43:04,915 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 15:43:04,930 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b276764bce73bcf0233d23 HTTP/1.1" 200 None 2026-03-14 15:43:04,932 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 15:43:04,959 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b2def44bce73bcf0235643 HTTP/1.1" 200 None 2026-03-14 15:43:04,961 - lava_callback - ERROR - Error processing callback for node 69b2def44bce73bcf0235643: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:50452 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59820 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:59836 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57444 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38208 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47270 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47278 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39852 - "GET / HTTP/1.0" 200 OK 2026-03-14 15:44:04,889 - lava_callback - INFO - Received callback for node 69b2df424bce73bcf0235657 INFO: 172.21.0.1:45738 - "POST /node/69b2df424bce73bcf0235657 HTTP/1.0" 202 Accepted 2026-03-14 15:44:04,894 - lava_callback - INFO - Starting async job submit for node 69b2df424bce73bcf0235657 2026-03-14 15:44:04,895 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 15:44:04,911 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b2df424bce73bcf0235657 HTTP/1.1" 200 None 2026-03-14 15:44:04,912 - lava_callback - DEBUG - Processing node 69b2df424bce73bcf0235657: baseline-arm64-clabbe 2026-03-14 15:44:04,912 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b2df424bce73bcf0235657 2026-03-14 15:44:04,913 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 15:44:04,933 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b2df424bce73bcf0235657 HTTP/1.1" 200 None 2026-03-14 15:44:04,934 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 15:44:04,949 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b276764bce73bcf0233d23 HTTP/1.1" 200 None 2026-03-14 15:44:04,951 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 15:44:04,971 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b2df424bce73bcf0235657 HTTP/1.1" 200 None 2026-03-14 15:44:04,972 - lava_callback - ERROR - Error processing callback for node 69b2df424bce73bcf0235657: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:45740 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54860 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:54874 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41762 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50048 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52092 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52098 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34406 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35234 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60928 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:60940 - "GET / HTTP/1.0" 200 OK 2026-03-14 15:45:24,914 - lava_callback - INFO - Received callback for node 69b2df904bce73bcf0235664 INFO: 172.21.0.1:42388 - "POST /node/69b2df904bce73bcf0235664 HTTP/1.0" 202 Accepted 2026-03-14 15:45:24,920 - lava_callback - INFO - Starting async job submit for node 69b2df904bce73bcf0235664 2026-03-14 15:45:24,921 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 15:45:24,935 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b2df904bce73bcf0235664 HTTP/1.1" 200 None 2026-03-14 15:45:24,936 - lava_callback - DEBUG - Processing node 69b2df904bce73bcf0235664: baseline-arm64-clabbe 2026-03-14 15:45:24,936 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b2df904bce73bcf0235664 2026-03-14 15:45:24,937 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 15:45:24,949 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b2df904bce73bcf0235664 HTTP/1.1" 200 None 2026-03-14 15:45:24,951 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 15:45:24,964 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b276764bce73bcf0233d23 HTTP/1.1" 200 None 2026-03-14 15:45:24,965 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 15:45:24,986 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b2df904bce73bcf0235664 HTTP/1.1" 200 None 2026-03-14 15:45:24,991 - lava_callback - ERROR - Error processing callback for node 69b2df904bce73bcf0235664: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:42402 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38144 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37186 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37196 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60044 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48296 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56840 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:56842 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37356 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58250 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48576 - "GET / HTTP/1.0" 200 OK 2026-03-14 15:46:45,010 - lava_callback - INFO - Received callback for node 69b2dfdc4bce73bcf023566b INFO: 172.21.0.1:48592 - "POST /node/69b2dfdc4bce73bcf023566b HTTP/1.0" 202 Accepted 2026-03-14 15:46:45,016 - lava_callback - INFO - Starting async job submit for node 69b2dfdc4bce73bcf023566b 2026-03-14 15:46:45,017 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 15:46:45,030 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b2dfdc4bce73bcf023566b HTTP/1.1" 200 None 2026-03-14 15:46:45,031 - lava_callback - DEBUG - Processing node 69b2dfdc4bce73bcf023566b: baseline-arm64-clabbe 2026-03-14 15:46:45,031 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b2dfdc4bce73bcf023566b 2026-03-14 15:46:45,032 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 15:46:45,048 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b2dfdc4bce73bcf023566b HTTP/1.1" 200 None 2026-03-14 15:46:45,050 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 15:46:45,063 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b276764bce73bcf0233d23 HTTP/1.1" 200 None 2026-03-14 15:46:45,065 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 15:46:45,087 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b2dfdc4bce73bcf023566b HTTP/1.1" 200 None 2026-03-14 15:46:45,092 - lava_callback - ERROR - Error processing callback for node 69b2dfdc4bce73bcf023566b: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:48608 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58902 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:32942 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47242 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:47258 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48560 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37568 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43176 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43180 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54986 - "GET / HTTP/1.0" 200 OK 2026-03-14 15:48:05,019 - lava_callback - INFO - Received callback for node 69b2e0284bce73bcf0235676 INFO: 172.21.0.1:35934 - "POST /node/69b2e0284bce73bcf0235676 HTTP/1.0" 202 Accepted 2026-03-14 15:48:05,024 - lava_callback - INFO - Starting async job submit for node 69b2e0284bce73bcf0235676 2026-03-14 15:48:05,025 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 15:48:05,043 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b2e0284bce73bcf0235676 HTTP/1.1" 200 None 2026-03-14 15:48:05,043 - lava_callback - DEBUG - Processing node 69b2e0284bce73bcf0235676: baseline-arm64-clabbe 2026-03-14 15:48:05,044 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b2e0284bce73bcf0235676 2026-03-14 15:48:05,044 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 15:48:05,058 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b2e0284bce73bcf0235676 HTTP/1.1" 200 None 2026-03-14 15:48:05,060 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 15:48:05,074 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b276764bce73bcf0233d23 HTTP/1.1" 200 None 2026-03-14 15:48:05,076 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 15:48:05,097 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b2e0284bce73bcf0235676 HTTP/1.1" 200 None 2026-03-14 15:48:05,098 - lava_callback - ERROR - Error processing callback for node 69b2e0284bce73bcf0235676: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:35942 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52334 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:52346 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34788 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39080 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35252 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35268 - "GET / HTTP/1.0" 200 OK 2026-03-14 15:48:54,604 - lava_callback - INFO - Received callback for node 69b2e0644bce73bcf023567b INFO: 172.21.0.1:39676 - "POST /node/69b2e0644bce73bcf023567b HTTP/1.0" 202 Accepted 2026-03-14 15:48:54,609 - lava_callback - INFO - Starting async job submit for node 69b2e0644bce73bcf023567b 2026-03-14 15:48:54,610 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 15:48:54,629 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b2e0644bce73bcf023567b HTTP/1.1" 200 None 2026-03-14 15:48:54,630 - lava_callback - DEBUG - Processing node 69b2e0644bce73bcf023567b: baseline-arm-baylibre 2026-03-14 15:48:54,630 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b2e0644bce73bcf023567b 2026-03-14 15:48:54,631 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 15:48:54,653 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b2e0644bce73bcf023567b HTTP/1.1" 200 None 2026-03-14 15:48:54,654 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 15:48:54,667 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69afd3a3c9209b146d8e1d68 HTTP/1.1" 200 None 2026-03-14 15:48:54,669 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 15:48:54,689 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b2e0644bce73bcf023567b HTTP/1.1" 200 None 2026-03-14 15:48:54,691 - lava_callback - ERROR - Error processing callback for node 69b2e0644bce73bcf023567b: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:39682 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33472 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38786 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:38794 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55896 - "GET / HTTP/1.0" 200 OK 2026-03-14 15:49:34,510 - lava_callback - INFO - Received callback for node 69b2e0884bce73bcf0235684 INFO: 172.21.0.1:48762 - "POST /node/69b2e0884bce73bcf0235684 HTTP/1.0" 202 Accepted 2026-03-14 15:49:34,515 - lava_callback - INFO - Starting async job submit for node 69b2e0884bce73bcf0235684 2026-03-14 15:49:34,516 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 15:49:34,531 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b2e0884bce73bcf0235684 HTTP/1.1" 200 None 2026-03-14 15:49:34,532 - lava_callback - DEBUG - Processing node 69b2e0884bce73bcf0235684: baseline-arm-baylibre 2026-03-14 15:49:34,532 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b2e0884bce73bcf0235684 2026-03-14 15:49:34,533 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 15:49:34,546 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b2e0884bce73bcf0235684 HTTP/1.1" 200 None 2026-03-14 15:49:34,548 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 15:49:34,566 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69afd3a3c9209b146d8e1d68 HTTP/1.1" 200 None 2026-03-14 15:49:34,567 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 15:49:34,588 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b2e0884bce73bcf0235684 HTTP/1.1" 200 None 2026-03-14 15:49:34,589 - lava_callback - ERROR - Error processing callback for node 69b2e0884bce73bcf0235684: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:48772 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56154 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56162 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40938 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47938 - "GET / HTTP/1.0" 200 OK 2026-03-14 15:50:14,525 - lava_callback - INFO - Received callback for node 69b2e0ad4bce73bcf023568e INFO: 172.21.0.1:39006 - "POST /node/69b2e0ad4bce73bcf023568e HTTP/1.0" 202 Accepted 2026-03-14 15:50:14,530 - lava_callback - INFO - Starting async job submit for node 69b2e0ad4bce73bcf023568e 2026-03-14 15:50:14,531 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 15:50:14,546 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b2e0ad4bce73bcf023568e HTTP/1.1" 200 None 2026-03-14 15:50:14,547 - lava_callback - DEBUG - Processing node 69b2e0ad4bce73bcf023568e: baseline-arm-baylibre 2026-03-14 15:50:14,547 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b2e0ad4bce73bcf023568e 2026-03-14 15:50:14,548 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 15:50:14,561 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b2e0ad4bce73bcf023568e HTTP/1.1" 200 None 2026-03-14 15:50:14,562 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 15:50:14,576 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69afd3a3c9209b146d8e1d68 HTTP/1.1" 200 None 2026-03-14 15:50:14,577 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 15:50:14,597 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b2e0ad4bce73bcf023568e HTTP/1.1" 200 None 2026-03-14 15:50:14,603 - lava_callback - ERROR - Error processing callback for node 69b2e0ad4bce73bcf023568e: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:39008 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:39012 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53058 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50272 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43514 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43524 - "GET / HTTP/1.0" 200 OK 2026-03-14 15:50:54,571 - lava_callback - INFO - Received callback for node 69b2e0d24bce73bcf0235697 INFO: 172.21.0.1:51790 - "POST /node/69b2e0d24bce73bcf0235697 HTTP/1.0" 202 Accepted 2026-03-14 15:50:54,576 - lava_callback - INFO - Starting async job submit for node 69b2e0d24bce73bcf0235697 2026-03-14 15:50:54,577 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 15:50:54,592 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b2e0d24bce73bcf0235697 HTTP/1.1" 200 None 2026-03-14 15:50:54,593 - lava_callback - DEBUG - Processing node 69b2e0d24bce73bcf0235697: baseline-arm-baylibre 2026-03-14 15:50:54,593 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b2e0d24bce73bcf0235697 2026-03-14 15:50:54,594 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 15:50:54,624 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b2e0d24bce73bcf0235697 HTTP/1.1" 200 None 2026-03-14 15:50:54,626 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 15:50:54,639 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69afd3a3c9209b146d8e1d68 HTTP/1.1" 200 None 2026-03-14 15:50:54,640 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 15:50:54,689 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b2e0d24bce73bcf0235697 HTTP/1.1" 200 None 2026-03-14 15:50:54,690 - lava_callback - ERROR - Error processing callback for node 69b2e0d24bce73bcf0235697: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:51798 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47424 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47584 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:47592 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50580 - "GET / HTTP/1.0" 200 OK 2026-03-14 15:51:34,618 - lava_callback - INFO - Received callback for node 69b2e0f64bce73bcf02356a3 INFO: 172.21.0.1:54608 - "POST /node/69b2e0f64bce73bcf02356a3 HTTP/1.0" 202 Accepted 2026-03-14 15:51:34,623 - lava_callback - INFO - Starting async job submit for node 69b2e0f64bce73bcf02356a3 2026-03-14 15:51:34,624 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 15:51:34,654 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b2e0f64bce73bcf02356a3 HTTP/1.1" 200 None 2026-03-14 15:51:34,655 - lava_callback - DEBUG - Processing node 69b2e0f64bce73bcf02356a3: baseline-arm-baylibre 2026-03-14 15:51:34,656 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b2e0f64bce73bcf02356a3 2026-03-14 15:51:34,656 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 15:51:34,672 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b2e0f64bce73bcf02356a3 HTTP/1.1" 200 None 2026-03-14 15:51:34,673 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 15:51:34,686 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69afd3a3c9209b146d8e1d68 HTTP/1.1" 200 None 2026-03-14 15:51:34,688 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 15:51:34,709 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b2e0f64bce73bcf02356a3 HTTP/1.1" 200 None 2026-03-14 15:51:34,710 - lava_callback - ERROR - Error processing callback for node 69b2e0f64bce73bcf02356a3: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:54618 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45612 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45614 - "GET / HTTP/1.0" 200 OK 2026-03-14 15:51:54,624 - lava_callback - INFO - Received callback for node 69b2e1174bce73bcf02356aa INFO: 172.21.0.1:45054 - "POST /node/69b2e1174bce73bcf02356aa HTTP/1.0" 202 Accepted 2026-03-14 15:51:54,630 - lava_callback - INFO - Starting async job submit for node 69b2e1174bce73bcf02356aa 2026-03-14 15:51:54,630 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 15:51:54,644 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b2e1174bce73bcf02356aa HTTP/1.1" 200 None 2026-03-14 15:51:54,645 - lava_callback - DEBUG - Processing node 69b2e1174bce73bcf02356aa: baseline-arm-baylibre 2026-03-14 15:51:54,646 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b2e1174bce73bcf02356aa 2026-03-14 15:51:54,646 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 15:51:54,662 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b2e1174bce73bcf02356aa HTTP/1.1" 200 None 2026-03-14 15:51:54,664 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 15:51:54,677 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69afd3a3c9209b146d8e1d68 HTTP/1.1" 200 None 2026-03-14 15:51:54,678 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 15:51:54,704 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b2e1174bce73bcf02356aa HTTP/1.1" 200 None 2026-03-14 15:51:54,710 - lava_callback - ERROR - Error processing callback for node 69b2e1174bce73bcf02356aa: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:45066 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55836 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33498 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:33512 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47664 - "GET / HTTP/1.0" 200 OK 2026-03-14 15:52:34,637 - lava_callback - INFO - Received callback for node 69b2e13b4bce73bcf02356b4 INFO: 172.21.0.1:43498 - "POST /node/69b2e13b4bce73bcf02356b4 HTTP/1.0" 202 Accepted 2026-03-14 15:52:34,643 - lava_callback - INFO - Starting async job submit for node 69b2e13b4bce73bcf02356b4 2026-03-14 15:52:34,644 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 15:52:34,677 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b2e13b4bce73bcf02356b4 HTTP/1.1" 200 None 2026-03-14 15:52:34,678 - lava_callback - DEBUG - Processing node 69b2e13b4bce73bcf02356b4: baseline-arm-baylibre 2026-03-14 15:52:34,678 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b2e13b4bce73bcf02356b4 2026-03-14 15:52:34,678 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 15:52:34,692 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b2e13b4bce73bcf02356b4 HTTP/1.1" 200 None 2026-03-14 15:52:34,693 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 15:52:34,757 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69afd3a3c9209b146d8e1d68 HTTP/1.1" 200 None 2026-03-14 15:52:34,760 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 15:52:34,785 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b2e13b4bce73bcf02356b4 HTTP/1.1" 200 None 2026-03-14 15:52:34,786 - lava_callback - ERROR - Error processing callback for node 69b2e13b4bce73bcf02356b4: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:43502 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54972 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54978 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51706 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55624 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49316 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:49324 - "GET / HTTP/1.0" 200 OK 2026-03-14 15:53:25,277 - lava_callback - INFO - Received callback for node 69b2e1654bce73bcf02356bd INFO: 172.21.0.1:46456 - "POST /node/69b2e1654bce73bcf02356bd HTTP/1.0" 202 Accepted 2026-03-14 15:53:25,282 - lava_callback - INFO - Starting async job submit for node 69b2e1654bce73bcf02356bd 2026-03-14 15:53:25,283 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 15:53:25,298 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b2e1654bce73bcf02356bd HTTP/1.1" 200 None 2026-03-14 15:53:25,299 - lava_callback - DEBUG - Processing node 69b2e1654bce73bcf02356bd: baseline-arm-clabbe 2026-03-14 15:53:25,299 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b2e1654bce73bcf02356bd 2026-03-14 15:53:25,299 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 15:53:25,322 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b2e1654bce73bcf02356bd HTTP/1.1" 200 None 2026-03-14 15:53:25,324 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 15:53:25,338 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69afd3a3c9209b146d8e1d68 HTTP/1.1" 200 None 2026-03-14 15:53:25,339 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 15:53:25,360 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b2e1654bce73bcf02356bd HTTP/1.1" 200 None 2026-03-14 15:53:25,361 - lava_callback - ERROR - Error processing callback for node 69b2e1654bce73bcf02356bd: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:46466 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52032 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58366 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58382 - "GET / HTTP/1.0" 200 OK 2026-03-14 15:53:54,792 - lava_callback - INFO - Received callback for node 69b2e1864bce73bcf02356c7 INFO: 172.21.0.1:56332 - "POST /node/69b2e1864bce73bcf02356c7 HTTP/1.0" 202 Accepted 2026-03-14 15:53:54,797 - lava_callback - INFO - Starting async job submit for node 69b2e1864bce73bcf02356c7 2026-03-14 15:53:54,798 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 15:53:54,812 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b2e1864bce73bcf02356c7 HTTP/1.1" 200 None 2026-03-14 15:53:54,813 - lava_callback - DEBUG - Processing node 69b2e1864bce73bcf02356c7: baseline-arm-baylibre 2026-03-14 15:53:54,813 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b2e1864bce73bcf02356c7 2026-03-14 15:53:54,814 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 15:53:54,830 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b2e1864bce73bcf02356c7 HTTP/1.1" 200 None 2026-03-14 15:53:54,832 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 15:53:54,848 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69afd3a3c9209b146d8e1d68 HTTP/1.1" 200 None 2026-03-14 15:53:54,849 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 15:53:54,871 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b2e1864bce73bcf02356c7 HTTP/1.1" 200 None 2026-03-14 15:53:54,872 - lava_callback - ERROR - Error processing callback for node 69b2e1864bce73bcf02356c7: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:56336 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36546 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46798 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:46804 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56838 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60626 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36350 - "GET / HTTP/1.0" 200 OK 2026-03-14 15:54:45,322 - lava_callback - INFO - Received callback for node 69b2e1ae4bce73bcf02356d3 INFO: 172.21.0.1:36356 - "POST /node/69b2e1ae4bce73bcf02356d3 HTTP/1.0" 202 Accepted 2026-03-14 15:54:45,327 - lava_callback - INFO - Starting async job submit for node 69b2e1ae4bce73bcf02356d3 2026-03-14 15:54:45,328 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 15:54:45,342 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b2e1ae4bce73bcf02356d3 HTTP/1.1" 200 None 2026-03-14 15:54:45,343 - lava_callback - DEBUG - Processing node 69b2e1ae4bce73bcf02356d3: baseline-arm-clabbe 2026-03-14 15:54:45,343 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b2e1ae4bce73bcf02356d3 2026-03-14 15:54:45,344 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 15:54:45,357 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b2e1ae4bce73bcf02356d3 HTTP/1.1" 200 None 2026-03-14 15:54:45,358 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 15:54:45,377 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69afd3a3c9209b146d8e1d68 HTTP/1.1" 200 None 2026-03-14 15:54:45,379 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 15:54:45,400 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b2e1ae4bce73bcf02356d3 HTTP/1.1" 200 None 2026-03-14 15:54:45,404 - lava_callback - ERROR - Error processing callback for node 69b2e1ae4bce73bcf02356d3: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:36368 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48276 - "GET / HTTP/1.0" 200 OK 2026-03-14 15:55:05,287 - lava_callback - INFO - Received callback for node 69b2e1d34bce73bcf02356dd INFO: 172.21.0.1:43306 - "POST /node/69b2e1d34bce73bcf02356dd HTTP/1.0" 202 Accepted 2026-03-14 15:55:05,292 - lava_callback - INFO - Starting async job submit for node 69b2e1d34bce73bcf02356dd 2026-03-14 15:55:05,293 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 15:55:05,312 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b2e1d34bce73bcf02356dd HTTP/1.1" 200 None 2026-03-14 15:55:05,312 - lava_callback - DEBUG - Processing node 69b2e1d34bce73bcf02356dd: baseline-arm-clabbe 2026-03-14 15:55:05,313 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b2e1d34bce73bcf02356dd 2026-03-14 15:55:05,313 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 15:55:05,337 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b2e1d34bce73bcf02356dd HTTP/1.1" 200 None 2026-03-14 15:55:05,339 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 15:55:05,351 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69afd3a3c9209b146d8e1d68 HTTP/1.1" 200 None 2026-03-14 15:55:05,353 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 15:55:05,373 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b2e1d34bce73bcf02356dd HTTP/1.1" 200 None 2026-03-14 15:55:05,379 - lava_callback - ERROR - Error processing callback for node 69b2e1d34bce73bcf02356dd: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:43316 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45680 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:45686 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37628 - "GET / HTTP/1.0" 200 OK 2026-03-14 15:55:35,351 - lava_callback - INFO - Received callback for node 69b2e1f44bce73bcf02356e7 INFO: 172.21.0.1:49308 - "POST /node/69b2e1f44bce73bcf02356e7 HTTP/1.0" 202 Accepted 2026-03-14 15:55:35,357 - lava_callback - INFO - Starting async job submit for node 69b2e1f44bce73bcf02356e7 2026-03-14 15:55:35,357 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 15:55:35,371 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b2e1f44bce73bcf02356e7 HTTP/1.1" 200 None 2026-03-14 15:55:35,371 - lava_callback - DEBUG - Processing node 69b2e1f44bce73bcf02356e7: baseline-arm-baylibre 2026-03-14 15:55:35,372 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b2e1f44bce73bcf02356e7 2026-03-14 15:55:35,372 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 15:55:35,385 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b2e1f44bce73bcf02356e7 HTTP/1.1" 200 None 2026-03-14 15:55:35,387 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 15:55:35,400 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69afd3a3c9209b146d8e1d68 HTTP/1.1" 200 None 2026-03-14 15:55:35,402 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 15:55:35,432 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b2e1f44bce73bcf02356e7 HTTP/1.1" 200 None 2026-03-14 15:55:35,434 - lava_callback - ERROR - Error processing callback for node 69b2e1f44bce73bcf02356e7: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:49310 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36086 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36098 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60304 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40240 - "GET / HTTP/1.0" 200 OK 2026-03-14 15:56:14,846 - lava_callback - INFO - Received callback for node 69b2e2194bce73bcf02356f0 INFO: 172.21.0.1:34542 - "POST /node/69b2e2194bce73bcf02356f0 HTTP/1.0" 202 Accepted 2026-03-14 15:56:14,852 - lava_callback - INFO - Starting async job submit for node 69b2e2194bce73bcf02356f0 2026-03-14 15:56:14,852 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 15:56:14,867 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b2e2194bce73bcf02356f0 HTTP/1.1" 200 None 2026-03-14 15:56:14,868 - lava_callback - DEBUG - Processing node 69b2e2194bce73bcf02356f0: baseline-arm-baylibre 2026-03-14 15:56:14,868 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b2e2194bce73bcf02356f0 2026-03-14 15:56:14,868 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 15:56:14,888 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b2e2194bce73bcf02356f0 HTTP/1.1" 200 None 2026-03-14 15:56:14,889 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 15:56:14,904 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69afd3a3c9209b146d8e1d68 HTTP/1.1" 200 None 2026-03-14 15:56:14,906 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 15:56:14,928 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b2e2194bce73bcf02356f0 HTTP/1.1" 200 None 2026-03-14 15:56:14,929 - lava_callback - ERROR - Error processing callback for node 69b2e2194bce73bcf02356f0: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:34548 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:34564 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52068 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37962 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59726 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59728 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59288 - "GET / HTTP/1.0" 200 OK 2026-03-14 15:57:05,430 - lava_callback - INFO - Received callback for node 69b2e23f4bce73bcf02356fe INFO: 172.21.0.1:46266 - "POST /node/69b2e23f4bce73bcf02356fe HTTP/1.0" 202 Accepted 2026-03-14 15:57:05,435 - lava_callback - INFO - Starting async job submit for node 69b2e23f4bce73bcf02356fe 2026-03-14 15:57:05,436 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 15:57:05,451 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b2e23f4bce73bcf02356fe HTTP/1.1" 200 None 2026-03-14 15:57:05,451 - lava_callback - DEBUG - Processing node 69b2e23f4bce73bcf02356fe: baseline-arm-clabbe 2026-03-14 15:57:05,452 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b2e23f4bce73bcf02356fe 2026-03-14 15:57:05,452 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 15:57:05,465 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b2e23f4bce73bcf02356fe HTTP/1.1" 200 None 2026-03-14 15:57:05,467 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 15:57:05,480 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69afd3a3c9209b146d8e1d68 HTTP/1.1" 200 None 2026-03-14 15:57:05,482 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 15:57:05,503 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b2e23f4bce73bcf02356fe HTTP/1.1" 200 None 2026-03-14 15:57:05,504 - lava_callback - ERROR - Error processing callback for node 69b2e23f4bce73bcf02356fe: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:46276 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60594 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:60596 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38936 - "GET / HTTP/1.0" 200 OK 2026-03-14 15:57:34,985 - lava_callback - INFO - Received callback for node 69b2e2614bce73bcf0235706 INFO: 172.21.0.1:47714 - "POST /node/69b2e2614bce73bcf0235706 HTTP/1.0" 202 Accepted 2026-03-14 15:57:34,990 - lava_callback - INFO - Starting async job submit for node 69b2e2614bce73bcf0235706 2026-03-14 15:57:34,991 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 15:57:35,010 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b2e2614bce73bcf0235706 HTTP/1.1" 200 None 2026-03-14 15:57:35,012 - lava_callback - DEBUG - Processing node 69b2e2614bce73bcf0235706: baseline-arm-baylibre 2026-03-14 15:57:35,012 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b2e2614bce73bcf0235706 2026-03-14 15:57:35,013 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 15:57:35,027 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b2e2614bce73bcf0235706 HTTP/1.1" 200 None 2026-03-14 15:57:35,028 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 15:57:35,044 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69afd3a3c9209b146d8e1d68 HTTP/1.1" 200 None 2026-03-14 15:57:35,045 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 15:57:35,066 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b2e2614bce73bcf0235706 HTTP/1.1" 200 None 2026-03-14 15:57:35,071 - lava_callback - ERROR - Error processing callback for node 69b2e2614bce73bcf0235706: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:47716 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48532 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48548 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36838 - "GET / HTTP/1.0" 200 OK 2026-03-14 15:58:05,451 - lava_callback - INFO - Received callback for node 69b2e2874bce73bcf0235711 INFO: 172.21.0.1:54430 - "POST /node/69b2e2874bce73bcf0235711 HTTP/1.0" 202 Accepted 2026-03-14 15:58:05,456 - lava_callback - INFO - Starting async job submit for node 69b2e2874bce73bcf0235711 2026-03-14 15:58:05,457 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 15:58:05,471 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b2e2874bce73bcf0235711 HTTP/1.1" 200 None 2026-03-14 15:58:05,472 - lava_callback - DEBUG - Processing node 69b2e2874bce73bcf0235711: baseline-arm-clabbe 2026-03-14 15:58:05,472 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b2e2874bce73bcf0235711 2026-03-14 15:58:05,473 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 15:58:05,491 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b2e2874bce73bcf0235711 HTTP/1.1" 200 None 2026-03-14 15:58:05,492 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 15:58:05,510 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69afd3a3c9209b146d8e1d68 HTTP/1.1" 200 None 2026-03-14 15:58:05,511 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 15:58:05,532 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b2e2874bce73bcf0235711 HTTP/1.1" 200 None 2026-03-14 15:58:05,533 - lava_callback - ERROR - Error processing callback for node 69b2e2874bce73bcf0235711: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:54446 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59760 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:59770 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53410 - "GET / HTTP/1.0" 200 OK 2026-03-14 15:58:34,988 - lava_callback - INFO - Received callback for node 69b2e2a64bce73bcf023571b INFO: 172.21.0.1:56222 - "POST /node/69b2e2a64bce73bcf023571b HTTP/1.0" 202 Accepted 2026-03-14 15:58:34,994 - lava_callback - INFO - Starting async job submit for node 69b2e2a64bce73bcf023571b 2026-03-14 15:58:34,995 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 15:58:35,009 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b2e2a64bce73bcf023571b HTTP/1.1" 200 None 2026-03-14 15:58:35,010 - lava_callback - DEBUG - Processing node 69b2e2a64bce73bcf023571b: baseline-arm-baylibre 2026-03-14 15:58:35,010 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b2e2a64bce73bcf023571b 2026-03-14 15:58:35,011 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 15:58:35,024 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b2e2a64bce73bcf023571b HTTP/1.1" 200 None 2026-03-14 15:58:35,026 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 15:58:35,040 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ad30bced37758c525e15d2 HTTP/1.1" 200 None 2026-03-14 15:58:35,041 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 15:58:35,070 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b2e2a64bce73bcf023571b HTTP/1.1" 200 None 2026-03-14 15:58:35,072 - lava_callback - ERROR - Error processing callback for node 69b2e2a64bce73bcf023571b: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:56234 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49762 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49764 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59206 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54570 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38272 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:38284 - "GET / HTTP/1.0" 200 OK 2026-03-14 15:59:25,517 - lava_callback - INFO - Received callback for node 69b2e2cf4bce73bcf0235729 INFO: 172.21.0.1:36456 - "POST /node/69b2e2cf4bce73bcf0235729 HTTP/1.0" 202 Accepted 2026-03-14 15:59:25,523 - lava_callback - INFO - Starting async job submit for node 69b2e2cf4bce73bcf0235729 2026-03-14 15:59:25,524 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 15:59:25,539 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b2e2cf4bce73bcf0235729 HTTP/1.1" 200 None 2026-03-14 15:59:25,539 - lava_callback - DEBUG - Processing node 69b2e2cf4bce73bcf0235729: baseline-arm-clabbe 2026-03-14 15:59:25,540 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b2e2cf4bce73bcf0235729 2026-03-14 15:59:25,540 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 15:59:25,558 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b2e2cf4bce73bcf0235729 HTTP/1.1" 200 None 2026-03-14 15:59:25,560 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 15:59:25,573 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69afd3a3c9209b146d8e1d68 HTTP/1.1" 200 None 2026-03-14 15:59:25,574 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 15:59:25,597 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b2e2cf4bce73bcf0235729 HTTP/1.1" 200 None 2026-03-14 15:59:25,599 - lava_callback - ERROR - Error processing callback for node 69b2e2cf4bce73bcf0235729: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:36464 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53498 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42840 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42844 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58594 - "GET / HTTP/1.0" 200 OK 2026-03-14 16:00:05,835 - lava_callback - INFO - Received callback for node 69b2e2f44bce73bcf0235736 INFO: 172.21.0.1:54294 - "POST /node/69b2e2f44bce73bcf0235736 HTTP/1.0" 202 Accepted 2026-03-14 16:00:05,840 - lava_callback - INFO - Starting async job submit for node 69b2e2f44bce73bcf0235736 2026-03-14 16:00:05,841 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 16:00:05,863 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b2e2f44bce73bcf0235736 HTTP/1.1" 200 None 2026-03-14 16:00:05,864 - lava_callback - DEBUG - Processing node 69b2e2f44bce73bcf0235736: baseline-arm-clabbe 2026-03-14 16:00:05,864 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b2e2f44bce73bcf0235736 2026-03-14 16:00:05,865 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 16:00:05,879 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b2e2f44bce73bcf0235736 HTTP/1.1" 200 None 2026-03-14 16:00:05,880 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 16:00:05,894 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69afd3a3c9209b146d8e1d68 HTTP/1.1" 200 None 2026-03-14 16:00:05,896 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 16:00:05,918 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b2e2f44bce73bcf0235736 HTTP/1.1" 200 None 2026-03-14 16:00:05,919 - lava_callback - ERROR - Error processing callback for node 69b2e2f44bce73bcf0235736: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:54296 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51494 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:51504 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59396 - "GET / HTTP/1.0" 200 OK 2026-03-14 16:00:35,145 - lava_callback - INFO - Received callback for node 69b2e3144bce73bcf023573e INFO: 172.21.0.1:52908 - "POST /node/69b2e3144bce73bcf023573e HTTP/1.0" 202 Accepted 2026-03-14 16:00:35,151 - lava_callback - INFO - Starting async job submit for node 69b2e3144bce73bcf023573e 2026-03-14 16:00:35,152 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 16:00:35,167 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b2e3144bce73bcf023573e HTTP/1.1" 200 None 2026-03-14 16:00:35,168 - lava_callback - DEBUG - Processing node 69b2e3144bce73bcf023573e: baseline-arm-baylibre 2026-03-14 16:00:35,168 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b2e3144bce73bcf023573e 2026-03-14 16:00:35,168 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 16:00:35,181 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b2e3144bce73bcf023573e HTTP/1.1" 200 None 2026-03-14 16:00:35,183 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 16:00:35,196 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ad30bced37758c525e15d2 HTTP/1.1" 200 None 2026-03-14 16:00:35,197 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 16:00:35,219 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b2e3144bce73bcf023573e HTTP/1.1" 200 None 2026-03-14 16:00:35,220 - lava_callback - ERROR - Error processing callback for node 69b2e3144bce73bcf023573e: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:52922 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43934 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43942 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44240 - "GET / HTTP/1.0" 200 OK 2026-03-14 16:01:05,621 - lava_callback - INFO - Received callback for node 69b2e33e4bce73bcf0235747 INFO: 172.21.0.1:46352 - "POST /node/69b2e33e4bce73bcf0235747 HTTP/1.0" 202 Accepted 2026-03-14 16:01:05,626 - lava_callback - INFO - Starting async job submit for node 69b2e33e4bce73bcf0235747 2026-03-14 16:01:05,627 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 16:01:05,642 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b2e33e4bce73bcf0235747 HTTP/1.1" 200 None 2026-03-14 16:01:05,643 - lava_callback - DEBUG - Processing node 69b2e33e4bce73bcf0235747: baseline-arm-clabbe 2026-03-14 16:01:05,643 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b2e33e4bce73bcf0235747 2026-03-14 16:01:05,644 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 16:01:05,661 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b2e33e4bce73bcf0235747 HTTP/1.1" 200 None 2026-03-14 16:01:05,663 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 16:01:05,677 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69afd3a3c9209b146d8e1d68 HTTP/1.1" 200 None 2026-03-14 16:01:05,679 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 16:01:05,700 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b2e33e4bce73bcf0235747 HTTP/1.1" 200 None 2026-03-14 16:01:05,702 - lava_callback - ERROR - Error processing callback for node 69b2e33e4bce73bcf0235747: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:46354 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45578 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:45590 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59448 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56282 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38848 - "GET / HTTP/1.0" 200 OK 2026-03-14 16:01:45,638 - lava_callback - INFO - Received callback for node 69b2e3634bce73bcf0235752 INFO: 172.21.0.1:38854 - "POST /node/69b2e3634bce73bcf0235752 HTTP/1.0" 202 Accepted 2026-03-14 16:01:45,643 - lava_callback - INFO - Starting async job submit for node 69b2e3634bce73bcf0235752 2026-03-14 16:01:45,644 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 16:01:45,658 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b2e3634bce73bcf0235752 HTTP/1.1" 200 None 2026-03-14 16:01:45,659 - lava_callback - DEBUG - Processing node 69b2e3634bce73bcf0235752: baseline-arm-clabbe 2026-03-14 16:01:45,659 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b2e3634bce73bcf0235752 2026-03-14 16:01:45,660 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 16:01:45,680 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b2e3634bce73bcf0235752 HTTP/1.1" 200 None 2026-03-14 16:01:45,682 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 16:01:45,695 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69afd3a3c9209b146d8e1d68 HTTP/1.1" 200 None 2026-03-14 16:01:45,697 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 16:01:45,717 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b2e3634bce73bcf0235752 HTTP/1.1" 200 None 2026-03-14 16:01:45,718 - lava_callback - ERROR - Error processing callback for node 69b2e3634bce73bcf0235752: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:38862 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58750 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50100 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40828 - "GET /api/metrics HTTP/1.0" 200 OK 2026-03-14 16:02:15,415 - lava_callback - INFO - Received callback for node 69b2e3844bce73bcf023575e INFO: 172.21.0.1:40832 - "POST /node/69b2e3844bce73bcf023575e HTTP/1.0" 202 Accepted 2026-03-14 16:02:15,421 - lava_callback - INFO - Starting async job submit for node 69b2e3844bce73bcf023575e 2026-03-14 16:02:15,421 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 16:02:15,436 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b2e3844bce73bcf023575e HTTP/1.1" 200 None 2026-03-14 16:02:15,437 - lava_callback - DEBUG - Processing node 69b2e3844bce73bcf023575e: baseline-arm-baylibre 2026-03-14 16:02:15,437 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b2e3844bce73bcf023575e 2026-03-14 16:02:15,438 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 16:02:15,455 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b2e3844bce73bcf023575e HTTP/1.1" 200 None 2026-03-14 16:02:15,456 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 16:02:15,470 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ad30bced37758c525e15d2 HTTP/1.1" 200 None 2026-03-14 16:02:15,471 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 16:02:15,494 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b2e3844bce73bcf023575e HTTP/1.1" 200 None 2026-03-14 16:02:15,496 - lava_callback - ERROR - Error processing callback for node 69b2e3844bce73bcf023575e: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:40844 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44180 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44392 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45828 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45842 - "GET / HTTP/1.0" 200 OK 2026-03-14 16:02:55,210 - lava_callback - INFO - Received callback for node 69b2e3a84bce73bcf023576b INFO: 172.21.0.1:32834 - "POST /node/69b2e3a84bce73bcf023576b HTTP/1.0" 202 Accepted 2026-03-14 16:02:55,216 - lava_callback - INFO - Starting async job submit for node 69b2e3a84bce73bcf023576b 2026-03-14 16:02:55,217 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 16:02:55,231 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b2e3a84bce73bcf023576b HTTP/1.1" 200 None 2026-03-14 16:02:55,232 - lava_callback - DEBUG - Processing node 69b2e3a84bce73bcf023576b: baseline-arm-baylibre 2026-03-14 16:02:55,232 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b2e3a84bce73bcf023576b 2026-03-14 16:02:55,233 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 16:02:55,246 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b2e3a84bce73bcf023576b HTTP/1.1" 200 None 2026-03-14 16:02:55,247 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 16:02:55,260 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ad30bced37758c525e15d2 HTTP/1.1" 200 None 2026-03-14 16:02:55,262 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 16:02:55,283 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b2e3a84bce73bcf023576b HTTP/1.1" 200 None 2026-03-14 16:02:55,284 - lava_callback - ERROR - Error processing callback for node 69b2e3a84bce73bcf023576b: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:32850 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55808 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43890 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:43896 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58008 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43158 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33548 - "GET / HTTP/1.0" 200 OK 2026-03-14 16:03:45,735 - lava_callback - INFO - Received callback for node 69b2e3cf4bce73bcf0235773 INFO: 172.21.0.1:33562 - "POST /node/69b2e3cf4bce73bcf0235773 HTTP/1.0" 202 Accepted 2026-03-14 16:03:45,741 - lava_callback - INFO - Starting async job submit for node 69b2e3cf4bce73bcf0235773 2026-03-14 16:03:45,742 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 16:03:45,756 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b2e3cf4bce73bcf0235773 HTTP/1.1" 200 None 2026-03-14 16:03:45,757 - lava_callback - DEBUG - Processing node 69b2e3cf4bce73bcf0235773: baseline-arm-clabbe 2026-03-14 16:03:45,757 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b2e3cf4bce73bcf0235773 2026-03-14 16:03:45,758 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 16:03:45,771 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b2e3cf4bce73bcf0235773 HTTP/1.1" 200 None 2026-03-14 16:03:45,772 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 16:03:45,786 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69afd3a3c9209b146d8e1d68 HTTP/1.1" 200 None 2026-03-14 16:03:45,787 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 16:03:45,808 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b2e3cf4bce73bcf0235773 HTTP/1.1" 200 None 2026-03-14 16:03:45,816 - lava_callback - ERROR - Error processing callback for node 69b2e3cf4bce73bcf0235773: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:33568 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48446 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35408 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58824 - "GET /api/metrics HTTP/1.0" 200 OK 2026-03-14 16:04:15,417 - lava_callback - INFO - Received callback for node 69b2e3f24bce73bcf023577c INFO: 172.21.0.1:58836 - "POST /node/69b2e3f24bce73bcf023577c HTTP/1.0" 202 Accepted 2026-03-14 16:04:15,423 - lava_callback - INFO - Starting async job submit for node 69b2e3f24bce73bcf023577c 2026-03-14 16:04:15,424 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 16:04:15,438 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b2e3f24bce73bcf023577c HTTP/1.1" 200 None 2026-03-14 16:04:15,439 - lava_callback - DEBUG - Processing node 69b2e3f24bce73bcf023577c: baseline-arm-baylibre 2026-03-14 16:04:15,439 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b2e3f24bce73bcf023577c 2026-03-14 16:04:15,440 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 16:04:15,453 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b2e3f24bce73bcf023577c HTTP/1.1" 200 None 2026-03-14 16:04:15,454 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 16:04:15,467 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ad30bced37758c525e15d2 HTTP/1.1" 200 None 2026-03-14 16:04:15,469 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 16:04:15,491 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b2e3f24bce73bcf023577c HTTP/1.1" 200 None 2026-03-14 16:04:15,493 - lava_callback - ERROR - Error processing callback for node 69b2e3f24bce73bcf023577c: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:58840 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35022 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60944 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60414 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60428 - "GET / HTTP/1.0" 200 OK 2026-03-14 16:04:55,328 - lava_callback - INFO - Received callback for node 69b2e4134bce73bcf0235787 INFO: 172.21.0.1:46324 - "POST /node/69b2e4134bce73bcf0235787 HTTP/1.0" 202 Accepted 2026-03-14 16:04:55,334 - lava_callback - INFO - Starting async job submit for node 69b2e4134bce73bcf0235787 2026-03-14 16:04:55,335 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 16:04:55,350 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b2e4134bce73bcf0235787 HTTP/1.1" 200 None 2026-03-14 16:04:55,351 - lava_callback - DEBUG - Processing node 69b2e4134bce73bcf0235787: baseline-arm-baylibre 2026-03-14 16:04:55,351 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b2e4134bce73bcf0235787 2026-03-14 16:04:55,351 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 16:04:55,365 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b2e4134bce73bcf0235787 HTTP/1.1" 200 None 2026-03-14 16:04:55,367 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 16:04:55,381 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ad30bced37758c525e15d2 HTTP/1.1" 200 None 2026-03-14 16:04:55,382 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 16:04:55,410 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b2e4134bce73bcf0235787 HTTP/1.1" 200 None 2026-03-14 16:04:55,415 - lava_callback - ERROR - Error processing callback for node 69b2e4134bce73bcf0235787: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:46326 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54276 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54922 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:54928 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43344 - "GET / HTTP/1.0" 200 OK 2026-03-14 16:05:35,413 - lava_callback - INFO - Received callback for node 69b2e43a4bce73bcf0235795 INFO: 172.21.0.1:36748 - "POST /node/69b2e43a4bce73bcf0235795 HTTP/1.0" 202 Accepted 2026-03-14 16:05:35,418 - lava_callback - INFO - Starting async job submit for node 69b2e43a4bce73bcf0235795 2026-03-14 16:05:35,419 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 16:05:35,434 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b2e43a4bce73bcf0235795 HTTP/1.1" 200 None 2026-03-14 16:05:35,435 - lava_callback - DEBUG - Processing node 69b2e43a4bce73bcf0235795: baseline-arm-baylibre 2026-03-14 16:05:35,435 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b2e43a4bce73bcf0235795 2026-03-14 16:05:35,436 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 16:05:35,455 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b2e43a4bce73bcf0235795 HTTP/1.1" 200 None 2026-03-14 16:05:35,456 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 16:05:35,471 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ad30bced37758c525e15d2 HTTP/1.1" 200 None 2026-03-14 16:05:35,472 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 16:05:35,492 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b2e43a4bce73bcf0235795 HTTP/1.1" 200 None 2026-03-14 16:05:35,511 - lava_callback - ERROR - Error processing callback for node 69b2e43a4bce73bcf0235795: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:36750 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45894 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45904 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53436 - "GET / HTTP/1.0" 200 OK 2026-03-14 16:06:05,874 - lava_callback - INFO - Received callback for node 69b2e4604bce73bcf02357a2 INFO: 172.21.0.1:58748 - "POST /node/69b2e4604bce73bcf02357a2 HTTP/1.0" 202 Accepted 2026-03-14 16:06:05,879 - lava_callback - INFO - Starting async job submit for node 69b2e4604bce73bcf02357a2 2026-03-14 16:06:05,880 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 16:06:05,925 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b2e4604bce73bcf02357a2 HTTP/1.1" 200 None 2026-03-14 16:06:05,926 - lava_callback - DEBUG - Processing node 69b2e4604bce73bcf02357a2: baseline-arm-clabbe 2026-03-14 16:06:05,926 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b2e4604bce73bcf02357a2 2026-03-14 16:06:05,927 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 16:06:05,944 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b2e4604bce73bcf02357a2 HTTP/1.1" 200 None 2026-03-14 16:06:05,945 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 16:06:05,959 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ad30bced37758c525e15d2 HTTP/1.1" 200 None 2026-03-14 16:06:05,960 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 16:06:05,987 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b2e4604bce73bcf02357a2 HTTP/1.1" 200 None 2026-03-14 16:06:05,993 - lava_callback - ERROR - Error processing callback for node 69b2e4604bce73bcf02357a2: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:58758 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34136 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:34148 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45222 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40938 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46870 - "GET / HTTP/1.0" 200 OK 2026-03-14 16:06:45,819 - lava_callback - INFO - Received callback for node 69b2e4844bce73bcf02357ac INFO: 172.21.0.1:46886 - "POST /node/69b2e4844bce73bcf02357ac HTTP/1.0" 202 Accepted 2026-03-14 16:06:45,825 - lava_callback - INFO - Starting async job submit for node 69b2e4844bce73bcf02357ac 2026-03-14 16:06:45,825 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 16:06:45,842 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b2e4844bce73bcf02357ac HTTP/1.1" 200 None 2026-03-14 16:06:45,843 - lava_callback - DEBUG - Processing node 69b2e4844bce73bcf02357ac: baseline-arm-clabbe 2026-03-14 16:06:45,843 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b2e4844bce73bcf02357ac 2026-03-14 16:06:45,844 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 16:06:45,857 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b2e4844bce73bcf02357ac HTTP/1.1" 200 None 2026-03-14 16:06:45,859 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 16:06:45,872 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ad30bced37758c525e15d2 HTTP/1.1" 200 None 2026-03-14 16:06:45,874 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 16:06:45,894 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b2e4844bce73bcf02357ac HTTP/1.1" 200 None 2026-03-14 16:06:45,900 - lava_callback - ERROR - Error processing callback for node 69b2e4844bce73bcf02357ac: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:46896 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:32986 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39812 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40358 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:40368 - "GET / HTTP/1.0" 200 OK 2026-03-14 16:07:25,867 - lava_callback - INFO - Received callback for node 69b2e4a94bce73bcf02357b9 INFO: 172.21.0.1:50408 - "POST /node/69b2e4a94bce73bcf02357b9 HTTP/1.0" 202 Accepted 2026-03-14 16:07:25,872 - lava_callback - INFO - Starting async job submit for node 69b2e4a94bce73bcf02357b9 2026-03-14 16:07:25,873 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 16:07:25,887 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b2e4a94bce73bcf02357b9 HTTP/1.1" 200 None 2026-03-14 16:07:25,888 - lava_callback - DEBUG - Processing node 69b2e4a94bce73bcf02357b9: baseline-arm-clabbe 2026-03-14 16:07:25,888 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b2e4a94bce73bcf02357b9 2026-03-14 16:07:25,889 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 16:07:25,905 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b2e4a94bce73bcf02357b9 HTTP/1.1" 200 None 2026-03-14 16:07:25,907 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 16:07:25,927 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ad30bced37758c525e15d2 HTTP/1.1" 200 None 2026-03-14 16:07:25,928 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 16:07:25,948 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b2e4a94bce73bcf02357b9 HTTP/1.1" 200 None 2026-03-14 16:07:25,949 - lava_callback - ERROR - Error processing callback for node 69b2e4a94bce73bcf02357b9: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:50420 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41206 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36104 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36106 - "GET / HTTP/1.0" 200 OK 2026-03-14 16:07:55,580 - lava_callback - INFO - Received callback for node 69b2e4cc4bce73bcf02357c5 INFO: 172.21.0.1:46484 - "POST /node/69b2e4cc4bce73bcf02357c5 HTTP/1.0" 202 Accepted 2026-03-14 16:07:55,586 - lava_callback - INFO - Starting async job submit for node 69b2e4cc4bce73bcf02357c5 2026-03-14 16:07:55,587 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 16:07:55,601 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b2e4cc4bce73bcf02357c5 HTTP/1.1" 200 None 2026-03-14 16:07:55,602 - lava_callback - DEBUG - Processing node 69b2e4cc4bce73bcf02357c5: baseline-arm-baylibre 2026-03-14 16:07:55,602 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b2e4cc4bce73bcf02357c5 2026-03-14 16:07:55,603 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 16:07:55,615 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b2e4cc4bce73bcf02357c5 HTTP/1.1" 200 None 2026-03-14 16:07:55,617 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 16:07:55,629 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ad30bced37758c525e15d2 HTTP/1.1" 200 None 2026-03-14 16:07:55,631 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 16:07:55,651 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b2e4cc4bce73bcf02357c5 HTTP/1.1" 200 None 2026-03-14 16:07:55,656 - lava_callback - ERROR - Error processing callback for node 69b2e4cc4bce73bcf02357c5: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:46494 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58560 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38890 - "GET /api/metrics HTTP/1.0" 200 OK 2026-03-14 16:08:15,487 - lava_callback - INFO - Received callback for node 69b2e4ed4bce73bcf02357ce INFO: 172.21.0.1:38894 - "POST /node/69b2e4ed4bce73bcf02357ce HTTP/1.0" 202 Accepted 2026-03-14 16:08:15,492 - lava_callback - INFO - Starting async job submit for node 69b2e4ed4bce73bcf02357ce 2026-03-14 16:08:15,493 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 16:08:15,509 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b2e4ed4bce73bcf02357ce HTTP/1.1" 200 None 2026-03-14 16:08:15,510 - lava_callback - DEBUG - Processing node 69b2e4ed4bce73bcf02357ce: baseline-arm-baylibre 2026-03-14 16:08:15,511 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b2e4ed4bce73bcf02357ce 2026-03-14 16:08:15,511 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 16:08:15,524 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b2e4ed4bce73bcf02357ce HTTP/1.1" 200 None 2026-03-14 16:08:15,525 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 16:08:15,555 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ad30bced37758c525e15d2 HTTP/1.1" 200 None 2026-03-14 16:08:15,557 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 16:08:15,578 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b2e4ed4bce73bcf02357ce HTTP/1.1" 200 None 2026-03-14 16:08:15,579 - lava_callback - ERROR - Error processing callback for node 69b2e4ed4bce73bcf02357ce: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:38896 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41988 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42848 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39862 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39870 - "GET / HTTP/1.0" 200 OK 2026-03-14 16:08:55,555 - lava_callback - INFO - Received callback for node 69b2e5124bce73bcf02357db INFO: 172.21.0.1:48956 - "POST /node/69b2e5124bce73bcf02357db HTTP/1.0" 202 Accepted 2026-03-14 16:08:55,561 - lava_callback - INFO - Starting async job submit for node 69b2e5124bce73bcf02357db 2026-03-14 16:08:55,562 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 16:08:55,578 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b2e5124bce73bcf02357db HTTP/1.1" 200 None 2026-03-14 16:08:55,579 - lava_callback - DEBUG - Processing node 69b2e5124bce73bcf02357db: baseline-arm-baylibre 2026-03-14 16:08:55,580 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b2e5124bce73bcf02357db 2026-03-14 16:08:55,580 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 16:08:55,597 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b2e5124bce73bcf02357db HTTP/1.1" 200 None 2026-03-14 16:08:55,598 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 16:08:55,615 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ad30bced37758c525e15d2 HTTP/1.1" 200 None 2026-03-14 16:08:55,617 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 16:08:55,639 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b2e5124bce73bcf02357db HTTP/1.1" 200 None 2026-03-14 16:08:55,640 - lava_callback - ERROR - Error processing callback for node 69b2e5124bce73bcf02357db: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:48966 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53008 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59888 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:59902 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51484 - "GET / HTTP/1.0" 200 OK 2026-03-14 16:09:35,702 - lava_callback - INFO - Received callback for node 69b2e5354bce73bcf02357e4 INFO: 172.21.0.1:35716 - "POST /node/69b2e5354bce73bcf02357e4 HTTP/1.0" 202 Accepted 2026-03-14 16:09:35,707 - lava_callback - INFO - Starting async job submit for node 69b2e5354bce73bcf02357e4 2026-03-14 16:09:35,708 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 16:09:35,722 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b2e5354bce73bcf02357e4 HTTP/1.1" 200 None 2026-03-14 16:09:35,723 - lava_callback - DEBUG - Processing node 69b2e5354bce73bcf02357e4: baseline-arm-baylibre 2026-03-14 16:09:35,724 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b2e5354bce73bcf02357e4 2026-03-14 16:09:35,724 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 16:09:35,740 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b2e5354bce73bcf02357e4 HTTP/1.1" 200 None 2026-03-14 16:09:35,741 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 16:09:35,755 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ad30bced37758c525e15d2 HTTP/1.1" 200 None 2026-03-14 16:09:35,756 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 16:09:35,776 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b2e5354bce73bcf02357e4 HTTP/1.1" 200 None 2026-03-14 16:09:35,778 - lava_callback - ERROR - Error processing callback for node 69b2e5354bce73bcf02357e4: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:35720 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37280 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37288 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56072 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53734 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35828 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:35836 - "GET / HTTP/1.0" 200 OK 2026-03-14 16:10:26,012 - lava_callback - INFO - Received callback for node 69b2e55d4bce73bcf02357f0 INFO: 172.21.0.1:39370 - "POST /node/69b2e55d4bce73bcf02357f0 HTTP/1.0" 202 Accepted 2026-03-14 16:10:26,017 - lava_callback - INFO - Starting async job submit for node 69b2e55d4bce73bcf02357f0 2026-03-14 16:10:26,018 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 16:10:26,065 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b2e55d4bce73bcf02357f0 HTTP/1.1" 200 None 2026-03-14 16:10:26,066 - lava_callback - DEBUG - Processing node 69b2e55d4bce73bcf02357f0: baseline-arm-clabbe 2026-03-14 16:10:26,066 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b2e55d4bce73bcf02357f0 2026-03-14 16:10:26,067 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 16:10:26,086 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b2e55d4bce73bcf02357f0 HTTP/1.1" 200 None 2026-03-14 16:10:26,088 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 16:10:26,101 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ad30bced37758c525e15d2 HTTP/1.1" 200 None 2026-03-14 16:10:26,103 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 16:10:26,125 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b2e55d4bce73bcf02357f0 HTTP/1.1" 200 None 2026-03-14 16:10:26,126 - lava_callback - ERROR - Error processing callback for node 69b2e55d4bce73bcf02357f0: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:39386 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34058 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49804 - "GET / HTTP/1.0" 200 OK 2026-03-14 16:10:45,981 - lava_callback - INFO - Received callback for node 69b2e5834bce73bcf02357fa INFO: 172.21.0.1:49810 - "POST /node/69b2e5834bce73bcf02357fa HTTP/1.0" 202 Accepted 2026-03-14 16:10:45,987 - lava_callback - INFO - Starting async job submit for node 69b2e5834bce73bcf02357fa 2026-03-14 16:10:45,987 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 16:10:46,005 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b2e5834bce73bcf02357fa HTTP/1.1" 200 None 2026-03-14 16:10:46,006 - lava_callback - DEBUG - Processing node 69b2e5834bce73bcf02357fa: baseline-arm-clabbe 2026-03-14 16:10:46,007 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b2e5834bce73bcf02357fa 2026-03-14 16:10:46,007 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 16:10:46,020 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b2e5834bce73bcf02357fa HTTP/1.1" 200 None 2026-03-14 16:10:46,022 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 16:10:46,035 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ad30bced37758c525e15d2 HTTP/1.1" 200 None 2026-03-14 16:10:46,036 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 16:10:46,057 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b2e5834bce73bcf02357fa HTTP/1.1" 200 None 2026-03-14 16:10:46,066 - lava_callback - ERROR - Error processing callback for node 69b2e5834bce73bcf02357fa: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:49816 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60246 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37002 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35518 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:35524 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58934 - "GET / HTTP/1.0" 200 OK 2026-03-14 16:11:35,755 - lava_callback - INFO - Received callback for node 69b2e5a34bce73bcf0235802 INFO: 172.21.0.1:50874 - "POST /node/69b2e5a34bce73bcf0235802 HTTP/1.0" 202 Accepted 2026-03-14 16:11:35,760 - lava_callback - INFO - Starting async job submit for node 69b2e5a34bce73bcf0235802 2026-03-14 16:11:35,761 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 16:11:35,775 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b2e5a34bce73bcf0235802 HTTP/1.1" 200 None 2026-03-14 16:11:35,776 - lava_callback - DEBUG - Processing node 69b2e5a34bce73bcf0235802: baseline-arm-baylibre 2026-03-14 16:11:35,776 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b2e5a34bce73bcf0235802 2026-03-14 16:11:35,777 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 16:11:35,802 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b2e5a34bce73bcf0235802 HTTP/1.1" 200 None 2026-03-14 16:11:35,804 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 16:11:35,817 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69afd826ae557f2600f0f036 HTTP/1.1" 200 None 2026-03-14 16:11:35,819 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 16:11:35,840 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b2e5a34bce73bcf0235802 HTTP/1.1" 200 None 2026-03-14 16:11:35,842 - lava_callback - ERROR - Error processing callback for node 69b2e5a34bce73bcf0235802: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:50886 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56752 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56766 - "GET / HTTP/1.0" 200 OK 2026-03-14 16:11:55,713 - lava_callback - INFO - Received callback for node 69b2e5c74bce73bcf023580c INFO: 172.21.0.1:52230 - "POST /node/69b2e5c74bce73bcf023580c HTTP/1.0" 202 Accepted 2026-03-14 16:11:55,718 - lava_callback - INFO - Starting async job submit for node 69b2e5c74bce73bcf023580c 2026-03-14 16:11:55,719 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 16:11:55,746 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b2e5c74bce73bcf023580c HTTP/1.1" 200 None 2026-03-14 16:11:55,747 - lava_callback - DEBUG - Processing node 69b2e5c74bce73bcf023580c: baseline-arm-baylibre 2026-03-14 16:11:55,747 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b2e5c74bce73bcf023580c 2026-03-14 16:11:55,748 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 16:11:55,761 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b2e5c74bce73bcf023580c HTTP/1.1" 200 None 2026-03-14 16:11:55,762 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 16:11:55,775 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69afd826ae557f2600f0f036 HTTP/1.1" 200 None 2026-03-14 16:11:55,777 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 16:11:55,796 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b2e5c74bce73bcf023580c HTTP/1.1" 200 None 2026-03-14 16:11:55,798 - lava_callback - ERROR - Error processing callback for node 69b2e5c74bce73bcf023580c: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:52234 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38840 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46458 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:46470 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46756 - "GET / HTTP/1.0" 200 OK 2026-03-14 16:12:35,731 - lava_callback - INFO - Received callback for node 69b2e5ee4bce73bcf0235816 INFO: 172.21.0.1:60932 - "POST /node/69b2e5ee4bce73bcf0235816 HTTP/1.0" 202 Accepted 2026-03-14 16:12:35,738 - lava_callback - INFO - Starting async job submit for node 69b2e5ee4bce73bcf0235816 2026-03-14 16:12:35,739 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 16:12:35,754 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b2e5ee4bce73bcf0235816 HTTP/1.1" 200 None 2026-03-14 16:12:35,755 - lava_callback - DEBUG - Processing node 69b2e5ee4bce73bcf0235816: baseline-arm-baylibre 2026-03-14 16:12:35,755 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b2e5ee4bce73bcf0235816 2026-03-14 16:12:35,756 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 16:12:35,776 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b2e5ee4bce73bcf0235816 HTTP/1.1" 200 None 2026-03-14 16:12:35,778 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 16:12:35,791 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ad30bced37758c525e15d2 HTTP/1.1" 200 None 2026-03-14 16:12:35,793 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 16:12:35,815 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b2e5ee4bce73bcf0235816 HTTP/1.1" 200 None 2026-03-14 16:12:35,816 - lava_callback - ERROR - Error processing callback for node 69b2e5ee4bce73bcf0235816: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:60934 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44158 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44174 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36754 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34668 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37960 - "GET /api/metrics HTTP/1.0" 200 OK 2026-03-14 16:13:15,976 - lava_callback - INFO - Received callback for node 69b2e6104bce73bcf0235821 INFO: 172.21.0.1:37970 - "POST /node/69b2e6104bce73bcf0235821 HTTP/1.0" 202 Accepted 2026-03-14 16:13:15,982 - lava_callback - INFO - Starting async job submit for node 69b2e6104bce73bcf0235821 2026-03-14 16:13:15,983 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 16:13:16,021 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b2e6104bce73bcf0235821 HTTP/1.1" 200 None 2026-03-14 16:13:16,022 - lava_callback - DEBUG - Processing node 69b2e6104bce73bcf0235821: baseline-arm-baylibre 2026-03-14 16:13:16,022 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b2e6104bce73bcf0235821 2026-03-14 16:13:16,023 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 16:13:16,036 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b2e6104bce73bcf0235821 HTTP/1.1" 200 None 2026-03-14 16:13:16,038 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 16:13:16,139 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69afd826ae557f2600f0f036 HTTP/1.1" 200 None 2026-03-14 16:13:16,140 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 16:13:16,161 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b2e6104bce73bcf0235821 HTTP/1.1" 200 None 2026-03-14 16:13:16,166 - lava_callback - ERROR - Error processing callback for node 69b2e6104bce73bcf0235821: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:37982 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57948 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58554 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47464 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47472 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34288 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42916 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47580 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:47582 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35186 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57454 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42146 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42148 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37612 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40464 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37210 - "GET /api/metrics HTTP/1.0" 200 OK 2026-03-14 16:15:15,960 - lava_callback - INFO - Received callback for node 69b2e6906267e2e450f02108 INFO: 172.21.0.1:37214 - "POST /node/69b2e6906267e2e450f02108 HTTP/1.0" 202 Accepted 2026-03-14 16:15:15,965 - lava_callback - INFO - Starting async job submit for node 69b2e6906267e2e450f02108 2026-03-14 16:15:15,966 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 16:15:15,980 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b2e6906267e2e450f02108 HTTP/1.1" 200 None 2026-03-14 16:15:15,981 - lava_callback - DEBUG - Processing node 69b2e6906267e2e450f02108: baseline-arm64-baylibre 2026-03-14 16:15:15,981 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b2e6906267e2e450f02108 2026-03-14 16:15:15,982 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 16:15:15,995 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b2e6906267e2e450f02108 HTTP/1.1" 200 None 2026-03-14 16:15:15,996 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 16:15:16,014 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69afd839ae557f2600f0f045 HTTP/1.1" 200 None 2026-03-14 16:15:16,016 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 16:15:16,038 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b2e6906267e2e450f02108 HTTP/1.1" 200 None 2026-03-14 16:15:16,044 - lava_callback - ERROR - Error processing callback for node 69b2e6906267e2e450f02108: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:37216 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57450 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59176 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46156 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46162 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50302 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47572 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55626 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:55642 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:32884 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43814 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46720 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46736 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45278 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50500 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46704 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:46714 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37446 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55704 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43250 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43264 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58774 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48882 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48798 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:48806 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41048 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34262 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52710 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52716 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44790 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56824 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53166 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:53176 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33102 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48072 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53668 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53678 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44998 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55116 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38344 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:38348 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:32814 - "GET / HTTP/1.0" 200 OK 2026-03-14 16:20:36,253 - lava_callback - INFO - Received callback for node 69b2e7c06267e2e450f02160 INFO: 172.21.0.1:44124 - "POST /node/69b2e7c06267e2e450f02160 HTTP/1.0" 202 Accepted 2026-03-14 16:20:36,258 - lava_callback - INFO - Starting async job submit for node 69b2e7c06267e2e450f02160 2026-03-14 16:20:36,259 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 16:20:36,273 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b2e7c06267e2e450f02160 HTTP/1.1" 200 None 2026-03-14 16:20:36,274 - lava_callback - DEBUG - Processing node 69b2e7c06267e2e450f02160: baseline-arm64-baylibre 2026-03-14 16:20:36,274 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b2e7c06267e2e450f02160 2026-03-14 16:20:36,275 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 16:20:36,289 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b2e7c06267e2e450f02160 HTTP/1.1" 200 None 2026-03-14 16:20:36,291 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 16:20:36,307 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ad30c9ed37758c525e15e4 HTTP/1.1" 200 None 2026-03-14 16:20:36,309 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 16:20:36,331 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b2e7c06267e2e450f02160 HTTP/1.1" 200 None 2026-03-14 16:20:36,336 - lava_callback - ERROR - Error processing callback for node 69b2e7c06267e2e450f02160: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:44134 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42382 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42384 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55468 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55928 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39620 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:39636 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58528 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55346 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48694 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48704 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:32926 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51298 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51820 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:51826 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52284 - "GET / HTTP/1.0" 200 OK 2026-03-14 16:22:36,336 - lava_callback - INFO - Received callback for node 69b2e8376267e2e450f0216d INFO: 172.21.0.1:37894 - "POST /node/69b2e8376267e2e450f0216d HTTP/1.0" 202 Accepted 2026-03-14 16:22:36,343 - lava_callback - INFO - Starting async job submit for node 69b2e8376267e2e450f0216d 2026-03-14 16:22:36,343 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 16:22:36,357 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b2e8376267e2e450f0216d HTTP/1.1" 200 None 2026-03-14 16:22:36,358 - lava_callback - DEBUG - Processing node 69b2e8376267e2e450f0216d: baseline-arm64-baylibre 2026-03-14 16:22:36,358 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b2e8376267e2e450f0216d 2026-03-14 16:22:36,359 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 16:22:36,377 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b2e8376267e2e450f0216d HTTP/1.1" 200 None 2026-03-14 16:22:36,379 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 16:22:36,392 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69afd839ae557f2600f0f045 HTTP/1.1" 200 None 2026-03-14 16:22:36,394 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 16:22:36,434 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b2e8376267e2e450f0216d HTTP/1.1" 200 None 2026-03-14 16:22:36,436 - lava_callback - ERROR - Error processing callback for node 69b2e8376267e2e450f0216d: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:37910 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45994 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46010 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38490 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58726 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41264 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:41266 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49970 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58228 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35736 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35746 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33712 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53750 - "GET / HTTP/1.0" 200 OK 2026-03-14 16:24:06,610 - lava_callback - INFO - Received callback for node 69b2e8916267e2e450f02178 INFO: 172.21.0.1:53766 - "POST /node/69b2e8916267e2e450f02178 HTTP/1.0" 202 Accepted 2026-03-14 16:24:06,616 - lava_callback - INFO - Starting async job submit for node 69b2e8916267e2e450f02178 2026-03-14 16:24:06,616 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 16:24:06,636 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b2e8916267e2e450f02178 HTTP/1.1" 200 None 2026-03-14 16:24:06,637 - lava_callback - DEBUG - Processing node 69b2e8916267e2e450f02178: baseline-arm64-clabbe 2026-03-14 16:24:06,637 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b2e8916267e2e450f02178 2026-03-14 16:24:06,638 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 16:24:06,651 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b2e8916267e2e450f02178 HTTP/1.1" 200 None 2026-03-14 16:24:06,653 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 16:24:06,666 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69afd839ae557f2600f0f045 HTTP/1.1" 200 None 2026-03-14 16:24:06,667 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 16:24:06,689 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b2e8916267e2e450f02178 HTTP/1.1" 200 None 2026-03-14 16:24:06,690 - lava_callback - ERROR - Error processing callback for node 69b2e8916267e2e450f02178: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:56894 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:56904 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54690 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40388 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43084 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43098 - "GET / HTTP/1.0" 200 OK 2026-03-14 16:24:56,468 - lava_callback - INFO - Received callback for node 69b2e8d66267e2e450f02181 INFO: 172.21.0.1:47386 - "POST /node/69b2e8d66267e2e450f02181 HTTP/1.0" 202 Accepted 2026-03-14 16:24:56,473 - lava_callback - INFO - Starting async job submit for node 69b2e8d66267e2e450f02181 2026-03-14 16:24:56,474 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 16:24:56,489 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b2e8d66267e2e450f02181 HTTP/1.1" 200 None 2026-03-14 16:24:56,489 - lava_callback - DEBUG - Processing node 69b2e8d66267e2e450f02181: baseline-arm64-baylibre 2026-03-14 16:24:56,490 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b2e8d66267e2e450f02181 2026-03-14 16:24:56,490 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 16:24:56,506 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b2e8d66267e2e450f02181 HTTP/1.1" 200 None 2026-03-14 16:24:56,508 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 16:24:56,521 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ad30c9ed37758c525e15e4 HTTP/1.1" 200 None 2026-03-14 16:24:56,523 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 INFO: 172.21.0.1:47400 - "GET / HTTP/1.0" 200 OK 2026-03-14 16:24:56,551 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b2e8d66267e2e450f02181 HTTP/1.1" 200 None 2026-03-14 16:24:56,553 - lava_callback - ERROR - Error processing callback for node 69b2e8d66267e2e450f02181: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:48574 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46184 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:46190 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52016 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43444 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39502 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39506 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37684 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40002 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60776 - "GET /api/metrics HTTP/1.0" 200 OK 2026-03-14 16:26:16,506 - lava_callback - INFO - Received callback for node 69b2e9206267e2e450f02190 INFO: 172.21.0.1:60778 - "POST /node/69b2e9206267e2e450f02190 HTTP/1.0" 202 Accepted 2026-03-14 16:26:16,512 - lava_callback - INFO - Starting async job submit for node 69b2e9206267e2e450f02190 2026-03-14 16:26:16,513 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 INFO: 172.21.0.1:60794 - "GET / HTTP/1.0" 200 OK 2026-03-14 16:26:16,528 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b2e9206267e2e450f02190 HTTP/1.1" 200 None 2026-03-14 16:26:16,529 - lava_callback - DEBUG - Processing node 69b2e9206267e2e450f02190: baseline-arm64-baylibre 2026-03-14 16:26:16,530 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b2e9206267e2e450f02190 2026-03-14 16:26:16,530 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 16:26:16,544 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b2e9206267e2e450f02190 HTTP/1.1" 200 None 2026-03-14 16:26:16,545 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 16:26:16,559 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ad30c9ed37758c525e15e4 HTTP/1.1" 200 None 2026-03-14 16:26:16,560 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 16:26:16,588 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b2e9206267e2e450f02190 HTTP/1.1" 200 None 2026-03-14 16:26:16,597 - lava_callback - ERROR - Error processing callback for node 69b2e9206267e2e450f02190: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:53592 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53054 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59344 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59360 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58438 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36398 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46874 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:46888 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52078 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43350 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55228 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55240 - "GET / HTTP/1.0" 200 OK 2026-03-14 16:27:46,718 - lava_callback - INFO - Received callback for node 69b2e9736267e2e450f021a2 INFO: 172.21.0.1:55246 - "POST /node/69b2e9736267e2e450f021a2 HTTP/1.0" 202 Accepted 2026-03-14 16:27:46,724 - lava_callback - INFO - Starting async job submit for node 69b2e9736267e2e450f021a2 2026-03-14 16:27:46,724 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 16:27:46,739 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b2e9736267e2e450f021a2 HTTP/1.1" 200 None 2026-03-14 16:27:46,740 - lava_callback - DEBUG - Processing node 69b2e9736267e2e450f021a2: baseline-arm64-clabbe 2026-03-14 16:27:46,740 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b2e9736267e2e450f021a2 2026-03-14 16:27:46,740 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 16:27:46,754 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b2e9736267e2e450f021a2 HTTP/1.1" 200 None 2026-03-14 16:27:46,756 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 16:27:46,769 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69afd839ae557f2600f0f045 HTTP/1.1" 200 None 2026-03-14 16:27:46,770 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 16:27:46,804 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b2e9736267e2e450f021a2 HTTP/1.1" 200 None 2026-03-14 16:27:46,805 - lava_callback - ERROR - Error processing callback for node 69b2e9736267e2e450f021a2: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:60988 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43754 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54492 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:54498 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38532 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50020 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53978 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53984 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54774 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38030 - "GET / HTTP/1.0" 200 OK 2026-03-14 16:29:06,754 - lava_callback - INFO - Received callback for node 69b2e9bf6267e2e450f021b0 INFO: 172.21.0.1:38036 - "POST /node/69b2e9bf6267e2e450f021b0 HTTP/1.0" 202 Accepted 2026-03-14 16:29:06,759 - lava_callback - INFO - Starting async job submit for node 69b2e9bf6267e2e450f021b0 2026-03-14 16:29:06,760 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 16:29:06,782 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b2e9bf6267e2e450f021b0 HTTP/1.1" 200 None 2026-03-14 16:29:06,782 - lava_callback - DEBUG - Processing node 69b2e9bf6267e2e450f021b0: baseline-arm64-clabbe 2026-03-14 16:29:06,783 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b2e9bf6267e2e450f021b0 2026-03-14 16:29:06,783 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 16:29:06,799 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b2e9bf6267e2e450f021b0 HTTP/1.1" 200 None 2026-03-14 16:29:06,800 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 16:29:06,813 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69afd839ae557f2600f0f045 HTTP/1.1" 200 None 2026-03-14 16:29:06,815 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 16:29:06,836 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b2e9bf6267e2e450f021b0 HTTP/1.1" 200 None 2026-03-14 16:29:06,845 - lava_callback - ERROR - Error processing callback for node 69b2e9bf6267e2e450f021b0: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:46712 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:46724 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50274 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54836 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56308 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56314 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50508 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39450 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54070 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:54072 - "GET / HTTP/1.0" 200 OK 2026-03-14 16:30:16,754 - lava_callback - INFO - Received callback for node 69b2ea046267e2e450f021bd INFO: 172.21.0.1:54082 - "POST /node/69b2ea046267e2e450f021bd HTTP/1.0" 202 Accepted 2026-03-14 16:30:16,759 - lava_callback - INFO - Starting async job submit for node 69b2ea046267e2e450f021bd 2026-03-14 16:30:16,760 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 16:30:16,781 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b2ea046267e2e450f021bd HTTP/1.1" 200 None 2026-03-14 16:30:16,782 - lava_callback - DEBUG - Processing node 69b2ea046267e2e450f021bd: baseline-arm64-baylibre 2026-03-14 16:30:16,782 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b2ea046267e2e450f021bd 2026-03-14 16:30:16,783 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 16:30:16,795 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b2ea046267e2e450f021bd HTTP/1.1" 200 None 2026-03-14 16:30:16,797 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 16:30:16,809 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ad30c9ed37758c525e15e4 HTTP/1.1" 200 None 2026-03-14 16:30:16,811 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 16:30:16,831 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b2ea046267e2e450f021bd HTTP/1.1" 200 None 2026-03-14 16:30:16,837 - lava_callback - ERROR - Error processing callback for node 69b2ea046267e2e450f021bd: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:40458 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43014 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41148 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41160 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44472 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58658 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47190 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:47194 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54018 - "GET / HTTP/1.0" 200 OK 2026-03-14 16:31:26,885 - lava_callback - INFO - Received callback for node 69b2ea556267e2e450f021d7 INFO: 172.21.0.1:54028 - "POST /node/69b2ea556267e2e450f021d7 HTTP/1.0" 202 Accepted 2026-03-14 16:31:26,891 - lava_callback - INFO - Starting async job submit for node 69b2ea556267e2e450f021d7 2026-03-14 16:31:26,892 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 16:31:26,907 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b2ea556267e2e450f021d7 HTTP/1.1" 200 None 2026-03-14 16:31:26,907 - lava_callback - DEBUG - Processing node 69b2ea556267e2e450f021d7: baseline-arm64-clabbe 2026-03-14 16:31:26,908 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b2ea556267e2e450f021d7 2026-03-14 16:31:26,908 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 16:31:26,922 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b2ea556267e2e450f021d7 HTTP/1.1" 200 None 2026-03-14 16:31:26,923 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 16:31:26,937 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69afd839ae557f2600f0f045 HTTP/1.1" 200 None 2026-03-14 16:31:26,938 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 16:31:26,969 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b2ea556267e2e450f021d7 HTTP/1.1" 200 None 2026-03-14 16:31:26,970 - lava_callback - ERROR - Error processing callback for node 69b2ea556267e2e450f021d7: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:48344 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36336 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36340 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38598 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53418 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34028 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:34040 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46012 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50812 - "GET / HTTP/1.0" 200 OK 2026-03-14 16:32:36,891 - lava_callback - INFO - Received callback for node 69b2ea9b6267e2e450f021ee INFO: 172.21.0.1:50826 - "POST /node/69b2ea9b6267e2e450f021ee HTTP/1.0" 202 Accepted 2026-03-14 16:32:36,896 - lava_callback - INFO - Starting async job submit for node 69b2ea9b6267e2e450f021ee 2026-03-14 16:32:36,897 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 16:32:36,912 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b2ea9b6267e2e450f021ee HTTP/1.1" 200 None 2026-03-14 16:32:36,912 - lava_callback - DEBUG - Processing node 69b2ea9b6267e2e450f021ee: baseline-arm64-baylibre 2026-03-14 16:32:36,913 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b2ea9b6267e2e450f021ee 2026-03-14 16:32:36,913 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 16:32:36,929 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b2ea9b6267e2e450f021ee HTTP/1.1" 200 None 2026-03-14 16:32:36,931 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 16:32:36,953 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ad30c9ed37758c525e15e4 HTTP/1.1" 200 None 2026-03-14 16:32:36,954 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 16:32:36,975 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b2ea9b6267e2e450f021ee HTTP/1.1" 200 None 2026-03-14 16:32:36,981 - lava_callback - ERROR - Error processing callback for node 69b2ea9b6267e2e450f021ee: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:57270 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57274 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50538 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49032 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54216 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:54218 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38688 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39654 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39456 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39468 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38620 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52206 - "GET / HTTP/1.0" 200 OK 2026-03-14 16:34:06,990 - lava_callback - INFO - Received callback for node 69b2eaeb6267e2e450f021f7 INFO: 172.21.0.1:52210 - "POST /node/69b2eaeb6267e2e450f021f7 HTTP/1.0" 202 Accepted 2026-03-14 16:34:06,995 - lava_callback - INFO - Starting async job submit for node 69b2eaeb6267e2e450f021f7 2026-03-14 16:34:06,996 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 16:34:07,010 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b2eaeb6267e2e450f021f7 HTTP/1.1" 200 None 2026-03-14 16:34:07,011 - lava_callback - DEBUG - Processing node 69b2eaeb6267e2e450f021f7: baseline-arm64-clabbe 2026-03-14 16:34:07,012 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b2eaeb6267e2e450f021f7 2026-03-14 16:34:07,012 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 16:34:07,045 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b2eaeb6267e2e450f021f7 HTTP/1.1" 200 None 2026-03-14 16:34:07,047 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 16:34:07,061 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ad30c9ed37758c525e15e4 HTTP/1.1" 200 None 2026-03-14 16:34:07,062 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 16:34:07,091 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b2eaeb6267e2e450f021f7 HTTP/1.1" 200 None 2026-03-14 16:34:07,093 - lava_callback - ERROR - Error processing callback for node 69b2eaeb6267e2e450f021f7: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:57122 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:57126 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40546 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48642 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48160 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48162 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59276 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42954 - "GET / HTTP/1.0" 200 OK 2026-03-14 16:35:07,071 - lava_callback - INFO - Received callback for node 69b2eb356267e2e450f02205 INFO: 172.21.0.1:42956 - "POST /node/69b2eb356267e2e450f02205 HTTP/1.0" 202 Accepted 2026-03-14 16:35:07,077 - lava_callback - INFO - Starting async job submit for node 69b2eb356267e2e450f02205 2026-03-14 16:35:07,079 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 16:35:07,101 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b2eb356267e2e450f02205 HTTP/1.1" 200 None 2026-03-14 16:35:07,102 - lava_callback - DEBUG - Processing node 69b2eb356267e2e450f02205: baseline-arm64-clabbe 2026-03-14 16:35:07,102 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b2eb356267e2e450f02205 2026-03-14 16:35:07,103 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 16:35:07,127 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b2eb356267e2e450f02205 HTTP/1.1" 200 None 2026-03-14 16:35:07,129 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 16:35:07,147 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69afd839ae557f2600f0f045 HTTP/1.1" 200 None 2026-03-14 16:35:07,149 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 16:35:07,170 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b2eb356267e2e450f02205 HTTP/1.1" 200 None 2026-03-14 16:35:07,175 - lava_callback - ERROR - Error processing callback for node 69b2eb356267e2e450f02205: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:33010 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:33026 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35736 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53960 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42204 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42210 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33856 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60334 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48838 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:48854 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36382 - "GET / HTTP/1.0" 200 OK 2026-03-14 16:36:27,113 - lava_callback - INFO - Received callback for node 69b2eb806267e2e450f0220c INFO: 172.21.0.1:36394 - "POST /node/69b2eb806267e2e450f0220c HTTP/1.0" 202 Accepted 2026-03-14 16:36:27,119 - lava_callback - INFO - Starting async job submit for node 69b2eb806267e2e450f0220c 2026-03-14 16:36:27,120 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 16:36:27,134 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b2eb806267e2e450f0220c HTTP/1.1" 200 None 2026-03-14 16:36:27,135 - lava_callback - DEBUG - Processing node 69b2eb806267e2e450f0220c: baseline-arm64-clabbe 2026-03-14 16:36:27,135 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b2eb806267e2e450f0220c 2026-03-14 16:36:27,136 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 16:36:27,275 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b2eb806267e2e450f0220c HTTP/1.1" 200 None 2026-03-14 16:36:27,277 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 16:36:27,291 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69afd839ae557f2600f0f045 HTTP/1.1" 200 None 2026-03-14 16:36:27,292 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 16:36:27,328 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b2eb806267e2e450f0220c HTTP/1.1" 200 None 2026-03-14 16:36:27,334 - lava_callback - ERROR - Error processing callback for node 69b2eb806267e2e450f0220c: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:56200 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34594 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34598 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49300 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60784 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42768 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:42778 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53594 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60198 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57700 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57714 - "GET / HTTP/1.0" 200 OK 2026-03-14 16:37:47,142 - lava_callback - INFO - Received callback for node 69b2ebca6267e2e450f0221a INFO: 172.21.0.1:57722 - "POST /node/69b2ebca6267e2e450f0221a HTTP/1.0" 202 Accepted 2026-03-14 16:37:47,148 - lava_callback - INFO - Starting async job submit for node 69b2ebca6267e2e450f0221a 2026-03-14 16:37:47,149 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 16:37:47,167 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b2ebca6267e2e450f0221a HTTP/1.1" 200 None 2026-03-14 16:37:47,168 - lava_callback - DEBUG - Processing node 69b2ebca6267e2e450f0221a: baseline-arm64-clabbe 2026-03-14 16:37:47,168 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b2ebca6267e2e450f0221a 2026-03-14 16:37:47,169 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 16:37:47,182 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b2ebca6267e2e450f0221a HTTP/1.1" 200 None 2026-03-14 16:37:47,184 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 16:37:47,197 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ad30c9ed37758c525e15e4 HTTP/1.1" 200 None 2026-03-14 16:37:47,199 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 16:37:47,219 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b2ebca6267e2e450f0221a HTTP/1.1" 200 None 2026-03-14 16:37:47,224 - lava_callback - ERROR - Error processing callback for node 69b2ebca6267e2e450f0221a: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:47894 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44996 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39916 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:39918 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38122 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38408 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40288 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40292 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33136 - "GET / HTTP/1.0" 200 OK 2026-03-14 16:38:57,314 - lava_callback - INFO - Received callback for node 69b2ec0d6267e2e450f02224 INFO: 172.21.0.1:33150 - "POST /node/69b2ec0d6267e2e450f02224 HTTP/1.0" 202 Accepted 2026-03-14 16:38:57,320 - lava_callback - INFO - Starting async job submit for node 69b2ec0d6267e2e450f02224 2026-03-14 16:38:57,321 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 16:38:57,334 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b2ec0d6267e2e450f02224 HTTP/1.1" 200 None 2026-03-14 16:38:57,335 - lava_callback - DEBUG - Processing node 69b2ec0d6267e2e450f02224: baseline-arm64-baylibre 2026-03-14 16:38:57,335 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b2ec0d6267e2e450f02224 2026-03-14 16:38:57,336 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 16:38:57,349 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b2ec0d6267e2e450f02224 HTTP/1.1" 200 None 2026-03-14 16:38:57,351 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 16:38:57,364 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ad30c9ed37758c525e15e4 HTTP/1.1" 200 None 2026-03-14 16:38:57,366 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 16:38:57,386 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b2ec0d6267e2e450f02224 HTTP/1.1" 200 None 2026-03-14 16:38:57,387 - lava_callback - ERROR - Error processing callback for node 69b2ec0d6267e2e450f02224: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:46776 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43452 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:43464 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44414 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44536 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41832 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41848 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44916 - "GET / HTTP/1.0" 200 OK 2026-03-14 16:39:57,248 - lava_callback - INFO - Received callback for node 69b2ec5a6267e2e450f0222f INFO: 172.21.0.1:44926 - "POST /node/69b2ec5a6267e2e450f0222f HTTP/1.0" 202 Accepted 2026-03-14 16:39:57,254 - lava_callback - INFO - Starting async job submit for node 69b2ec5a6267e2e450f0222f 2026-03-14 16:39:57,254 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 16:39:57,272 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b2ec5a6267e2e450f0222f HTTP/1.1" 200 None 2026-03-14 16:39:57,273 - lava_callback - DEBUG - Processing node 69b2ec5a6267e2e450f0222f: baseline-arm64-baylibre 2026-03-14 16:39:57,273 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b2ec5a6267e2e450f0222f 2026-03-14 16:39:57,274 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 16:39:57,291 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b2ec5a6267e2e450f0222f HTTP/1.1" 200 None 2026-03-14 16:39:57,293 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 16:39:57,306 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ad30c9ed37758c525e15e4 HTTP/1.1" 200 None 2026-03-14 16:39:57,307 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 16:39:57,337 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b2ec5a6267e2e450f0222f HTTP/1.1" 200 None 2026-03-14 16:39:57,340 - lava_callback - ERROR - Error processing callback for node 69b2ec5a6267e2e450f0222f: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:57066 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45752 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:45758 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55188 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58018 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52360 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52368 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53018 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56678 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47044 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:47060 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35548 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38456 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43040 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43046 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39912 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42652 - "GET / HTTP/1.0" 200 OK 2026-03-14 16:42:07,351 - lava_callback - INFO - Received callback for node 69b2ecca6267e2e450f0223e INFO: 172.21.0.1:42662 - "POST /node/69b2ecca6267e2e450f0223e HTTP/1.0" 202 Accepted 2026-03-14 16:42:07,357 - lava_callback - INFO - Starting async job submit for node 69b2ecca6267e2e450f0223e 2026-03-14 16:42:07,357 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 16:42:07,371 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b2ecca6267e2e450f0223e HTTP/1.1" 200 None 2026-03-14 16:42:07,372 - lava_callback - DEBUG - Processing node 69b2ecca6267e2e450f0223e: baseline-arm64-clabbe 2026-03-14 16:42:07,372 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b2ecca6267e2e450f0223e 2026-03-14 16:42:07,373 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 16:42:07,390 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b2ecca6267e2e450f0223e HTTP/1.1" 200 None 2026-03-14 16:42:07,391 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 16:42:07,412 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ad30c9ed37758c525e15e4 HTTP/1.1" 200 None 2026-03-14 16:42:07,414 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 16:42:07,434 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b2ecca6267e2e450f0223e HTTP/1.1" 200 None 2026-03-14 16:42:07,435 - lava_callback - ERROR - Error processing callback for node 69b2ecca6267e2e450f0223e: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:38952 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:38956 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54858 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56380 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46818 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46828 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48778 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60656 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42720 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:42724 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60188 - "GET / HTTP/1.0" 200 OK 2026-03-14 16:43:27,368 - lava_callback - INFO - Received callback for node 69b2ed196267e2e450f0224e INFO: 172.21.0.1:60190 - "POST /node/69b2ed196267e2e450f0224e HTTP/1.0" 202 Accepted 2026-03-14 16:43:27,374 - lava_callback - INFO - Starting async job submit for node 69b2ed196267e2e450f0224e 2026-03-14 16:43:27,375 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 16:43:27,390 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b2ed196267e2e450f0224e HTTP/1.1" 200 None 2026-03-14 16:43:27,391 - lava_callback - DEBUG - Processing node 69b2ed196267e2e450f0224e: baseline-arm64-clabbe 2026-03-14 16:43:27,391 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b2ed196267e2e450f0224e 2026-03-14 16:43:27,392 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 16:43:27,405 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b2ed196267e2e450f0224e HTTP/1.1" 200 None 2026-03-14 16:43:27,406 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 16:43:27,425 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ad30c9ed37758c525e15e4 HTTP/1.1" 200 None 2026-03-14 16:43:27,426 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 16:43:27,451 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b2ed196267e2e450f0224e HTTP/1.1" 200 None 2026-03-14 16:43:27,452 - lava_callback - ERROR - Error processing callback for node 69b2ed196267e2e450f0224e: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:59306 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37822 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37826 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42476 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39526 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48944 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:48950 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49742 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38404 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33600 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33614 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36134 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50264 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58702 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:58714 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45512 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46696 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58906 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58908 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56630 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35304 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35828 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:35840 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37338 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37476 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47544 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47558 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51054 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41712 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53202 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:53210 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60088 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46740 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39602 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39618 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34826 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58002 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40636 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:40646 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44376 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42458 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34486 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34500 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33012 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46336 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60054 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:60060 - "GET / HTTP/1.0" 200 OK 2026-03-14 16:49:17,891 - lava_callback - INFO - Received callback for node 69b2ee886267e2e450f022f1 INFO: 172.21.0.1:60062 - "POST /node/69b2ee886267e2e450f022f1 HTTP/1.0" 202 Accepted 2026-03-14 16:49:17,897 - lava_callback - INFO - Starting async job submit for node 69b2ee886267e2e450f022f1 2026-03-14 16:49:17,898 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 16:49:17,912 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b2ee886267e2e450f022f1 HTTP/1.1" 200 None 2026-03-14 16:49:17,913 - lava_callback - DEBUG - Processing node 69b2ee886267e2e450f022f1: baseline-arm64-baylibre 2026-03-14 16:49:17,913 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b2ee886267e2e450f022f1 2026-03-14 16:49:17,914 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 16:49:17,927 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b2ee886267e2e450f022f1 HTTP/1.1" 200 None 2026-03-14 16:49:17,929 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 16:49:17,942 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b2e73e6267e2e450f02132 HTTP/1.1" 200 None 2026-03-14 16:49:17,943 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 16:49:17,964 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b2ee886267e2e450f022f1 HTTP/1.1" 200 None 2026-03-14 16:49:17,965 - lava_callback - ERROR - Error processing callback for node 69b2ee886267e2e450f022f1: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' 2026-03-14 16:49:18,578 - lava_callback - INFO - Received callback for node 69b2ee8a6267e2e450f022f4 INFO: 172.21.0.1:60076 - "POST /node/69b2ee8a6267e2e450f022f4 HTTP/1.0" 202 Accepted 2026-03-14 16:49:18,584 - lava_callback - INFO - Starting async job submit for node 69b2ee8a6267e2e450f022f4 2026-03-14 16:49:18,584 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 16:49:18,599 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b2ee8a6267e2e450f022f4 HTTP/1.1" 200 None 2026-03-14 16:49:18,600 - lava_callback - DEBUG - Processing node 69b2ee8a6267e2e450f022f4: baseline-arm64-baylibre 2026-03-14 16:49:18,600 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b2ee8a6267e2e450f022f4 2026-03-14 16:49:18,601 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 16:49:18,614 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b2ee8a6267e2e450f022f4 HTTP/1.1" 200 None 2026-03-14 16:49:18,615 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 16:49:18,629 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b2e73e6267e2e450f02132 HTTP/1.1" 200 None 2026-03-14 16:49:18,630 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 16:49:18,650 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b2ee8a6267e2e450f022f4 HTTP/1.1" 200 None 2026-03-14 16:49:18,656 - lava_callback - ERROR - Error processing callback for node 69b2ee8a6267e2e450f022f4: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:44376 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41006 - "GET / HTTP/1.0" 200 OK 2026-03-14 16:49:37,744 - lava_callback - INFO - Received callback for node 69b2ee8e6267e2e450f022fb INFO: 172.21.0.1:41010 - "POST /node/69b2ee8e6267e2e450f022fb HTTP/1.0" 202 Accepted 2026-03-14 16:49:37,750 - lava_callback - INFO - Starting async job submit for node 69b2ee8e6267e2e450f022fb 2026-03-14 16:49:37,750 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 16:49:37,765 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b2ee8e6267e2e450f022fb HTTP/1.1" 200 None 2026-03-14 16:49:37,766 - lava_callback - DEBUG - Processing node 69b2ee8e6267e2e450f022fb: baseline-arm64-baylibre 2026-03-14 16:49:37,766 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b2ee8e6267e2e450f022fb 2026-03-14 16:49:37,767 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 16:49:37,780 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b2ee8e6267e2e450f022fb HTTP/1.1" 200 None 2026-03-14 16:49:37,782 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 16:49:37,795 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b2e73e6267e2e450f02132 HTTP/1.1" 200 None 2026-03-14 16:49:37,796 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 16:49:37,817 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b2ee8e6267e2e450f022fb HTTP/1.1" 200 None 2026-03-14 16:49:37,823 - lava_callback - ERROR - Error processing callback for node 69b2ee8e6267e2e450f022fb: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' 2026-03-14 16:49:38,407 - lava_callback - INFO - Received callback for node 69b2ee906267e2e450f02300 INFO: 172.21.0.1:41016 - "POST /node/69b2ee906267e2e450f02300 HTTP/1.0" 202 Accepted 2026-03-14 16:49:38,413 - lava_callback - INFO - Starting async job submit for node 69b2ee906267e2e450f02300 2026-03-14 16:49:38,415 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 16:49:38,429 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b2ee906267e2e450f02300 HTTP/1.1" 200 None 2026-03-14 16:49:38,430 - lava_callback - DEBUG - Processing node 69b2ee906267e2e450f02300: baseline-arm64-baylibre 2026-03-14 16:49:38,430 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b2ee906267e2e450f02300 2026-03-14 16:49:38,430 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 16:49:38,444 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b2ee906267e2e450f02300 HTTP/1.1" 200 None 2026-03-14 16:49:38,445 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 16:49:38,459 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b2e73e6267e2e450f02132 HTTP/1.1" 200 None 2026-03-14 16:49:38,460 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 16:49:38,480 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b2ee906267e2e450f02300 HTTP/1.1" 200 None 2026-03-14 16:49:38,489 - lava_callback - ERROR - Error processing callback for node 69b2ee906267e2e450f02300: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:56102 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56116 - "GET / HTTP/1.0" 200 OK 2026-03-14 16:49:47,719 - lava_callback - INFO - Received callback for node 69b2eea36267e2e450f02349 INFO: 172.21.0.1:56132 - "POST /node/69b2eea36267e2e450f02349 HTTP/1.0" 202 Accepted 2026-03-14 16:49:47,724 - lava_callback - INFO - Starting async job submit for node 69b2eea36267e2e450f02349 2026-03-14 16:49:47,725 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 16:49:47,739 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b2eea36267e2e450f02349 HTTP/1.1" 200 None 2026-03-14 16:49:47,740 - lava_callback - DEBUG - Processing node 69b2eea36267e2e450f02349: baseline-arm64-clabbe 2026-03-14 16:49:47,740 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b2eea36267e2e450f02349 2026-03-14 16:49:47,741 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 16:49:47,756 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b2eea36267e2e450f02349 HTTP/1.1" 200 None 2026-03-14 16:49:47,757 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 16:49:47,771 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b2e73e6267e2e450f02132 HTTP/1.1" 200 None 2026-03-14 16:49:47,773 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 16:49:47,794 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b2eea36267e2e450f02349 HTTP/1.1" 200 None 2026-03-14 16:49:47,801 - lava_callback - ERROR - Error processing callback for node 69b2eea36267e2e450f02349: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' 2026-03-14 16:49:48,382 - lava_callback - INFO - Received callback for node 69b2eea56267e2e450f0234c INFO: 172.21.0.1:56138 - "POST /node/69b2eea56267e2e450f0234c HTTP/1.0" 202 Accepted 2026-03-14 16:49:48,388 - lava_callback - INFO - Starting async job submit for node 69b2eea56267e2e450f0234c 2026-03-14 16:49:48,389 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 16:49:48,403 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b2eea56267e2e450f0234c HTTP/1.1" 200 None 2026-03-14 16:49:48,404 - lava_callback - DEBUG - Processing node 69b2eea56267e2e450f0234c: baseline-arm64-clabbe 2026-03-14 16:49:48,404 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b2eea56267e2e450f0234c 2026-03-14 16:49:48,405 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 16:49:48,419 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b2eea56267e2e450f0234c HTTP/1.1" 200 None 2026-03-14 16:49:48,420 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 16:49:48,433 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b2e73e6267e2e450f02132 HTTP/1.1" 200 None 2026-03-14 16:49:48,435 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 16:49:48,465 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b2eea56267e2e450f0234c HTTP/1.1" 200 None 2026-03-14 16:49:48,466 - lava_callback - ERROR - Error processing callback for node 69b2eea56267e2e450f0234c: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' 2026-03-14 16:49:49,067 - lava_callback - INFO - Received callback for node 69b2eea56267e2e450f0234f INFO: 172.21.0.1:56146 - "POST /node/69b2eea56267e2e450f0234f HTTP/1.0" 202 Accepted 2026-03-14 16:49:49,072 - lava_callback - INFO - Starting async job submit for node 69b2eea56267e2e450f0234f 2026-03-14 16:49:49,073 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 16:49:49,087 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b2eea56267e2e450f0234f HTTP/1.1" 200 None 2026-03-14 16:49:49,088 - lava_callback - DEBUG - Processing node 69b2eea56267e2e450f0234f: baseline-arm64-clabbe 2026-03-14 16:49:49,088 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b2eea56267e2e450f0234f 2026-03-14 16:49:49,089 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 16:49:49,105 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b2eea56267e2e450f0234f HTTP/1.1" 200 None 2026-03-14 16:49:49,107 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 16:49:49,120 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b2e73e6267e2e450f02132 HTTP/1.1" 200 None 2026-03-14 16:49:49,121 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 16:49:49,142 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b2eea56267e2e450f0234f HTTP/1.1" 200 None 2026-03-14 16:49:49,144 - lava_callback - ERROR - Error processing callback for node 69b2eea56267e2e450f0234f: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' 2026-03-14 16:49:49,722 - lava_callback - INFO - Received callback for node 69b2eea66267e2e450f02352 INFO: 172.21.0.1:60286 - "POST /node/69b2eea66267e2e450f02352 HTTP/1.0" 202 Accepted 2026-03-14 16:49:49,728 - lava_callback - INFO - Starting async job submit for node 69b2eea66267e2e450f02352 2026-03-14 16:49:49,729 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 16:49:49,743 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b2eea66267e2e450f02352 HTTP/1.1" 200 None 2026-03-14 16:49:49,744 - lava_callback - DEBUG - Processing node 69b2eea66267e2e450f02352: baseline-arm64-clabbe 2026-03-14 16:49:49,745 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b2eea66267e2e450f02352 2026-03-14 16:49:49,745 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 16:49:49,759 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b2eea66267e2e450f02352 HTTP/1.1" 200 None 2026-03-14 16:49:49,761 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 16:49:49,774 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b2e73e6267e2e450f02132 HTTP/1.1" 200 None 2026-03-14 16:49:49,776 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 16:49:49,801 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b2eea66267e2e450f02352 HTTP/1.1" 200 None 2026-03-14 16:49:49,803 - lava_callback - ERROR - Error processing callback for node 69b2eea66267e2e450f02352: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' 2026-03-14 16:49:50,384 - lava_callback - INFO - Received callback for node 69b2eeaa6267e2e450f0235b INFO: 172.21.0.1:60296 - "POST /node/69b2eeaa6267e2e450f0235b HTTP/1.0" 202 Accepted 2026-03-14 16:49:50,389 - lava_callback - INFO - Starting async job submit for node 69b2eeaa6267e2e450f0235b 2026-03-14 16:49:50,390 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 16:49:50,406 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b2eeaa6267e2e450f0235b HTTP/1.1" 200 None 2026-03-14 16:49:50,407 - lava_callback - DEBUG - Processing node 69b2eeaa6267e2e450f0235b: baseline-arm64-clabbe 2026-03-14 16:49:50,407 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b2eeaa6267e2e450f0235b 2026-03-14 16:49:50,408 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 16:49:50,421 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b2eeaa6267e2e450f0235b HTTP/1.1" 200 None 2026-03-14 16:49:50,422 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 16:49:50,436 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b2e73e6267e2e450f02132 HTTP/1.1" 200 None 2026-03-14 16:49:50,437 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 16:49:50,458 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b2eeaa6267e2e450f0235b HTTP/1.1" 200 None 2026-03-14 16:49:50,459 - lava_callback - ERROR - Error processing callback for node 69b2eeaa6267e2e450f0235b: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' 2026-03-14 16:49:51,038 - lava_callback - INFO - Received callback for node 69b2eea96267e2e450f02358 INFO: 172.21.0.1:60310 - "POST /node/69b2eea96267e2e450f02358 HTTP/1.0" 202 Accepted 2026-03-14 16:49:51,044 - lava_callback - INFO - Starting async job submit for node 69b2eea96267e2e450f02358 2026-03-14 16:49:51,045 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 16:49:51,063 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b2eea96267e2e450f02358 HTTP/1.1" 200 None 2026-03-14 16:49:51,063 - lava_callback - DEBUG - Processing node 69b2eea96267e2e450f02358: baseline-arm64-clabbe 2026-03-14 16:49:51,064 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b2eea96267e2e450f02358 2026-03-14 16:49:51,064 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 16:49:51,077 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b2eea96267e2e450f02358 HTTP/1.1" 200 None 2026-03-14 16:49:51,079 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 16:49:51,092 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b2e73e6267e2e450f02132 HTTP/1.1" 200 None 2026-03-14 16:49:51,093 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 16:49:51,114 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b2eea96267e2e450f02358 HTTP/1.1" 200 None 2026-03-14 16:49:51,120 - lava_callback - ERROR - Error processing callback for node 69b2eea96267e2e450f02358: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:60326 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35306 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58278 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:58290 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55324 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48552 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50066 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50072 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59898 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41616 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40028 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:40042 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53634 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43676 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47840 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47856 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59916 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44718 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49394 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:49400 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41360 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43242 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54582 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54588 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59504 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51234 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42476 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:42490 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34022 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36902 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56416 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56432 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55314 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48284 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52656 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:52658 - "GET / HTTP/1.0" 200 OK 2026-03-14 16:54:18,238 - lava_callback - INFO - Received callback for node 69b2efb06267e2e450f024bb INFO: 172.21.0.1:52660 - "POST /node/69b2efb06267e2e450f024bb HTTP/1.0" 202 Accepted 2026-03-14 16:54:18,243 - lava_callback - INFO - Starting async job submit for node 69b2efb06267e2e450f024bb 2026-03-14 16:54:18,244 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 16:54:18,259 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b2efb06267e2e450f024bb HTTP/1.1" 200 None 2026-03-14 16:54:18,260 - lava_callback - DEBUG - Processing node 69b2efb06267e2e450f024bb: baseline-arm64-baylibre 2026-03-14 16:54:18,260 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b2efb06267e2e450f024bb 2026-03-14 16:54:18,261 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 16:54:18,274 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b2efb06267e2e450f024bb HTTP/1.1" 200 None 2026-03-14 16:54:18,275 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 16:54:18,293 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ad30c9ed37758c525e15e4 HTTP/1.1" 200 None 2026-03-14 16:54:18,294 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 16:54:18,315 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b2efb06267e2e450f024bb HTTP/1.1" 200 None 2026-03-14 16:54:18,322 - lava_callback - ERROR - Error processing callback for node 69b2efb06267e2e450f024bb: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:43862 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50520 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54180 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54182 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39366 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47214 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42374 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:42376 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59094 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48550 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35738 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35742 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37306 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41542 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46168 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:46178 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38408 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56756 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56248 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56254 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41514 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54192 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39418 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:39420 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37920 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53520 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47098 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47100 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46492 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47142 - "GET / HTTP/1.0" 200 OK 2026-03-14 16:58:08,127 - lava_callback - INFO - Received callback for node 69b2f0966267e2e450f0250e INFO: 172.21.0.1:47148 - "POST /node/69b2f0966267e2e450f0250e HTTP/1.0" 202 Accepted 2026-03-14 16:58:08,133 - lava_callback - INFO - Starting async job submit for node 69b2f0966267e2e450f0250e 2026-03-14 16:58:08,133 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 16:58:08,147 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b2f0966267e2e450f0250e HTTP/1.1" 200 None 2026-03-14 16:58:08,148 - lava_callback - DEBUG - Processing node 69b2f0966267e2e450f0250e: baseline-arm64-clabbe 2026-03-14 16:58:08,148 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b2f0966267e2e450f0250e 2026-03-14 16:58:08,149 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 16:58:08,162 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b2f0966267e2e450f0250e HTTP/1.1" 200 None 2026-03-14 16:58:08,163 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 16:58:08,176 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ad30c9ed37758c525e15e4 HTTP/1.1" 200 None 2026-03-14 16:58:08,178 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 16:58:08,201 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b2f0966267e2e450f0250e HTTP/1.1" 200 None 2026-03-14 16:58:08,203 - lava_callback - ERROR - Error processing callback for node 69b2f0966267e2e450f0250e: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:54198 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:54210 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52458 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49196 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52918 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52932 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48726 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58298 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58480 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:58490 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56990 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51558 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55290 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55300 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43414 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44924 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42926 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:42936 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51414 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49094 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41152 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41166 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45296 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55592 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48574 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:48582 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35998 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44160 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55538 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55546 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47054 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48130 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46988 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:47002 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45320 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60998 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38144 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38156 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56260 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53186 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45346 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:45350 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37474 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54192 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54638 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54640 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36152 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54130 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41360 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:41362 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58744 - "GET / HTTP/1.0" 200 OK 2026-03-14 17:04:28,739 - lava_callback - INFO - Received callback for node 69b2f2096267e2e450f02564 INFO: 172.21.0.1:58748 - "POST /node/69b2f2096267e2e450f02564 HTTP/1.0" 202 Accepted 2026-03-14 17:04:28,745 - lava_callback - INFO - Starting async job submit for node 69b2f2096267e2e450f02564 2026-03-14 17:04:28,745 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 17:04:28,759 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b2f2096267e2e450f02564 HTTP/1.1" 200 None 2026-03-14 17:04:28,760 - lava_callback - DEBUG - Processing node 69b2f2096267e2e450f02564: baseline-arm64-clabbe 2026-03-14 17:04:28,760 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b2f2096267e2e450f02564 2026-03-14 17:04:28,761 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 17:04:28,796 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b2f2096267e2e450f02564 HTTP/1.1" 200 None 2026-03-14 17:04:28,798 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 17:04:28,819 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ad30c9ed37758c525e15e4 HTTP/1.1" 200 None 2026-03-14 17:04:28,821 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 17:04:28,842 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b2f2096267e2e450f02564 HTTP/1.1" 200 None 2026-03-14 17:04:28,843 - lava_callback - ERROR - Error processing callback for node 69b2f2096267e2e450f02564: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:40168 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38766 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38780 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50130 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48084 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39632 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:39634 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46924 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49382 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46412 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46414 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40288 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59396 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40532 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:40542 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51576 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59536 - "GET / HTTP/1.0" 200 OK 2026-03-14 17:06:38,859 - lava_callback - INFO - Received callback for node 69b2f28d6267e2e450f02574 INFO: 172.21.0.1:59538 - "POST /node/69b2f28d6267e2e450f02574 HTTP/1.0" 202 Accepted 2026-03-14 17:06:38,864 - lava_callback - INFO - Starting async job submit for node 69b2f28d6267e2e450f02574 2026-03-14 17:06:38,865 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 17:06:38,879 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b2f28d6267e2e450f02574 HTTP/1.1" 200 None 2026-03-14 17:06:38,880 - lava_callback - DEBUG - Processing node 69b2f28d6267e2e450f02574: baseline-arm-baylibre 2026-03-14 17:06:38,880 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b2f28d6267e2e450f02574 2026-03-14 17:06:38,880 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 17:06:38,893 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b2f28d6267e2e450f02574 HTTP/1.1" 200 None 2026-03-14 17:06:38,895 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 17:06:38,922 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ada13b8fc97e5ba07d4d75 HTTP/1.1" 200 None 2026-03-14 17:06:38,923 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 17:06:38,945 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b2f28d6267e2e450f02574 HTTP/1.1" 200 None 2026-03-14 17:06:38,946 - lava_callback - ERROR - Error processing callback for node 69b2f28d6267e2e450f02574: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:34784 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34786 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52776 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60254 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37268 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:37274 - "GET / HTTP/1.0" 200 OK 2026-03-14 17:07:18,724 - lava_callback - INFO - Received callback for node 69b2f2b16267e2e450f0257f INFO: 172.21.0.1:37282 - "POST /node/69b2f2b16267e2e450f0257f HTTP/1.0" 202 Accepted 2026-03-14 17:07:18,729 - lava_callback - INFO - Starting async job submit for node 69b2f2b16267e2e450f0257f 2026-03-14 17:07:18,730 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 17:07:18,745 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b2f2b16267e2e450f0257f HTTP/1.1" 200 None 2026-03-14 17:07:18,745 - lava_callback - DEBUG - Processing node 69b2f2b16267e2e450f0257f: baseline-arm-baylibre 2026-03-14 17:07:18,746 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b2f2b16267e2e450f0257f 2026-03-14 17:07:18,746 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 17:07:18,764 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b2f2b16267e2e450f0257f HTTP/1.1" 200 None 2026-03-14 17:07:18,766 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 17:07:18,779 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ada13b8fc97e5ba07d4d75 HTTP/1.1" 200 None 2026-03-14 17:07:18,780 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 17:07:18,800 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b2f2b16267e2e450f0257f HTTP/1.1" 200 None 2026-03-14 17:07:18,807 - lava_callback - ERROR - Error processing callback for node 69b2f2b16267e2e450f0257f: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:39352 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45392 - "GET / HTTP/1.0" 200 OK 2026-03-14 17:07:38,742 - lava_callback - INFO - Received callback for node 69b2f2d56267e2e450f0258a INFO: 172.21.0.1:45404 - "POST /node/69b2f2d56267e2e450f0258a HTTP/1.0" 202 Accepted 2026-03-14 17:07:38,747 - lava_callback - INFO - Starting async job submit for node 69b2f2d56267e2e450f0258a 2026-03-14 17:07:38,748 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 17:07:38,763 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b2f2d56267e2e450f0258a HTTP/1.1" 200 None 2026-03-14 17:07:38,764 - lava_callback - DEBUG - Processing node 69b2f2d56267e2e450f0258a: baseline-arm-baylibre 2026-03-14 17:07:38,764 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b2f2d56267e2e450f0258a 2026-03-14 17:07:38,765 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 17:07:38,784 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b2f2d56267e2e450f0258a HTTP/1.1" 200 None 2026-03-14 17:07:38,785 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 17:07:38,801 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ada13b8fc97e5ba07d4d75 HTTP/1.1" 200 None 2026-03-14 17:07:38,802 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 17:07:38,824 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b2f2d56267e2e450f0258a HTTP/1.1" 200 None 2026-03-14 17:07:38,830 - lava_callback - ERROR - Error processing callback for node 69b2f2d56267e2e450f0258a: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:59668 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59682 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44274 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38952 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47184 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:47194 - "GET / HTTP/1.0" 200 OK 2026-03-14 17:08:18,826 - lava_callback - INFO - Received callback for node 69b2f2f96267e2e450f02597 INFO: 172.21.0.1:47196 - "POST /node/69b2f2f96267e2e450f02597 HTTP/1.0" 202 Accepted 2026-03-14 17:08:18,832 - lava_callback - INFO - Starting async job submit for node 69b2f2f96267e2e450f02597 2026-03-14 17:08:18,833 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 17:08:18,848 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b2f2f96267e2e450f02597 HTTP/1.1" 200 None 2026-03-14 17:08:18,848 - lava_callback - DEBUG - Processing node 69b2f2f96267e2e450f02597: baseline-arm-baylibre 2026-03-14 17:08:18,849 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b2f2f96267e2e450f02597 2026-03-14 17:08:18,849 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 17:08:18,862 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b2f2f96267e2e450f02597 HTTP/1.1" 200 None 2026-03-14 17:08:18,863 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 17:08:18,878 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ada13b8fc97e5ba07d4d75 HTTP/1.1" 200 None 2026-03-14 17:08:18,879 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 17:08:18,904 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b2f2f96267e2e450f02597 HTTP/1.1" 200 None 2026-03-14 17:08:18,906 - lava_callback - ERROR - Error processing callback for node 69b2f2f96267e2e450f02597: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:46818 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53696 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57288 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57294 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56810 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33608 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51030 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:51040 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48778 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58408 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33950 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33956 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50482 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56190 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45640 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:45648 - "GET / HTTP/1.0" 200 OK 2026-03-14 17:10:18,988 - lava_callback - INFO - Received callback for node 69b2f3686267e2e450f025b9 INFO: 172.21.0.1:45664 - "POST /node/69b2f3686267e2e450f025b9 HTTP/1.0" 202 Accepted 2026-03-14 17:10:18,993 - lava_callback - INFO - Starting async job submit for node 69b2f3686267e2e450f025b9 2026-03-14 17:10:18,994 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 17:10:19,010 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b2f3686267e2e450f025b9 HTTP/1.1" 200 None 2026-03-14 17:10:19,011 - lava_callback - DEBUG - Processing node 69b2f3686267e2e450f025b9: baseline-arm-baylibre 2026-03-14 17:10:19,011 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b2f3686267e2e450f025b9 2026-03-14 17:10:19,012 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 17:10:19,025 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b2f3686267e2e450f025b9 HTTP/1.1" 200 None 2026-03-14 17:10:19,026 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 17:10:19,040 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ada13b8fc97e5ba07d4d75 HTTP/1.1" 200 None 2026-03-14 17:10:19,041 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 17:10:19,069 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b2f3686267e2e450f025b9 HTTP/1.1" 200 None 2026-03-14 17:10:19,072 - lava_callback - ERROR - Error processing callback for node 69b2f3686267e2e450f025b9: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:47116 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35028 - "GET / HTTP/1.0" 200 OK 2026-03-14 17:10:38,908 - lava_callback - INFO - Received callback for node 69b2f38c6267e2e450f025c8 INFO: 172.21.0.1:35030 - "POST /node/69b2f38c6267e2e450f025c8 HTTP/1.0" 202 Accepted 2026-03-14 17:10:38,914 - lava_callback - INFO - Starting async job submit for node 69b2f38c6267e2e450f025c8 2026-03-14 17:10:38,915 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 17:10:38,930 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b2f38c6267e2e450f025c8 HTTP/1.1" 200 None 2026-03-14 17:10:38,931 - lava_callback - DEBUG - Processing node 69b2f38c6267e2e450f025c8: baseline-arm-baylibre 2026-03-14 17:10:38,931 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b2f38c6267e2e450f025c8 2026-03-14 17:10:38,931 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 17:10:38,946 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b2f38c6267e2e450f025c8 HTTP/1.1" 200 None 2026-03-14 17:10:38,948 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 17:10:38,961 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ada13b8fc97e5ba07d4d75 HTTP/1.1" 200 None 2026-03-14 17:10:38,963 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 17:10:38,992 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b2f38c6267e2e450f025c8 HTTP/1.1" 200 None 2026-03-14 17:10:38,998 - lava_callback - ERROR - Error processing callback for node 69b2f38c6267e2e450f025c8: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:35788 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35790 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:32988 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50998 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36954 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:36966 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48684 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33238 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52680 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52684 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51938 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55758 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56584 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:56588 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33834 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60628 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40672 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40682 - "GET / HTTP/1.0" 200 OK 2026-03-14 17:12:48,732 - lava_callback - INFO - Received callback for node 69b2f3fb6267e2e450f025e2 INFO: 172.21.0.1:40686 - "POST /node/69b2f3fb6267e2e450f025e2 HTTP/1.0" 202 Accepted 2026-03-14 17:12:48,738 - lava_callback - INFO - Starting async job submit for node 69b2f3fb6267e2e450f025e2 2026-03-14 17:12:48,738 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 17:12:48,752 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b2f3fb6267e2e450f025e2 HTTP/1.1" 200 None 2026-03-14 17:12:48,753 - lava_callback - DEBUG - Processing node 69b2f3fb6267e2e450f025e2: baseline-arm-clabbe 2026-03-14 17:12:48,754 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b2f3fb6267e2e450f025e2 2026-03-14 17:12:48,754 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 17:12:48,778 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b2f3fb6267e2e450f025e2 HTTP/1.1" 200 None 2026-03-14 17:12:48,780 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 17:12:48,793 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ada13b8fc97e5ba07d4d75 HTTP/1.1" 200 None 2026-03-14 17:12:48,795 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 17:12:48,816 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b2f3fb6267e2e450f025e2 HTTP/1.1" 200 None 2026-03-14 17:12:48,818 - lava_callback - ERROR - Error processing callback for node 69b2f3fb6267e2e450f025e2: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:50270 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58804 - "GET / HTTP/1.0" 200 OK 2026-03-14 17:13:08,751 - lava_callback - INFO - Received callback for node 69b2f4206267e2e450f025f2 INFO: 172.21.0.1:58808 - "POST /node/69b2f4206267e2e450f025f2 HTTP/1.0" 202 Accepted 2026-03-14 17:13:08,757 - lava_callback - INFO - Starting async job submit for node 69b2f4206267e2e450f025f2 2026-03-14 17:13:08,758 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 17:13:08,773 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b2f4206267e2e450f025f2 HTTP/1.1" 200 None 2026-03-14 17:13:08,774 - lava_callback - DEBUG - Processing node 69b2f4206267e2e450f025f2: baseline-arm-clabbe 2026-03-14 17:13:08,774 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b2f4206267e2e450f025f2 2026-03-14 17:13:08,775 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 17:13:08,788 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b2f4206267e2e450f025f2 HTTP/1.1" 200 None 2026-03-14 17:13:08,789 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 17:13:08,802 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ada13b8fc97e5ba07d4d75 HTTP/1.1" 200 None 2026-03-14 17:13:08,804 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 17:13:08,824 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b2f4206267e2e450f025f2 HTTP/1.1" 200 None 2026-03-14 17:13:08,826 - lava_callback - ERROR - Error processing callback for node 69b2f4206267e2e450f025f2: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:43332 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:43336 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56766 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54756 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40118 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40128 - "GET / HTTP/1.0" 200 OK 2026-03-14 17:13:48,763 - lava_callback - INFO - Received callback for node 69b2f4446267e2e450f025fd INFO: 172.21.0.1:40134 - "POST /node/69b2f4446267e2e450f025fd HTTP/1.0" 202 Accepted 2026-03-14 17:13:48,769 - lava_callback - INFO - Starting async job submit for node 69b2f4446267e2e450f025fd 2026-03-14 17:13:48,770 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 17:13:48,804 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b2f4446267e2e450f025fd HTTP/1.1" 200 None 2026-03-14 17:13:48,804 - lava_callback - DEBUG - Processing node 69b2f4446267e2e450f025fd: baseline-arm-clabbe 2026-03-14 17:13:48,805 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b2f4446267e2e450f025fd 2026-03-14 17:13:48,805 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 17:13:48,819 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b2f4446267e2e450f025fd HTTP/1.1" 200 None 2026-03-14 17:13:48,820 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 17:13:48,834 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ada13b8fc97e5ba07d4d75 HTTP/1.1" 200 None 2026-03-14 17:13:48,836 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 17:13:48,864 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b2f4446267e2e450f025fd HTTP/1.1" 200 None 2026-03-14 17:13:48,865 - lava_callback - ERROR - Error processing callback for node 69b2f4446267e2e450f025fd: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:43824 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39544 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55968 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:55980 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59634 - "GET / HTTP/1.0" 200 OK 2026-03-14 17:14:28,794 - lava_callback - INFO - Received callback for node 69b2f4686267e2e450f02614 INFO: 172.21.0.1:59648 - "POST /node/69b2f4686267e2e450f02614 HTTP/1.0" 202 Accepted 2026-03-14 17:14:28,799 - lava_callback - INFO - Starting async job submit for node 69b2f4686267e2e450f02614 2026-03-14 17:14:28,800 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 17:14:28,814 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b2f4686267e2e450f02614 HTTP/1.1" 200 None 2026-03-14 17:14:28,815 - lava_callback - DEBUG - Processing node 69b2f4686267e2e450f02614: baseline-arm-clabbe 2026-03-14 17:14:28,815 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b2f4686267e2e450f02614 2026-03-14 17:14:28,816 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 17:14:28,830 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b2f4686267e2e450f02614 HTTP/1.1" 200 None 2026-03-14 17:14:28,832 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 17:14:28,845 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ada13b8fc97e5ba07d4d75 HTTP/1.1" 200 None 2026-03-14 17:14:28,846 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 17:14:28,875 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b2f4686267e2e450f02614 HTTP/1.1" 200 None 2026-03-14 17:14:28,877 - lava_callback - ERROR - Error processing callback for node 69b2f4686267e2e450f02614: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:56564 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35386 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35394 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43078 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36198 - "GET / HTTP/1.0" 200 OK 2026-03-14 17:15:08,746 - lava_callback - INFO - Received callback for node 69b2f48d6267e2e450f02621 INFO: 172.21.0.1:36210 - "POST /node/69b2f48d6267e2e450f02621 HTTP/1.0" 202 Accepted 2026-03-14 17:15:08,752 - lava_callback - INFO - Starting async job submit for node 69b2f48d6267e2e450f02621 2026-03-14 17:15:08,753 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 17:15:08,767 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b2f48d6267e2e450f02621 HTTP/1.1" 200 None 2026-03-14 17:15:08,768 - lava_callback - DEBUG - Processing node 69b2f48d6267e2e450f02621: baseline-arm-clabbe 2026-03-14 17:15:08,768 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b2f48d6267e2e450f02621 2026-03-14 17:15:08,769 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 17:15:08,789 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b2f48d6267e2e450f02621 HTTP/1.1" 200 None 2026-03-14 17:15:08,790 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 17:15:08,814 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ada13b8fc97e5ba07d4d75 HTTP/1.1" 200 None 2026-03-14 17:15:08,816 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 17:15:08,846 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b2f48d6267e2e450f02621 HTTP/1.1" 200 None 2026-03-14 17:15:08,847 - lava_callback - ERROR - Error processing callback for node 69b2f48d6267e2e450f02621: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:34116 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:34132 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46116 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49856 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54566 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54572 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55422 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56144 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38508 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:38524 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44636 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48204 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52552 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52558 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49924 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55162 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60124 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:60134 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43400 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43260 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48236 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48240 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55816 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40716 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38778 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:38790 - "GET / HTTP/1.0" 200 OK 2026-03-14 17:18:19,358 - lava_callback - INFO - Received callback for node 69b2f5496267e2e450f0264c INFO: 172.21.0.1:38794 - "POST /node/69b2f5496267e2e450f0264c HTTP/1.0" 202 Accepted 2026-03-14 17:18:19,364 - lava_callback - INFO - Starting async job submit for node 69b2f5496267e2e450f0264c 2026-03-14 17:18:19,365 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 17:18:19,384 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b2f5496267e2e450f0264c HTTP/1.1" 200 None 2026-03-14 17:18:19,385 - lava_callback - DEBUG - Processing node 69b2f5496267e2e450f0264c: baseline-arm64-baylibre 2026-03-14 17:18:19,385 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b2f5496267e2e450f0264c 2026-03-14 17:18:19,385 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 17:18:19,398 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b2f5496267e2e450f0264c HTTP/1.1" 200 None 2026-03-14 17:18:19,400 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 17:18:19,415 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ada1488fc97e5ba07d4d8d HTTP/1.1" 200 None 2026-03-14 17:18:19,417 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 17:18:19,446 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b2f5496267e2e450f0264c HTTP/1.1" 200 None 2026-03-14 17:18:19,448 - lava_callback - ERROR - Error processing callback for node 69b2f5496267e2e450f0264c: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:50648 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41536 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44032 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44040 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37900 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56746 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37626 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:37642 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:32930 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33296 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40202 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40206 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54660 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36926 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35826 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:35842 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34776 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46786 - "GET / HTTP/1.0" 200 OK 2026-03-14 17:20:39,477 - lava_callback - INFO - Received callback for node 69b2f5de6267e2e450f02666 INFO: 172.21.0.1:46800 - "POST /node/69b2f5de6267e2e450f02666 HTTP/1.0" 202 Accepted 2026-03-14 17:20:39,483 - lava_callback - INFO - Starting async job submit for node 69b2f5de6267e2e450f02666 2026-03-14 17:20:39,484 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 17:20:39,498 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b2f5de6267e2e450f02666 HTTP/1.1" 200 None 2026-03-14 17:20:39,499 - lava_callback - DEBUG - Processing node 69b2f5de6267e2e450f02666: baseline-arm64-baylibre 2026-03-14 17:20:39,500 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b2f5de6267e2e450f02666 2026-03-14 17:20:39,500 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 17:20:39,556 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b2f5de6267e2e450f02666 HTTP/1.1" 200 None 2026-03-14 17:20:39,558 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 17:20:39,571 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ada1488fc97e5ba07d4d8d HTTP/1.1" 200 None 2026-03-14 17:20:39,573 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 17:20:39,618 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b2f5de6267e2e450f02666 HTTP/1.1" 200 None 2026-03-14 17:20:39,625 - lava_callback - ERROR - Error processing callback for node 69b2f5de6267e2e450f02666: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:34044 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34048 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51388 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46242 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33660 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:33662 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53278 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53308 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34180 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34182 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41580 - "GET / HTTP/1.0" 200 OK 2026-03-14 17:21:59,611 - lava_callback - INFO - Received callback for node 69b2f62a6267e2e450f0266c INFO: 172.21.0.1:41588 - "POST /node/69b2f62a6267e2e450f0266c HTTP/1.0" 202 Accepted 2026-03-14 17:21:59,616 - lava_callback - INFO - Starting async job submit for node 69b2f62a6267e2e450f0266c 2026-03-14 17:21:59,617 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 17:21:59,632 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b2f62a6267e2e450f0266c HTTP/1.1" 200 None 2026-03-14 17:21:59,633 - lava_callback - DEBUG - Processing node 69b2f62a6267e2e450f0266c: baseline-arm64-baylibre 2026-03-14 17:21:59,633 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b2f62a6267e2e450f0266c 2026-03-14 17:21:59,634 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 17:21:59,646 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b2f62a6267e2e450f0266c HTTP/1.1" 200 None 2026-03-14 17:21:59,648 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 17:21:59,662 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ada1488fc97e5ba07d4d8d HTTP/1.1" 200 None 2026-03-14 17:21:59,663 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 17:21:59,690 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b2f62a6267e2e450f0266c HTTP/1.1" 200 None 2026-03-14 17:21:59,691 - lava_callback - ERROR - Error processing callback for node 69b2f62a6267e2e450f0266c: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:47524 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56260 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:56276 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38102 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60048 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60204 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60206 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59998 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60118 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54682 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:54694 - "GET / HTTP/1.0" 200 OK 2026-03-14 17:23:19,581 - lava_callback - INFO - Received callback for node 69b2f6766267e2e450f02678 INFO: 172.21.0.1:54706 - "POST /node/69b2f6766267e2e450f02678 HTTP/1.0" 202 Accepted 2026-03-14 17:23:19,587 - lava_callback - INFO - Starting async job submit for node 69b2f6766267e2e450f02678 2026-03-14 17:23:19,587 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 17:23:19,602 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b2f6766267e2e450f02678 HTTP/1.1" 200 None 2026-03-14 17:23:19,603 - lava_callback - DEBUG - Processing node 69b2f6766267e2e450f02678: baseline-arm64-baylibre 2026-03-14 17:23:19,603 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b2f6766267e2e450f02678 2026-03-14 17:23:19,603 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 17:23:19,616 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b2f6766267e2e450f02678 HTTP/1.1" 200 None 2026-03-14 17:23:19,618 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 17:23:19,631 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ada1488fc97e5ba07d4d8d HTTP/1.1" 200 None 2026-03-14 17:23:19,632 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 17:23:19,655 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b2f6766267e2e450f02678 HTTP/1.1" 200 None 2026-03-14 17:23:19,657 - lava_callback - ERROR - Error processing callback for node 69b2f6766267e2e450f02678: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:56954 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42690 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33064 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33066 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:32848 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48106 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49322 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:49328 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56420 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35514 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59800 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59808 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55868 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44218 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39282 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:39284 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48592 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60972 - "GET / HTTP/1.0" 200 OK 2026-03-14 17:25:39,777 - lava_callback - INFO - Received callback for node 69b2f70c6267e2e450f02693 INFO: 172.21.0.1:49452 - "POST /node/69b2f70c6267e2e450f02693 HTTP/1.0" 202 Accepted 2026-03-14 17:25:39,782 - lava_callback - INFO - Starting async job submit for node 69b2f70c6267e2e450f02693 2026-03-14 17:25:39,783 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 17:25:39,816 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b2f70c6267e2e450f02693 HTTP/1.1" 200 None 2026-03-14 17:25:39,817 - lava_callback - DEBUG - Processing node 69b2f70c6267e2e450f02693: baseline-arm64-baylibre 2026-03-14 17:25:39,817 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b2f70c6267e2e450f02693 2026-03-14 17:25:39,818 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 17:25:39,856 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b2f70c6267e2e450f02693 HTTP/1.1" 200 None 2026-03-14 17:25:39,857 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 17:25:39,870 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ada1488fc97e5ba07d4d8d HTTP/1.1" 200 None 2026-03-14 17:25:39,872 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 17:25:39,892 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b2f70c6267e2e450f02693 HTTP/1.1" 200 None 2026-03-14 17:25:39,899 - lava_callback - ERROR - Error processing callback for node 69b2f70c6267e2e450f02693: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:49454 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49460 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47362 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36990 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48774 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:48780 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44598 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48506 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45782 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45792 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37328 - "GET / HTTP/1.0" 200 OK 2026-03-14 17:27:00,032 - lava_callback - INFO - Received callback for node 69b2f7586267e2e450f0269b INFO: 172.21.0.1:48908 - "POST /node/69b2f7586267e2e450f0269b HTTP/1.0" 202 Accepted 2026-03-14 17:27:00,037 - lava_callback - INFO - Starting async job submit for node 69b2f7586267e2e450f0269b 2026-03-14 17:27:00,038 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 17:27:00,075 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b2f7586267e2e450f0269b HTTP/1.1" 200 None 2026-03-14 17:27:00,076 - lava_callback - DEBUG - Processing node 69b2f7586267e2e450f0269b: baseline-arm64-baylibre 2026-03-14 17:27:00,076 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b2f7586267e2e450f0269b 2026-03-14 17:27:00,077 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 17:27:00,090 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b2f7586267e2e450f0269b HTTP/1.1" 200 None 2026-03-14 17:27:00,092 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 17:27:00,112 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ada1488fc97e5ba07d4d8d HTTP/1.1" 200 None 2026-03-14 17:27:00,114 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 17:27:00,136 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b2f7586267e2e450f0269b HTTP/1.1" 200 None 2026-03-14 17:27:00,138 - lava_callback - ERROR - Error processing callback for node 69b2f7586267e2e450f0269b: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:48914 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48232 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:48234 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55826 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43302 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44976 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44992 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43038 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58062 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44320 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:44332 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51968 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46714 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49630 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49644 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55382 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40692 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35536 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:35538 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39178 - "GET / HTTP/1.0" 200 OK 2026-03-14 17:29:29,506 - lava_callback - INFO - Received callback for node 69b2f7f46267e2e450f026bb INFO: 172.21.0.1:39186 - "POST /node/69b2f7f46267e2e450f026bb HTTP/1.0" 202 Accepted 2026-03-14 17:29:29,512 - lava_callback - INFO - Starting async job submit for node 69b2f7f46267e2e450f026bb 2026-03-14 17:29:29,512 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 17:29:29,527 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b2f7f46267e2e450f026bb HTTP/1.1" 200 None 2026-03-14 17:29:29,527 - lava_callback - DEBUG - Processing node 69b2f7f46267e2e450f026bb: baseline-arm64-clabbe 2026-03-14 17:29:29,528 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b2f7f46267e2e450f026bb 2026-03-14 17:29:29,528 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 17:29:29,542 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b2f7f46267e2e450f026bb HTTP/1.1" 200 None 2026-03-14 17:29:29,543 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 17:29:29,556 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ada1488fc97e5ba07d4d8d HTTP/1.1" 200 None 2026-03-14 17:29:29,558 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 17:29:29,583 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b2f7f46267e2e450f026bb HTTP/1.1" 200 None 2026-03-14 17:29:29,585 - lava_callback - ERROR - Error processing callback for node 69b2f7f46267e2e450f026bb: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:52240 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60042 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60050 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59606 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46754 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44186 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:44200 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57142 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41676 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40956 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40960 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46734 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52984 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38210 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:38226 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56920 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36208 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:45750 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:57672 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:48820 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:54608 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37644 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42614 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:42616 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49838 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42764 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53936 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53948 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59730 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53900 - "GET / HTTP/1.0" 200 OK 2026-03-14 17:37:09,848 - lava_callback - INFO - Received callback for node 69b2f9c06267e2e450f0274f INFO: 172.21.0.1:47520 - "POST /node/69b2f9c06267e2e450f0274f HTTP/1.0" 202 Accepted 2026-03-14 17:37:09,857 - lava_callback - INFO - Starting async job submit for node 69b2f9c06267e2e450f0274f 2026-03-14 17:37:09,858 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 17:37:09,873 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b2f9c06267e2e450f0274f HTTP/1.1" 200 None 2026-03-14 17:37:09,874 - lava_callback - DEBUG - Processing node 69b2f9c06267e2e450f0274f: baseline-arm64-clabbe 2026-03-14 17:37:09,875 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b2f9c06267e2e450f0274f 2026-03-14 17:37:09,875 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 17:37:09,925 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b2f9c06267e2e450f0274f HTTP/1.1" 200 None 2026-03-14 17:37:09,927 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 17:37:09,957 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ada1488fc97e5ba07d4d8d HTTP/1.1" 200 None 2026-03-14 17:37:09,959 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 17:37:09,987 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b2f9c06267e2e450f0274f HTTP/1.1" 200 None 2026-03-14 17:37:09,988 - lava_callback - ERROR - Error processing callback for node 69b2f9c06267e2e450f0274f: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:47522 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:47528 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38264 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38740 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55588 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55602 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36126 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41330 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35688 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:35696 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40728 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46436 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59124 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59126 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34536 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59806 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58688 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:58704 - "GET / HTTP/1.0" 200 OK 2026-03-14 17:39:20,517 - lava_callback - INFO - Received callback for node 69b2fa436267e2e450f02762 INFO: 172.21.0.1:50438 - "POST /node/69b2fa436267e2e450f02762 HTTP/1.0" 202 Accepted 2026-03-14 17:39:20,522 - lava_callback - INFO - Starting async job submit for node 69b2fa436267e2e450f02762 2026-03-14 17:39:20,523 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 17:39:20,547 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b2fa436267e2e450f02762 HTTP/1.1" 200 None 2026-03-14 17:39:20,548 - lava_callback - DEBUG - Processing node 69b2fa436267e2e450f02762: baseline-arm-baylibre 2026-03-14 17:39:20,548 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b2fa436267e2e450f02762 2026-03-14 17:39:20,549 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 17:39:20,581 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b2fa436267e2e450f02762 HTTP/1.1" 200 None 2026-03-14 17:39:20,582 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 17:39:20,620 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aafe8b27cb11dcdfc758da HTTP/1.1" 200 None 2026-03-14 17:39:20,621 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 17:39:20,642 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b2fa436267e2e450f02762 HTTP/1.1" 200 None 2026-03-14 17:39:20,647 - lava_callback - ERROR - Error processing callback for node 69b2fa436267e2e450f02762: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:50442 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57970 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41708 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41716 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48610 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45748 - "GET / HTTP/1.0" 200 OK 2026-03-14 17:40:09,984 - lava_callback - INFO - Received callback for node 69b2fa6c6267e2e450f02773 INFO: 172.21.0.1:48748 - "POST /node/69b2fa6c6267e2e450f02773 HTTP/1.0" 202 Accepted 2026-03-14 17:40:09,990 - lava_callback - INFO - Starting async job submit for node 69b2fa6c6267e2e450f02773 2026-03-14 17:40:09,991 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 17:40:10,006 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b2fa6c6267e2e450f02773 HTTP/1.1" 200 None 2026-03-14 17:40:10,007 - lava_callback - DEBUG - Processing node 69b2fa6c6267e2e450f02773: baseline-arm-clabbe 2026-03-14 17:40:10,007 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b2fa6c6267e2e450f02773 2026-03-14 17:40:10,008 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 17:40:10,030 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b2fa6c6267e2e450f02773 HTTP/1.1" 200 None 2026-03-14 17:40:10,032 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 17:40:10,048 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aafe8b27cb11dcdfc758da HTTP/1.1" 200 None 2026-03-14 17:40:10,050 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 17:40:10,086 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b2fa6c6267e2e450f02773 HTTP/1.1" 200 None 2026-03-14 17:40:10,087 - lava_callback - ERROR - Error processing callback for node 69b2fa6c6267e2e450f02773: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:48756 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:48766 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51926 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40874 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38930 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38944 - "GET / HTTP/1.0" 200 OK 2026-03-14 17:40:49,900 - lava_callback - INFO - Received callback for node 69b2fa906267e2e450f02789 INFO: 172.21.0.1:53120 - "POST /node/69b2fa906267e2e450f02789 HTTP/1.0" 202 Accepted 2026-03-14 17:40:49,905 - lava_callback - INFO - Starting async job submit for node 69b2fa906267e2e450f02789 2026-03-14 17:40:49,906 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 17:40:49,923 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b2fa906267e2e450f02789 HTTP/1.1" 200 None 2026-03-14 17:40:49,924 - lava_callback - DEBUG - Processing node 69b2fa906267e2e450f02789: baseline-arm-clabbe 2026-03-14 17:40:49,924 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b2fa906267e2e450f02789 2026-03-14 17:40:49,925 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 17:40:49,938 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b2fa906267e2e450f02789 HTTP/1.1" 200 None 2026-03-14 17:40:49,940 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 17:40:49,953 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aafe8b27cb11dcdfc758da HTTP/1.1" 200 None 2026-03-14 17:40:49,955 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 17:40:49,977 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b2fa906267e2e450f02789 HTTP/1.1" 200 None 2026-03-14 17:40:49,983 - lava_callback - ERROR - Error processing callback for node 69b2fa906267e2e450f02789: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:53122 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39612 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50276 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:50278 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38398 - "GET / HTTP/1.0" 200 OK 2026-03-14 17:41:30,047 - lava_callback - INFO - Received callback for node 69b2fab56267e2e450f02791 INFO: 172.21.0.1:41514 - "POST /node/69b2fab56267e2e450f02791 HTTP/1.0" 202 Accepted 2026-03-14 17:41:30,053 - lava_callback - INFO - Starting async job submit for node 69b2fab56267e2e450f02791 2026-03-14 17:41:30,054 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 17:41:30,068 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b2fab56267e2e450f02791 HTTP/1.1" 200 None 2026-03-14 17:41:30,069 - lava_callback - DEBUG - Processing node 69b2fab56267e2e450f02791: baseline-arm-clabbe 2026-03-14 17:41:30,070 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b2fab56267e2e450f02791 2026-03-14 17:41:30,070 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 17:41:30,093 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b2fab56267e2e450f02791 HTTP/1.1" 200 None 2026-03-14 17:41:30,094 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 17:41:30,108 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aafe8b27cb11dcdfc758da HTTP/1.1" 200 None 2026-03-14 17:41:30,110 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 17:41:30,137 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b2fab56267e2e450f02791 HTTP/1.1" 200 None 2026-03-14 17:41:30,146 - lava_callback - ERROR - Error processing callback for node 69b2fab56267e2e450f02791: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:41522 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59124 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59126 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52948 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48628 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50848 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:50860 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39844 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45378 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34206 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34210 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57710 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36888 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34144 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:34148 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60108 - "GET / HTTP/1.0" 200 OK 2026-03-14 17:43:30,097 - lava_callback - INFO - Received callback for node 69b2fb316267e2e450f027ad INFO: 172.21.0.1:51198 - "POST /node/69b2fb316267e2e450f027ad HTTP/1.0" 202 Accepted 2026-03-14 17:43:30,103 - lava_callback - INFO - Starting async job submit for node 69b2fb316267e2e450f027ad 2026-03-14 17:43:30,104 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 17:43:30,138 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b2fb316267e2e450f027ad HTTP/1.1" 200 None 2026-03-14 17:43:30,139 - lava_callback - DEBUG - Processing node 69b2fb316267e2e450f027ad: baseline-arm64-clabbe 2026-03-14 17:43:30,139 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b2fb316267e2e450f027ad 2026-03-14 17:43:30,140 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 17:43:30,165 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b2fb316267e2e450f027ad HTTP/1.1" 200 None 2026-03-14 17:43:30,166 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 17:43:30,180 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ada1488fc97e5ba07d4d8d HTTP/1.1" 200 None 2026-03-14 17:43:30,181 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 17:43:30,211 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b2fb316267e2e450f027ad HTTP/1.1" 200 None 2026-03-14 17:43:30,212 - lava_callback - ERROR - Error processing callback for node 69b2fb316267e2e450f027ad: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:51210 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38866 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38880 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40460 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37820 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34728 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:34742 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37146 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42664 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56370 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56374 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51020 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42546 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33698 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:33700 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49136 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36466 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41912 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41914 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36672 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45932 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54516 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:54520 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50198 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47738 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40364 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40370 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44996 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43672 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35316 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:35322 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60958 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37382 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46948 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46952 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37064 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37598 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53612 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:53624 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46102 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43994 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58692 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58704 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47190 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46476 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59150 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:59162 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39810 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60824 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49210 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49216 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37718 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60530 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51916 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:51930 - "GET / HTTP/1.0" 200 OK 2026-03-14 17:50:21,382 - lava_callback - INFO - Received callback for node 69b2fcd06267e2e450f02805 INFO: 172.21.0.1:54664 - "POST /node/69b2fcd06267e2e450f02805 HTTP/1.0" 202 Accepted 2026-03-14 17:50:21,388 - lava_callback - INFO - Starting async job submit for node 69b2fcd06267e2e450f02805 2026-03-14 17:50:21,389 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 17:50:21,411 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b2fcd06267e2e450f02805 HTTP/1.1" 200 None 2026-03-14 17:50:21,412 - lava_callback - DEBUG - Processing node 69b2fcd06267e2e450f02805: baseline-arm-baylibre 2026-03-14 17:50:21,412 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b2fcd06267e2e450f02805 2026-03-14 17:50:21,413 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 17:50:21,426 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b2fcd06267e2e450f02805 HTTP/1.1" 200 None 2026-03-14 17:50:21,428 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 17:50:21,441 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b2e72a6267e2e450f0211d HTTP/1.1" 200 None 2026-03-14 17:50:21,442 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 17:50:21,462 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b2fcd06267e2e450f02805 HTTP/1.1" 200 None 2026-03-14 17:50:21,464 - lava_callback - ERROR - Error processing callback for node 69b2fcd06267e2e450f02805: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' 2026-03-14 17:50:22,068 - lava_callback - INFO - Received callback for node 69b2fcd46267e2e450f02810 INFO: 172.21.0.1:54666 - "POST /node/69b2fcd46267e2e450f02810 HTTP/1.0" 202 Accepted 2026-03-14 17:50:22,075 - lava_callback - INFO - Starting async job submit for node 69b2fcd46267e2e450f02810 2026-03-14 17:50:22,076 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 17:50:22,094 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b2fcd46267e2e450f02810 HTTP/1.1" 200 None 2026-03-14 17:50:22,095 - lava_callback - DEBUG - Processing node 69b2fcd46267e2e450f02810: baseline-arm-baylibre 2026-03-14 17:50:22,095 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b2fcd46267e2e450f02810 2026-03-14 17:50:22,096 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 17:50:22,109 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b2fcd46267e2e450f02810 HTTP/1.1" 200 None 2026-03-14 17:50:22,111 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 17:50:22,124 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b2e72a6267e2e450f0211d HTTP/1.1" 200 None 2026-03-14 17:50:22,125 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 17:50:22,146 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b2fcd46267e2e450f02810 HTTP/1.1" 200 None 2026-03-14 17:50:22,147 - lava_callback - ERROR - Error processing callback for node 69b2fcd46267e2e450f02810: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:54670 - "GET / HTTP/1.0" 200 OK 2026-03-14 17:50:30,515 - lava_callback - INFO - Received callback for node 69b2fcdd6267e2e450f0282b INFO: 172.21.0.1:57978 - "POST /node/69b2fcdd6267e2e450f0282b HTTP/1.0" 202 Accepted 2026-03-14 17:50:30,520 - lava_callback - INFO - Starting async job submit for node 69b2fcdd6267e2e450f0282b 2026-03-14 17:50:30,521 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 17:50:30,536 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b2fcdd6267e2e450f0282b HTTP/1.1" 200 None 2026-03-14 17:50:30,536 - lava_callback - DEBUG - Processing node 69b2fcdd6267e2e450f0282b: baseline-arm-clabbe 2026-03-14 17:50:30,537 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b2fcdd6267e2e450f0282b 2026-03-14 17:50:30,537 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 17:50:30,551 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b2fcdd6267e2e450f0282b HTTP/1.1" 200 None 2026-03-14 17:50:30,553 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 17:50:30,566 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b2e72a6267e2e450f0211d HTTP/1.1" 200 None 2026-03-14 17:50:30,568 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 17:50:30,594 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b2fcdd6267e2e450f0282b HTTP/1.1" 200 None 2026-03-14 17:50:30,595 - lava_callback - ERROR - Error processing callback for node 69b2fcdd6267e2e450f0282b: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' 2026-03-14 17:50:31,173 - lava_callback - INFO - Received callback for node 69b2fce26267e2e450f02838 INFO: 172.21.0.1:57992 - "POST /node/69b2fce26267e2e450f02838 HTTP/1.0" 202 Accepted 2026-03-14 17:50:31,179 - lava_callback - INFO - Starting async job submit for node 69b2fce26267e2e450f02838 2026-03-14 17:50:31,180 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 17:50:31,194 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b2fce26267e2e450f02838 HTTP/1.1" 200 None 2026-03-14 17:50:31,195 - lava_callback - DEBUG - Processing node 69b2fce26267e2e450f02838: baseline-arm-clabbe 2026-03-14 17:50:31,195 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b2fce26267e2e450f02838 2026-03-14 17:50:31,196 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 17:50:31,208 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b2fce26267e2e450f02838 HTTP/1.1" 200 None 2026-03-14 17:50:31,210 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 17:50:31,222 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b2e72a6267e2e450f0211d HTTP/1.1" 200 None 2026-03-14 17:50:31,224 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 17:50:31,245 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b2fce26267e2e450f02838 HTTP/1.1" 200 None 2026-03-14 17:50:31,250 - lava_callback - ERROR - Error processing callback for node 69b2fce26267e2e450f02838: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' 2026-03-14 17:50:31,829 - lava_callback - INFO - Received callback for node 69b2fce36267e2e450f0283b INFO: 172.21.0.1:58006 - "POST /node/69b2fce36267e2e450f0283b HTTP/1.0" 202 Accepted 2026-03-14 17:50:31,835 - lava_callback - INFO - Starting async job submit for node 69b2fce36267e2e450f0283b 2026-03-14 17:50:31,836 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 17:50:31,854 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b2fce36267e2e450f0283b HTTP/1.1" 200 None 2026-03-14 17:50:31,855 - lava_callback - DEBUG - Processing node 69b2fce36267e2e450f0283b: baseline-arm-clabbe 2026-03-14 17:50:31,856 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b2fce36267e2e450f0283b 2026-03-14 17:50:31,856 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 17:50:31,870 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b2fce36267e2e450f0283b HTTP/1.1" 200 None 2026-03-14 17:50:31,871 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 17:50:31,885 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b2e72a6267e2e450f0211d HTTP/1.1" 200 None 2026-03-14 17:50:31,886 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 17:50:31,911 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b2fce36267e2e450f0283b HTTP/1.1" 200 None 2026-03-14 17:50:31,912 - lava_callback - ERROR - Error processing callback for node 69b2fce36267e2e450f0283b: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' 2026-03-14 17:50:32,492 - lava_callback - INFO - Received callback for node 69b2fce46267e2e450f02842 INFO: 172.21.0.1:58022 - "POST /node/69b2fce46267e2e450f02842 HTTP/1.0" 202 Accepted 2026-03-14 17:50:32,498 - lava_callback - INFO - Starting async job submit for node 69b2fce46267e2e450f02842 2026-03-14 17:50:32,499 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 17:50:32,513 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b2fce46267e2e450f02842 HTTP/1.1" 200 None 2026-03-14 17:50:32,514 - lava_callback - DEBUG - Processing node 69b2fce46267e2e450f02842: baseline-arm-clabbe 2026-03-14 17:50:32,514 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b2fce46267e2e450f02842 2026-03-14 17:50:32,515 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 17:50:32,528 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b2fce46267e2e450f02842 HTTP/1.1" 200 None 2026-03-14 17:50:32,529 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 17:50:32,543 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b2e72a6267e2e450f0211d HTTP/1.1" 200 None 2026-03-14 17:50:32,544 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 17:50:32,579 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b2fce46267e2e450f02842 HTTP/1.1" 200 None 2026-03-14 17:50:32,581 - lava_callback - ERROR - Error processing callback for node 69b2fce46267e2e450f02842: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:58034 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56606 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56614 - "GET / HTTP/1.0" 200 OK 2026-03-14 17:50:50,445 - lava_callback - INFO - Received callback for node 69b2fce76267e2e450f02879 INFO: 172.21.0.1:48268 - "POST /node/69b2fce76267e2e450f02879 HTTP/1.0" 202 Accepted 2026-03-14 17:50:50,450 - lava_callback - INFO - Starting async job submit for node 69b2fce76267e2e450f02879 2026-03-14 17:50:50,451 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 17:50:50,471 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b2fce76267e2e450f02879 HTTP/1.1" 200 None 2026-03-14 17:50:50,472 - lava_callback - DEBUG - Processing node 69b2fce76267e2e450f02879: baseline-arm-clabbe 2026-03-14 17:50:50,472 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b2fce76267e2e450f02879 2026-03-14 17:50:50,473 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 17:50:50,487 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b2fce76267e2e450f02879 HTTP/1.1" 200 None 2026-03-14 17:50:50,488 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 17:50:50,501 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b2e72a6267e2e450f0211d HTTP/1.1" 200 None 2026-03-14 17:50:50,503 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 17:50:50,528 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b2fce76267e2e450f02879 HTTP/1.1" 200 None 2026-03-14 17:50:50,529 - lava_callback - ERROR - Error processing callback for node 69b2fce76267e2e450f02879: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:48274 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34842 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60150 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:60152 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39754 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48096 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36354 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36368 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42484 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48072 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57668 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:57680 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37658 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52000 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33588 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33594 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57032 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50062 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38778 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:38794 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60842 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44030 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55332 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55342 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33906 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34258 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48734 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:48740 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48628 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39066 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51938 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51942 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54728 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46364 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54766 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:54768 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38590 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48844 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33570 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33584 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54598 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35898 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56110 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:56116 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36924 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54516 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36894 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36906 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47734 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41554 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56844 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:56848 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41442 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57442 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39268 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39278 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42998 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58320 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46654 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:46670 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37042 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36424 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60224 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60230 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33682 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56086 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39616 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:39632 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48324 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47706 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53648 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53664 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48802 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42062 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57580 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:57584 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33224 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58772 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44096 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44108 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49974 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39980 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44092 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:44096 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49652 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59364 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55284 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55296 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60624 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45102 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38516 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:38526 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41688 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55302 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38950 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38962 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37846 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55284 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50388 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:50402 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53488 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47552 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59814 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59828 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47238 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45048 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45430 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:45442 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:32810 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43682 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58860 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58862 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42376 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:32786 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44898 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:44910 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60040 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41578 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59044 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59046 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36094 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51318 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59746 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:59758 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39492 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38922 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54862 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54870 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57150 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49728 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55546 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:55558 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48806 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48430 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56460 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56462 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59142 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48772 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51460 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:51470 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40664 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41654 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51382 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51392 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:32782 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36084 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39924 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:39934 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54882 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36976 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55562 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55576 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51966 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56820 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52138 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:52142 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41316 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44618 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48750 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48752 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57956 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33564 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49696 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:49698 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55314 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50518 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36260 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36272 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57268 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60610 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38480 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:38492 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36000 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48972 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59996 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60006 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49262 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39576 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46440 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:46450 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45322 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56072 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44096 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44106 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57858 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60558 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47190 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:47206 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46588 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60906 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55098 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55100 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34498 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57586 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59764 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:59770 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44248 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40094 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40870 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40880 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45126 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47152 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49710 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:49716 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42544 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44722 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54880 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54894 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47676 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37564 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51690 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:51696 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37096 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46934 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33006 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33010 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42250 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59876 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59624 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:59626 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46996 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45664 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60708 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60714 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49320 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47980 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59824 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:59830 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35298 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39822 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48210 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48224 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55930 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35126 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46446 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:46458 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39198 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52780 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:32854 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:32858 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55650 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41342 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57112 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:57120 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50272 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47100 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56936 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56948 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40248 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45572 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41216 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:41222 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37690 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33478 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56622 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56626 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35528 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57298 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39584 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:39592 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52482 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40222 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42634 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42650 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33352 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38690 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49248 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:49258 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59172 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52524 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38722 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38736 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45496 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45234 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40646 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:40660 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51660 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57288 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42516 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42518 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35436 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37062 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51194 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:51204 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55442 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45386 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53436 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53448 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53616 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45244 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39156 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:39162 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58114 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43158 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45982 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45992 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60832 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39864 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49910 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:49914 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38618 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59874 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34766 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34770 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39486 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36010 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54054 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:54056 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58142 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55354 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60402 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60414 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53068 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42018 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51942 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:51950 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52762 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56672 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33606 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33618 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35992 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36720 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45672 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:45686 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59498 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36240 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44464 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44470 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34142 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56510 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55568 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:55580 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41204 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40904 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43914 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43916 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53518 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44158 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41896 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:41898 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52948 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59966 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42162 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42166 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43396 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44230 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57002 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:57012 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46850 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:32908 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49194 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49206 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54146 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50978 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38312 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:38324 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58360 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53524 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55772 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55778 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39750 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48490 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49134 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:49150 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33128 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40918 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41488 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41504 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43082 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56668 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56282 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:56286 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35394 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50698 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60418 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60428 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:32870 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42178 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42198 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:42208 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40796 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46304 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45428 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45444 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42496 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51404 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57184 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:57200 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55842 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50316 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59220 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59230 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46584 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38458 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40750 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:40758 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56054 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35662 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41636 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41646 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47546 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39302 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34526 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:34542 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41142 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52454 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59060 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59070 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41300 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39674 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58586 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:58600 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43336 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50200 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48964 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48976 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47004 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60222 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41760 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:41762 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42344 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60822 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50442 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50448 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58416 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37178 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34454 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:34456 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37462 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37336 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53596 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53600 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39154 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37516 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59608 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:59612 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49610 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46406 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45230 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45244 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56934 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39876 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49092 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:49102 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44234 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36356 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57718 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57730 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57850 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44768 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34938 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:34946 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60372 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48582 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58224 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58228 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54744 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59522 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40630 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:40638 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43682 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41824 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55398 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55410 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38650 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60672 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33624 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:33626 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39304 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42886 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47142 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47156 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54382 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56690 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60020 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:60024 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35926 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52206 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39736 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39740 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37828 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35898 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53334 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:53336 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41590 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47322 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53156 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53158 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42584 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43882 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34548 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:34560 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52892 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59960 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57142 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57152 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40620 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50796 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51566 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:51576 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47296 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38684 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53434 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53440 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36932 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43532 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53964 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:53968 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59718 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52182 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52004 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52006 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55836 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48620 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54598 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:54600 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37722 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43462 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59898 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59900 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50280 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45902 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37026 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:37038 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47072 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34198 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42802 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42816 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56116 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53808 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38248 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:38264 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39208 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39522 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53130 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53138 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60902 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53706 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50322 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:50332 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57016 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39848 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45342 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45352 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46434 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47682 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51258 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:51268 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57992 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49146 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47566 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47580 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45192 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41278 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38422 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:38438 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35350 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50948 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36562 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36568 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36044 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57320 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57592 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:57598 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45636 - "GET / HTTP/1.0" 200 OK 2026-03-14 19:01:33,414 - lava_callback - INFO - Received callback for node 69b30d826267e2e450f02e3b INFO: 172.21.0.1:56896 - "POST /node/69b30d826267e2e450f02e3b HTTP/1.0" 202 Accepted 2026-03-14 19:01:33,420 - lava_callback - INFO - Starting async job submit for node 69b30d826267e2e450f02e3b 2026-03-14 19:01:33,420 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 19:01:33,437 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b30d826267e2e450f02e3b HTTP/1.1" 200 None 2026-03-14 19:01:33,437 - lava_callback - DEBUG - Processing node 69b30d826267e2e450f02e3b: baseline-arm-clabbe 2026-03-14 19:01:33,438 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b30d826267e2e450f02e3b 2026-03-14 19:01:33,438 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 19:01:33,470 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b30d826267e2e450f02e3b HTTP/1.1" 200 None 2026-03-14 19:01:33,471 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 19:01:33,484 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b2060ab0f5558b5d7cc5e3 HTTP/1.1" 200 None 2026-03-14 19:01:33,486 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 19:01:33,515 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b30d826267e2e450f02e3b HTTP/1.1" 200 None 2026-03-14 19:01:33,516 - lava_callback - ERROR - Error processing callback for node 69b30d826267e2e450f02e3b: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:56912 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50038 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50052 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51278 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39172 - "GET / HTTP/1.0" 200 OK 2026-03-14 19:02:13,401 - lava_callback - INFO - Received callback for node 69b30da76267e2e450f02e47 INFO: 172.21.0.1:60602 - "POST /node/69b30da76267e2e450f02e47 HTTP/1.0" 202 Accepted 2026-03-14 19:02:13,407 - lava_callback - INFO - Starting async job submit for node 69b30da76267e2e450f02e47 2026-03-14 19:02:13,408 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 19:02:13,422 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b30da76267e2e450f02e47 HTTP/1.1" 200 None 2026-03-14 19:02:13,423 - lava_callback - DEBUG - Processing node 69b30da76267e2e450f02e47: baseline-arm-clabbe 2026-03-14 19:02:13,423 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b30da76267e2e450f02e47 2026-03-14 19:02:13,424 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 19:02:13,438 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b30da76267e2e450f02e47 HTTP/1.1" 200 None 2026-03-14 19:02:13,439 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 19:02:13,452 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b2060ab0f5558b5d7cc5e3 HTTP/1.1" 200 None 2026-03-14 19:02:13,454 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 19:02:13,502 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b30da76267e2e450f02e47 HTTP/1.1" 200 None 2026-03-14 19:02:13,503 - lava_callback - ERROR - Error processing callback for node 69b30da76267e2e450f02e47: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:60612 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:60620 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:32960 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:32834 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50112 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50122 - "GET / HTTP/1.0" 200 OK 2026-03-14 19:02:53,507 - lava_callback - INFO - Received callback for node 69b30dcc6267e2e450f02e55 INFO: 172.21.0.1:46954 - "POST /node/69b30dcc6267e2e450f02e55 HTTP/1.0" 202 Accepted 2026-03-14 19:02:53,512 - lava_callback - INFO - Starting async job submit for node 69b30dcc6267e2e450f02e55 2026-03-14 19:02:53,513 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 19:02:53,528 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b30dcc6267e2e450f02e55 HTTP/1.1" 200 None 2026-03-14 19:02:53,529 - lava_callback - DEBUG - Processing node 69b30dcc6267e2e450f02e55: baseline-arm-clabbe 2026-03-14 19:02:53,529 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b30dcc6267e2e450f02e55 2026-03-14 19:02:53,529 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 19:02:53,543 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b30dcc6267e2e450f02e55 HTTP/1.1" 200 None 2026-03-14 19:02:53,544 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 19:02:53,584 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b2060ab0f5558b5d7cc5e3 HTTP/1.1" 200 None 2026-03-14 19:02:53,586 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 19:02:53,617 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b30dcc6267e2e450f02e55 HTTP/1.1" 200 None 2026-03-14 19:02:53,627 - lava_callback - ERROR - Error processing callback for node 69b30dcc6267e2e450f02e55: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:46968 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43598 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59738 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:59744 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38432 - "GET / HTTP/1.0" 200 OK 2026-03-14 19:03:33,477 - lava_callback - INFO - Received callback for node 69b30dfa6267e2e450f02e5e INFO: 172.21.0.1:48774 - "POST /node/69b30dfa6267e2e450f02e5e HTTP/1.0" 202 Accepted 2026-03-14 19:03:33,482 - lava_callback - INFO - Starting async job submit for node 69b30dfa6267e2e450f02e5e 2026-03-14 19:03:33,483 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 19:03:33,499 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b30dfa6267e2e450f02e5e HTTP/1.1" 200 None 2026-03-14 19:03:33,500 - lava_callback - DEBUG - Processing node 69b30dfa6267e2e450f02e5e: baseline-arm-clabbe 2026-03-14 19:03:33,500 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b30dfa6267e2e450f02e5e 2026-03-14 19:03:33,500 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 19:03:33,533 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b30dfa6267e2e450f02e5e HTTP/1.1" 200 None 2026-03-14 19:03:33,534 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 19:03:33,555 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b2060ab0f5558b5d7cc5e3 HTTP/1.1" 200 None 2026-03-14 19:03:33,557 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 19:03:33,607 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b30dfa6267e2e450f02e5e HTTP/1.1" 200 None 2026-03-14 19:03:33,609 - lava_callback - ERROR - Error processing callback for node 69b30dfa6267e2e450f02e5e: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:48780 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46914 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46930 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50244 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39232 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60028 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:60040 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44912 - "GET / HTTP/1.0" 200 OK 2026-03-14 19:04:33,518 - lava_callback - INFO - Received callback for node 69b30e376267e2e450f02e6b INFO: 172.21.0.1:59824 - "POST /node/69b30e376267e2e450f02e6b HTTP/1.0" 202 Accepted 2026-03-14 19:04:33,523 - lava_callback - INFO - Starting async job submit for node 69b30e376267e2e450f02e6b 2026-03-14 19:04:33,524 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 19:04:33,539 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b30e376267e2e450f02e6b HTTP/1.1" 200 None 2026-03-14 19:04:33,540 - lava_callback - DEBUG - Processing node 69b30e376267e2e450f02e6b: baseline-arm-clabbe 2026-03-14 19:04:33,540 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b30e376267e2e450f02e6b 2026-03-14 19:04:33,541 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 19:04:33,554 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b30e376267e2e450f02e6b HTTP/1.1" 200 None 2026-03-14 19:04:33,555 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 19:04:33,570 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b2060ab0f5558b5d7cc5e3 HTTP/1.1" 200 None 2026-03-14 19:04:33,572 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 19:04:33,600 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b30e376267e2e450f02e6b HTTP/1.1" 200 None 2026-03-14 19:04:33,602 - lava_callback - ERROR - Error processing callback for node 69b30e376267e2e450f02e6b: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:59828 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45974 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45984 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37130 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51710 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42046 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:42050 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34638 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40496 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60250 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60254 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41286 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37742 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47556 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:47568 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60534 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59390 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45182 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45194 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53758 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55408 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44020 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:44026 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56010 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48414 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49350 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49366 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34754 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50432 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36714 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:36718 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56178 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57794 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53254 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53268 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53480 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45868 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57612 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:57624 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40048 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57196 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45964 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45968 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56100 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36188 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37294 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:37296 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48786 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59706 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37078 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37080 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37288 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41698 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60126 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:60132 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45208 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57510 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59980 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59990 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40974 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37102 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57742 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:57752 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49694 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59420 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55886 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55900 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34548 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39136 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38322 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:38326 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51548 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51656 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33048 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33058 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53444 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52142 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38622 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:38636 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52974 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45078 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47330 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47346 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40774 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55816 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40724 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:40732 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37278 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36222 - "GET / HTTP/1.0" 200 OK 2026-03-14 19:15:46,024 - lava_callback - INFO - Received callback for node 69b310cf6267e2e450f02ebd INFO: 172.21.0.1:51418 - "POST /node/69b310cf6267e2e450f02ebd HTTP/1.0" 202 Accepted 2026-03-14 19:15:46,030 - lava_callback - INFO - Starting async job submit for node 69b310cf6267e2e450f02ebd 2026-03-14 19:15:46,030 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 19:15:46,048 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b310cf6267e2e450f02ebd HTTP/1.1" 200 None 2026-03-14 19:15:46,049 - lava_callback - DEBUG - Processing node 69b310cf6267e2e450f02ebd: baseline-arm64-baylibre 2026-03-14 19:15:46,049 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b310cf6267e2e450f02ebd 2026-03-14 19:15:46,050 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 19:15:46,231 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b310cf6267e2e450f02ebd HTTP/1.1" 200 None 2026-03-14 19:15:46,233 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 19:15:46,263 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b2061ab0f5558b5d7cc5f2 HTTP/1.1" 200 None 2026-03-14 19:15:46,265 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 19:15:46,302 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b310cf6267e2e450f02ebd HTTP/1.1" 200 None 2026-03-14 19:15:46,303 - lava_callback - ERROR - Error processing callback for node 69b310cf6267e2e450f02ebd: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:51422 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51428 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55680 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57142 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48168 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:48170 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38924 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47348 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50820 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50822 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42540 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60480 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39570 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:39584 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55730 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56120 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51994 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52010 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59394 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52798 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60972 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:60976 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46562 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47814 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33050 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33066 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36186 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53020 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47064 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:47072 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53870 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41266 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42128 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42132 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48522 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56246 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35920 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:35928 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34826 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38594 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33836 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33848 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59326 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49822 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34030 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:34044 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49148 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46136 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50054 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50056 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46274 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51020 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52720 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:52722 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44588 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53602 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41226 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41238 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41510 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58472 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55860 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:55868 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35518 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34900 - "GET / HTTP/1.0" 200 OK 2026-03-14 19:23:46,322 - lava_callback - INFO - Received callback for node 69b312b46267e2e450f02eea INFO: 172.21.0.1:35024 - "POST /node/69b312b46267e2e450f02eea HTTP/1.0" 202 Accepted 2026-03-14 19:23:46,327 - lava_callback - INFO - Starting async job submit for node 69b312b46267e2e450f02eea 2026-03-14 19:23:46,328 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 19:23:46,343 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b312b46267e2e450f02eea HTTP/1.1" 200 None 2026-03-14 19:23:46,344 - lava_callback - DEBUG - Processing node 69b312b46267e2e450f02eea: baseline-arm64-baylibre 2026-03-14 19:23:46,344 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b312b46267e2e450f02eea 2026-03-14 19:23:46,345 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 19:23:46,367 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b312b46267e2e450f02eea HTTP/1.1" 200 None 2026-03-14 19:23:46,369 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 19:23:46,383 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b2061ab0f5558b5d7cc5f2 HTTP/1.1" 200 None 2026-03-14 19:23:46,384 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 19:23:46,414 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b312b46267e2e450f02eea HTTP/1.1" 200 None 2026-03-14 19:23:46,415 - lava_callback - ERROR - Error processing callback for node 69b312b46267e2e450f02eea: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:35026 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35032 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51978 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54796 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43304 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:43306 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52380 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50476 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34942 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34944 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42518 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55802 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44870 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:44876 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48812 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45170 - "GET / HTTP/1.0" 200 OK 2026-03-14 19:25:46,401 - lava_callback - INFO - Received callback for node 69b3132c6267e2e450f02efa INFO: 172.21.0.1:34334 - "POST /node/69b3132c6267e2e450f02efa HTTP/1.0" 202 Accepted 2026-03-14 19:25:46,406 - lava_callback - INFO - Starting async job submit for node 69b3132c6267e2e450f02efa 2026-03-14 19:25:46,407 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 19:25:46,423 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b3132c6267e2e450f02efa HTTP/1.1" 200 None 2026-03-14 19:25:46,424 - lava_callback - DEBUG - Processing node 69b3132c6267e2e450f02efa: baseline-arm64-baylibre 2026-03-14 19:25:46,424 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b3132c6267e2e450f02efa 2026-03-14 19:25:46,424 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 19:25:46,446 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b3132c6267e2e450f02efa HTTP/1.1" 200 None 2026-03-14 19:25:46,447 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 19:25:46,462 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b2061ab0f5558b5d7cc5f2 HTTP/1.1" 200 None 2026-03-14 19:25:46,463 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 19:25:46,489 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b3132c6267e2e450f02efa HTTP/1.1" 200 None 2026-03-14 19:25:46,496 - lava_callback - ERROR - Error processing callback for node 69b3132c6267e2e450f02efa: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:34348 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34358 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51624 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37126 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43912 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:43918 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54554 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59330 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37264 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37280 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46212 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41614 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39354 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:39370 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44488 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57656 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57096 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57102 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37514 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42194 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44080 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:44090 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38658 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46664 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47562 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47564 - "GET / HTTP/1.0" 200 OK 2026-03-14 19:28:54,523 - lava_callback - INFO - Received callback for node 69b313e66267e2e450f02f0b INFO: 172.21.0.1:54932 - "POST /node/69b313e66267e2e450f02f0b HTTP/1.0" 202 Accepted 2026-03-14 19:28:54,529 - lava_callback - INFO - Starting async job submit for node 69b313e66267e2e450f02f0b 2026-03-14 19:28:54,530 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 19:28:54,578 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b313e66267e2e450f02f0b HTTP/1.1" 200 None 2026-03-14 19:28:54,579 - lava_callback - DEBUG - Processing node 69b313e66267e2e450f02f0b: baseline-arm64-clabbe 2026-03-14 19:28:54,579 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b313e66267e2e450f02f0b 2026-03-14 19:28:54,580 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 19:28:54,617 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b313e66267e2e450f02f0b HTTP/1.1" 200 None 2026-03-14 19:28:54,619 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 19:28:54,655 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b2061ab0f5558b5d7cc5f2 HTTP/1.1" 200 None 2026-03-14 19:28:54,656 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 19:28:54,680 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b313e66267e2e450f02f0b HTTP/1.1" 200 None 2026-03-14 19:28:54,682 - lava_callback - ERROR - Error processing callback for node 69b313e66267e2e450f02f0b: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:54934 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42036 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38338 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:38346 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54598 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35602 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36250 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36254 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46326 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52122 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53680 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:53690 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59588 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57892 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51462 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51478 - "GET / HTTP/1.0" 200 OK 2026-03-14 19:30:54,612 - lava_callback - INFO - Received callback for node 69b3145f6267e2e450f02f1b INFO: 172.21.0.1:53284 - "POST /node/69b3145f6267e2e450f02f1b HTTP/1.0" 202 Accepted 2026-03-14 19:30:54,618 - lava_callback - INFO - Starting async job submit for node 69b3145f6267e2e450f02f1b 2026-03-14 19:30:54,618 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 19:30:54,635 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b3145f6267e2e450f02f1b HTTP/1.1" 200 None 2026-03-14 19:30:54,636 - lava_callback - DEBUG - Processing node 69b3145f6267e2e450f02f1b: baseline-arm64-clabbe 2026-03-14 19:30:54,637 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b3145f6267e2e450f02f1b 2026-03-14 19:30:54,637 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 19:30:54,652 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b3145f6267e2e450f02f1b HTTP/1.1" 200 None 2026-03-14 19:30:54,653 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 19:30:54,672 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b2061ab0f5558b5d7cc5f2 HTTP/1.1" 200 None 2026-03-14 19:30:54,674 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 19:30:54,704 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b3145f6267e2e450f02f1b HTTP/1.1" 200 None 2026-03-14 19:30:54,706 - lava_callback - ERROR - Error processing callback for node 69b3145f6267e2e450f02f1b: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:53300 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36328 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36976 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:36986 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44180 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36956 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51930 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51946 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57186 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40612 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49252 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:49260 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37210 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48698 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37586 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37592 - "GET / HTTP/1.0" 200 OK 2026-03-14 19:32:54,752 - lava_callback - INFO - Received callback for node 69b314d66267e2e450f02f2a INFO: 172.21.0.1:40686 - "POST /node/69b314d66267e2e450f02f2a HTTP/1.0" 202 Accepted 2026-03-14 19:32:54,758 - lava_callback - INFO - Starting async job submit for node 69b314d66267e2e450f02f2a 2026-03-14 19:32:54,759 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 19:32:54,773 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b314d66267e2e450f02f2a HTTP/1.1" 200 None 2026-03-14 19:32:54,774 - lava_callback - DEBUG - Processing node 69b314d66267e2e450f02f2a: baseline-arm64-clabbe 2026-03-14 19:32:54,774 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b314d66267e2e450f02f2a 2026-03-14 19:32:54,775 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 19:32:54,789 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b314d66267e2e450f02f2a HTTP/1.1" 200 None 2026-03-14 19:32:54,790 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 19:32:54,813 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b2061ab0f5558b5d7cc5f2 HTTP/1.1" 200 None 2026-03-14 19:32:54,815 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 19:32:54,836 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b314d66267e2e450f02f2a HTTP/1.1" 200 None 2026-03-14 19:32:54,838 - lava_callback - ERROR - Error processing callback for node 69b314d66267e2e450f02f2a: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:40700 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38758 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55172 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:55184 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38314 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53308 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36176 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36182 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37416 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59474 - "GET / HTTP/1.0" 200 OK 2026-03-14 19:34:14,782 - lava_callback - INFO - Received callback for node 69b315226267e2e450f02f32 INFO: 172.21.0.1:57340 - "POST /node/69b315226267e2e450f02f32 HTTP/1.0" 202 Accepted 2026-03-14 19:34:14,788 - lava_callback - INFO - Starting async job submit for node 69b315226267e2e450f02f32 2026-03-14 19:34:14,789 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 19:34:14,803 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b315226267e2e450f02f32 HTTP/1.1" 200 None 2026-03-14 19:34:14,804 - lava_callback - DEBUG - Processing node 69b315226267e2e450f02f32: baseline-arm64-clabbe 2026-03-14 19:34:14,804 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b315226267e2e450f02f32 2026-03-14 19:34:14,805 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 19:34:14,820 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b315226267e2e450f02f32 HTTP/1.1" 200 None 2026-03-14 19:34:14,821 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 19:34:14,834 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b2061ab0f5558b5d7cc5f2 HTTP/1.1" 200 None 2026-03-14 19:34:14,836 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 19:34:14,857 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b315226267e2e450f02f32 HTTP/1.1" 200 None 2026-03-14 19:34:14,858 - lava_callback - ERROR - Error processing callback for node 69b315226267e2e450f02f32: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:57342 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:57348 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33456 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42734 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53928 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53938 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52610 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45756 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40498 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:40514 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53522 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49182 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46304 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46308 - "GET / HTTP/1.0" 200 OK 2026-03-14 19:35:54,860 - lava_callback - INFO - Received callback for node 69b3158b6267e2e450f02f45 INFO: 172.21.0.1:44086 - "POST /node/69b3158b6267e2e450f02f45 HTTP/1.0" 202 Accepted 2026-03-14 19:35:54,866 - lava_callback - INFO - Starting async job submit for node 69b3158b6267e2e450f02f45 2026-03-14 19:35:54,867 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 19:35:54,898 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b3158b6267e2e450f02f45 HTTP/1.1" 200 None 2026-03-14 19:35:54,899 - lava_callback - DEBUG - Processing node 69b3158b6267e2e450f02f45: baseline-arm64-clabbe 2026-03-14 19:35:54,899 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b3158b6267e2e450f02f45 2026-03-14 19:35:54,899 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 19:35:54,919 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b3158b6267e2e450f02f45 HTTP/1.1" 200 None 2026-03-14 19:35:54,921 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 19:35:54,957 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b2061ab0f5558b5d7cc5f2 HTTP/1.1" 200 None 2026-03-14 19:35:54,958 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 19:35:55,000 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b3158b6267e2e450f02f45 HTTP/1.1" 200 None 2026-03-14 19:35:55,001 - lava_callback - ERROR - Error processing callback for node 69b3158b6267e2e450f02f45: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:44100 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46252 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49160 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:49164 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33712 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34286 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46222 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46228 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43754 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33100 - "GET / HTTP/1.0" 200 OK 2026-03-14 19:37:14,906 - lava_callback - INFO - Received callback for node 69b315d66267e2e450f02f4e INFO: 172.21.0.1:35058 - "POST /node/69b315d66267e2e450f02f4e HTTP/1.0" 202 Accepted 2026-03-14 19:37:14,911 - lava_callback - INFO - Starting async job submit for node 69b315d66267e2e450f02f4e 2026-03-14 19:37:14,912 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 19:37:14,930 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b315d66267e2e450f02f4e HTTP/1.1" 200 None 2026-03-14 19:37:14,931 - lava_callback - DEBUG - Processing node 69b315d66267e2e450f02f4e: baseline-arm64-clabbe 2026-03-14 19:37:14,931 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b315d66267e2e450f02f4e 2026-03-14 19:37:14,932 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 19:37:14,977 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b315d66267e2e450f02f4e HTTP/1.1" 200 None 2026-03-14 19:37:14,979 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 19:37:14,991 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b2061ab0f5558b5d7cc5f2 HTTP/1.1" 200 None 2026-03-14 19:37:14,993 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 19:37:15,029 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b315d66267e2e450f02f4e HTTP/1.1" 200 None 2026-03-14 19:37:15,031 - lava_callback - ERROR - Error processing callback for node 69b315d66267e2e450f02f4e: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:35060 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:35068 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44378 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38284 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49580 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49586 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59094 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52066 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37508 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:37512 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41990 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49800 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50400 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50412 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44190 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39358 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58940 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:58944 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43992 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57536 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48224 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48238 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34026 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54364 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57128 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:57130 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43244 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46792 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38336 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38340 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45010 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41300 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56708 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:56712 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51364 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48926 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51536 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51552 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33192 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36752 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45946 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:45962 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47970 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55530 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60886 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60888 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60800 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50230 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36358 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:36364 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60714 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42272 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54498 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54514 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33706 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40576 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43636 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:43648 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44272 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56534 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39848 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39852 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56058 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35958 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53186 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:53202 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50334 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49386 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58988 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58992 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46288 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50506 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46398 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:46400 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39372 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54158 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58638 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58642 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:32936 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42330 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50914 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:50916 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38316 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47090 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49054 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49058 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35958 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60358 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37418 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:37428 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37122 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51724 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38158 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38174 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45666 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40620 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42296 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:42300 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56748 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51696 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38848 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38860 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37822 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33510 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50986 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:50998 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41042 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54892 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52040 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52050 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60396 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48354 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40020 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:40028 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49326 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43354 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46020 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46034 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39798 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52180 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58526 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:58542 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37324 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56872 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33994 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34008 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56674 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52958 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59766 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:59768 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51982 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58910 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55336 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55342 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39874 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51970 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51308 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:51310 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36726 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44128 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51944 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51960 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45604 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47274 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54368 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:54370 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52542 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36618 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37946 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37962 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35040 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57344 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:32786 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:32788 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51584 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36914 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42398 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42412 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58986 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35252 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52308 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:52314 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59922 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57450 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55476 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55486 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36166 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44514 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60958 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:60966 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34192 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38574 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36222 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36238 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39566 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36394 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60358 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:60374 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45444 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53134 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52272 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52284 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42694 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51074 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57336 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:57350 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:32836 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59296 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42820 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42832 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38510 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48150 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60576 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:60578 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39772 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46208 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48204 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48206 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55158 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52742 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52890 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:52900 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58552 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48388 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55340 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55346 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37382 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53578 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45160 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:45162 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41404 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39020 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47282 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47284 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34462 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33830 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39036 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:39038 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60106 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42002 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59040 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59056 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53522 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33008 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60306 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:60310 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34880 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50134 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43034 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43042 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52572 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36992 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40640 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:40654 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59662 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55446 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45588 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45600 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33468 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45054 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44686 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:44696 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53508 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39946 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43758 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43766 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38358 - "GET / HTTP/1.0" 200 OK 2026-03-14 20:08:02,776 - lava_callback - INFO - Received callback for node 69b363c9974c91e64560ed5b INFO: 172.21.0.1:43352 - "POST /node/69b363c9974c91e64560ed5b HTTP/1.0" 202 Accepted 2026-03-14 20:08:02,782 - lava_callback - INFO - Starting async job submit for node 69b363c9974c91e64560ed5b 2026-03-14 20:08:02,799 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 20:08:02,814 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b363c9974c91e64560ed5b HTTP/1.1" 200 None 2026-03-14 20:08:02,815 - lava_callback - DEBUG - Processing node 69b363c9974c91e64560ed5b: baseline-arm64-broonie 2026-03-14 20:08:03,127 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-14 20:08:03,304 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-14 20:08:03,306 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69b363c9974c91e64560ed5b/log.txt.gz 2026-03-14 20:08:03,496 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-14 20:08:03,738 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-14 20:08:03,740 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69b363c9974c91e64560ed5b/lava-logs.yaml 2026-03-14 20:08:03,749 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-14 20:08:04,004 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-14 20:08:04,006 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69b363c9974c91e64560ed5b/lava_callback.json.gz 2026-03-14 20:08:04,024 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 20:08:04,061 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b363c9974c91e64560ed5b HTTP/1.1" 200 None 2026-03-14 20:08:04,062 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 20:08:04,102 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b3594d974c91e64560e4b2 HTTP/1.1" 200 None 2026-03-14 20:08:04,104 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 20:08:04,130 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b363c9974c91e64560ed5b HTTP/1.1" 200 None 2026-03-14 20:08:04,147 - lava_callback - INFO - Completed processing callback for node 69b363c9974c91e64560ed5b INFO: 172.21.0.1:43356 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59856 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:59870 - "GET / HTTP/1.0" 200 OK 2026-03-14 20:08:22,614 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 20:08:22,630 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:56860 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58834 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33416 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33430 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55702 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53558 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45884 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:45888 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60600 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56096 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43414 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43420 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47330 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35558 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38278 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:38294 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57574 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42616 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43600 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43606 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45864 - "GET / HTTP/1.0" 200 OK 2026-03-14 20:11:02,983 - lava_callback - INFO - Received callback for node 69b3d0001727ff69d6f22554 INFO: 172.21.0.1:40286 - "POST /node/69b3d0001727ff69d6f22554 HTTP/1.0" 202 Accepted 2026-03-14 20:11:02,989 - lava_callback - INFO - Starting async job submit for node 69b3d0001727ff69d6f22554 2026-03-14 20:11:03,006 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 20:11:03,030 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b3d0001727ff69d6f22554 HTTP/1.1" 200 None 2026-03-14 20:11:03,031 - lava_callback - DEBUG - Processing node 69b3d0001727ff69d6f22554: baseline-arm64-broonie 2026-03-14 20:11:03,365 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-14 20:11:03,512 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-14 20:11:03,514 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69b3d0001727ff69d6f22554/log.txt.gz 2026-03-14 20:11:03,702 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-14 20:11:03,931 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-14 20:11:03,933 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69b3d0001727ff69d6f22554/lava-logs.yaml 2026-03-14 20:11:03,941 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-14 20:11:04,100 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-14 20:11:04,102 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69b3d0001727ff69d6f22554/lava_callback.json.gz 2026-03-14 20:11:04,142 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 20:11:04,162 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b3d0001727ff69d6f22554 HTTP/1.1" 200 None 2026-03-14 20:11:04,163 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 20:11:04,176 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b3c8061727ff69d6f21d98 HTTP/1.1" 200 None 2026-03-14 20:11:04,178 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 20:11:04,202 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b3d0001727ff69d6f22554 HTTP/1.1" 200 None 2026-03-14 20:11:04,255 - lava_callback - INFO - Completed processing callback for node 69b3d0001727ff69d6f22554 INFO: 172.21.0.1:40300 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41892 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:41904 - "GET / HTTP/1.0" 200 OK 2026-03-14 20:11:22,633 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 20:11:22,649 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:49684 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38834 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36972 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36976 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57658 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56214 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59528 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:59538 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39596 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41208 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53670 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53674 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42912 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36230 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51570 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:51572 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38488 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41298 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51622 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51632 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41870 - "GET / HTTP/1.0" 200 OK 2026-03-14 20:14:03,303 - lava_callback - INFO - Received callback for node 69b428591727ff69d6f232ac INFO: 172.21.0.1:34802 - "POST /node/69b428591727ff69d6f232ac HTTP/1.0" 202 Accepted 2026-03-14 20:14:03,309 - lava_callback - INFO - Starting async job submit for node 69b428591727ff69d6f232ac 2026-03-14 20:14:03,326 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 20:14:03,344 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b428591727ff69d6f232ac HTTP/1.1" 200 None 2026-03-14 20:14:03,345 - lava_callback - DEBUG - Processing node 69b428591727ff69d6f232ac: baseline-arm64-broonie 2026-03-14 20:14:03,648 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-14 20:14:03,842 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-14 20:14:03,844 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69b428591727ff69d6f232ac/log.txt.gz 2026-03-14 20:14:04,047 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-14 20:14:04,286 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-14 20:14:04,288 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69b428591727ff69d6f232ac/lava-logs.yaml 2026-03-14 20:14:04,296 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-14 20:14:04,545 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-14 20:14:04,547 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69b428591727ff69d6f232ac/lava_callback.json.gz 2026-03-14 20:14:04,582 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 20:14:04,596 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b428591727ff69d6f232ac HTTP/1.1" 200 None 2026-03-14 20:14:04,598 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 20:14:04,611 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b3c8061727ff69d6f21d98 HTTP/1.1" 200 None 2026-03-14 20:14:04,613 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 20:14:04,646 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b428591727ff69d6f232ac HTTP/1.1" 200 None 2026-03-14 20:14:04,707 - lava_callback - INFO - Completed processing callback for node 69b428591727ff69d6f232ac INFO: 172.21.0.1:34818 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56014 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:56028 - "GET / HTTP/1.0" 200 OK 2026-03-14 20:14:22,651 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 20:14:22,681 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:42490 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52674 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37974 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37976 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55066 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43308 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38718 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:38732 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36320 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56756 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35570 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35572 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60212 - "GET / HTTP/1.0" 200 OK 2026-03-14 20:16:03,033 - lava_callback - INFO - Received callback for node 69b4809b1727ff69d6f24075 INFO: 172.21.0.1:40144 - "POST /node/69b4809b1727ff69d6f24075 HTTP/1.0" 202 Accepted 2026-03-14 20:16:03,039 - lava_callback - INFO - Starting async job submit for node 69b4809b1727ff69d6f24075 2026-03-14 20:16:03,054 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 20:16:03,068 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b4809b1727ff69d6f24075 HTTP/1.1" 200 None 2026-03-14 20:16:03,069 - lava_callback - DEBUG - Processing node 69b4809b1727ff69d6f24075: baseline-arm64-broonie 2026-03-14 20:16:03,357 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-14 20:16:03,514 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-14 20:16:03,516 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69b4809b1727ff69d6f24075/log.txt.gz 2026-03-14 20:16:03,676 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-14 20:16:03,909 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-14 20:16:03,911 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69b4809b1727ff69d6f24075/lava-logs.yaml 2026-03-14 20:16:03,918 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-14 20:16:04,074 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-14 20:16:04,076 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69b4809b1727ff69d6f24075/lava_callback.json.gz 2026-03-14 20:16:04,092 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 20:16:04,109 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b4809b1727ff69d6f24075 HTTP/1.1" 200 None 2026-03-14 20:16:04,111 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 20:16:04,124 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b3c8061727ff69d6f21d98 HTTP/1.1" 200 None 2026-03-14 20:16:04,126 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 20:16:04,159 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b4809b1727ff69d6f24075 HTTP/1.1" 200 None 2026-03-14 20:16:04,160 - lava_callback - INFO - Completed processing callback for node 69b4809b1727ff69d6f24075 INFO: 172.21.0.1:40154 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37462 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:37464 - "GET / HTTP/1.0" 200 OK 2026-03-14 20:16:22,683 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 20:16:22,704 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:52668 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39950 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56750 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56762 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:32858 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52118 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33514 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:33526 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59640 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57638 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44082 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44098 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40344 - "GET / HTTP/1.0" 200 OK 2026-03-14 20:18:03,319 - lava_callback - INFO - Received callback for node 69b4d52d1727ff69d6f24efe INFO: 172.21.0.1:53226 - "POST /node/69b4d52d1727ff69d6f24efe HTTP/1.0" 202 Accepted 2026-03-14 20:18:03,324 - lava_callback - INFO - Starting async job submit for node 69b4d52d1727ff69d6f24efe 2026-03-14 20:18:03,342 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 20:18:03,366 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b4d52d1727ff69d6f24efe HTTP/1.1" 200 None 2026-03-14 20:18:03,366 - lava_callback - DEBUG - Processing node 69b4d52d1727ff69d6f24efe: baseline-arm64-broonie 2026-03-14 20:18:03,672 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-14 20:18:03,825 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-14 20:18:03,827 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69b4d52d1727ff69d6f24efe/log.txt.gz 2026-03-14 20:18:04,037 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-14 20:18:04,320 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-14 20:18:04,322 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69b4d52d1727ff69d6f24efe/lava-logs.yaml 2026-03-14 20:18:04,330 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-14 20:18:04,505 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-14 20:18:04,506 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69b4d52d1727ff69d6f24efe/lava_callback.json.gz 2026-03-14 20:18:04,525 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 20:18:04,547 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b4d52d1727ff69d6f24efe HTTP/1.1" 200 None 2026-03-14 20:18:04,549 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 20:18:04,562 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b3c8061727ff69d6f21d98 HTTP/1.1" 200 None 2026-03-14 20:18:04,564 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 20:18:04,612 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b4d52d1727ff69d6f24efe HTTP/1.1" 200 None 2026-03-14 20:18:04,614 - lava_callback - INFO - Completed processing callback for node 69b4d52d1727ff69d6f24efe INFO: 172.21.0.1:53230 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39968 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:39982 - "GET / HTTP/1.0" 200 OK 2026-03-14 20:18:22,706 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 20:18:22,732 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:53478 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33700 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51152 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51154 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59580 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:32776 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50236 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:50242 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57752 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55338 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33008 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33018 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48624 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37996 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50330 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:50338 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40406 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34748 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54602 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54614 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39006 - "GET / HTTP/1.0" 200 OK 2026-03-14 20:21:03,949 - lava_callback - INFO - Received callback for node 69b5c0eb1727ff69d6f26684 INFO: 172.21.0.1:35512 - "POST /node/69b5c0eb1727ff69d6f26684 HTTP/1.0" 202 Accepted 2026-03-14 20:21:03,955 - lava_callback - INFO - Starting async job submit for node 69b5c0eb1727ff69d6f26684 2026-03-14 20:21:03,972 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 20:21:03,993 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b5c0eb1727ff69d6f26684 HTTP/1.1" 200 None 2026-03-14 20:21:03,993 - lava_callback - DEBUG - Processing node 69b5c0eb1727ff69d6f26684: baseline-arm64-broonie 2026-03-14 20:21:04,300 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-14 20:21:04,465 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-14 20:21:04,466 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69b5c0eb1727ff69d6f26684/log.txt.gz 2026-03-14 20:21:04,653 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-14 20:21:04,877 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-14 20:21:04,879 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69b5c0eb1727ff69d6f26684/lava-logs.yaml 2026-03-14 20:21:04,887 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-14 20:21:05,054 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-14 20:21:05,056 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69b5c0eb1727ff69d6f26684/lava_callback.json.gz 2026-03-14 20:21:05,091 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 20:21:05,106 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b5c0eb1727ff69d6f26684 HTTP/1.1" 200 None 2026-03-14 20:21:05,108 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 20:21:05,132 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b3c8061727ff69d6f21d98 HTTP/1.1" 200 None 2026-03-14 20:21:05,134 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 20:21:05,159 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b5c0eb1727ff69d6f26684 HTTP/1.1" 200 None 2026-03-14 20:21:05,198 - lava_callback - INFO - Completed processing callback for node 69b5c0eb1727ff69d6f26684 INFO: 172.21.0.1:35524 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42498 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:42514 - "GET / HTTP/1.0" 200 OK 2026-03-14 20:21:22,735 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 20:21:22,757 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:45952 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40996 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59674 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59690 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59598 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44658 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60316 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:60320 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58360 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55392 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37114 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37122 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55960 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45798 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35696 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:35704 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57968 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39990 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55654 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55666 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44454 - "GET / HTTP/1.0" 200 OK 2026-03-14 20:24:03,522 - lava_callback - INFO - Received callback for node 69b5c19f1727ff69d6f26696 INFO: 172.21.0.1:51290 - "POST /node/69b5c19f1727ff69d6f26696 HTTP/1.0" 202 Accepted 2026-03-14 20:24:03,528 - lava_callback - INFO - Starting async job submit for node 69b5c19f1727ff69d6f26696 2026-03-14 20:24:03,546 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 20:24:03,565 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b5c19f1727ff69d6f26696 HTTP/1.1" 200 None 2026-03-14 20:24:03,566 - lava_callback - DEBUG - Processing node 69b5c19f1727ff69d6f26696: baseline-arm64-broonie 2026-03-14 20:24:03,891 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-14 20:24:04,056 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-14 20:24:04,057 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69b5c19f1727ff69d6f26696/log.txt.gz 2026-03-14 20:24:04,247 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-14 20:24:04,489 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-14 20:24:04,491 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69b5c19f1727ff69d6f26696/lava-logs.yaml 2026-03-14 20:24:04,499 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-14 20:24:04,669 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-14 20:24:04,671 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69b5c19f1727ff69d6f26696/lava_callback.json.gz 2026-03-14 20:24:04,706 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 20:24:04,721 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b5c19f1727ff69d6f26696 HTTP/1.1" 200 None 2026-03-14 20:24:04,723 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 20:24:04,737 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b3c8061727ff69d6f21d98 HTTP/1.1" 200 None 2026-03-14 20:24:04,739 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 20:24:04,790 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b5c19f1727ff69d6f26696 HTTP/1.1" 200 None 2026-03-14 20:24:04,843 - lava_callback - INFO - Completed processing callback for node 69b5c19f1727ff69d6f26696 INFO: 172.21.0.1:51306 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60318 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:60328 - "GET / HTTP/1.0" 200 OK 2026-03-14 20:24:22,759 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 20:24:22,775 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:38436 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54154 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58590 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58604 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36424 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57538 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57972 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:57974 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36836 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46186 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54356 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54358 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42918 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39926 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36116 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:36118 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47656 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43158 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35466 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35478 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55380 - "GET / HTTP/1.0" 200 OK 2026-03-14 20:27:03,591 - lava_callback - INFO - Received callback for node 69b5c3431727ff69d6f266b6 INFO: 172.21.0.1:46504 - "POST /node/69b5c3431727ff69d6f266b6 HTTP/1.0" 202 Accepted 2026-03-14 20:27:03,597 - lava_callback - INFO - Starting async job submit for node 69b5c3431727ff69d6f266b6 2026-03-14 20:27:03,615 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 20:27:03,629 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b5c3431727ff69d6f266b6 HTTP/1.1" 200 None 2026-03-14 20:27:03,630 - lava_callback - DEBUG - Processing node 69b5c3431727ff69d6f266b6: baseline-arm64-broonie 2026-03-14 20:27:03,938 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-14 20:27:04,092 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-14 20:27:04,094 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69b5c3431727ff69d6f266b6/log.txt.gz 2026-03-14 20:27:04,281 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-14 20:27:04,530 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-14 20:27:04,533 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69b5c3431727ff69d6f266b6/lava-logs.yaml 2026-03-14 20:27:04,541 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-14 20:27:04,698 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-14 20:27:04,700 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69b5c3431727ff69d6f266b6/lava_callback.json.gz 2026-03-14 20:27:04,735 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 20:27:04,768 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b5c3431727ff69d6f266b6 HTTP/1.1" 200 None 2026-03-14 20:27:04,770 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 20:27:04,785 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b3c8061727ff69d6f21d98 HTTP/1.1" 200 None 2026-03-14 20:27:04,787 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 20:27:04,817 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b5c3431727ff69d6f266b6 HTTP/1.1" 200 None 2026-03-14 20:27:04,851 - lava_callback - INFO - Completed processing callback for node 69b5c3431727ff69d6f266b6 INFO: 172.21.0.1:46512 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42384 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:42398 - "GET / HTTP/1.0" 200 OK 2026-03-14 20:27:22,777 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 20:27:22,797 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:45902 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40132 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51416 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51420 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53076 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42932 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56930 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:56934 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53126 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54932 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52876 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52882 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41720 - "GET / HTTP/1.0" 200 OK 2026-03-14 20:29:03,824 - lava_callback - INFO - Received callback for node 69b5c3f71727ff69d6f266c9 INFO: 172.21.0.1:48818 - "POST /node/69b5c3f71727ff69d6f266c9 HTTP/1.0" 202 Accepted 2026-03-14 20:29:03,829 - lava_callback - INFO - Starting async job submit for node 69b5c3f71727ff69d6f266c9 2026-03-14 20:29:03,845 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 20:29:03,868 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b5c3f71727ff69d6f266c9 HTTP/1.1" 200 None 2026-03-14 20:29:03,869 - lava_callback - DEBUG - Processing node 69b5c3f71727ff69d6f266c9: baseline-arm64-broonie 2026-03-14 20:29:04,137 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-14 20:29:04,294 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-14 20:29:04,295 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69b5c3f71727ff69d6f266c9/log.txt.gz 2026-03-14 20:29:04,446 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-14 20:29:04,666 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-14 20:29:04,668 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69b5c3f71727ff69d6f266c9/lava-logs.yaml 2026-03-14 20:29:04,675 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-14 20:29:04,843 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-14 20:29:04,844 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69b5c3f71727ff69d6f266c9/lava_callback.json.gz 2026-03-14 20:29:04,860 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 20:29:04,874 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b5c3f71727ff69d6f266c9 HTTP/1.1" 200 None 2026-03-14 20:29:04,876 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 20:29:04,889 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b3c8061727ff69d6f21d98 HTTP/1.1" 200 None 2026-03-14 20:29:04,891 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 20:29:04,915 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b5c3f71727ff69d6f266c9 HTTP/1.1" 200 None 2026-03-14 20:29:04,916 - lava_callback - INFO - Completed processing callback for node 69b5c3f71727ff69d6f266c9 INFO: 172.21.0.1:48822 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33696 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:33712 - "GET / HTTP/1.0" 200 OK 2026-03-14 20:29:22,800 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 20:29:22,842 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:54704 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56018 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41422 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41438 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57966 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55402 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51170 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:51176 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41930 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41228 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45976 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45982 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49032 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58176 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34622 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:34634 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52476 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42490 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45400 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45408 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35228 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50530 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48256 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:48272 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37686 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59640 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46514 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46528 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49884 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49662 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34716 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:34722 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49632 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55120 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35804 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35810 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45756 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41000 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36858 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:36870 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50742 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58300 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53608 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53624 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54016 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48510 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55992 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:55994 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43482 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48734 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37402 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37404 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43580 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36380 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53180 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:53182 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35968 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43916 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56156 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56168 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38976 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58134 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56738 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:56748 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44472 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59926 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47636 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47638 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41454 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49432 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33298 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:33302 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60302 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45696 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58364 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58374 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52522 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59632 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46210 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:46222 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59736 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49878 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57604 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57608 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38352 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59720 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43096 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:43106 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45542 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60180 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57782 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57786 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46390 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42576 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42156 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:42168 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58286 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54616 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46334 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46336 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55678 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43540 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35260 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:35268 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:32792 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36790 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54738 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54754 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44740 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59734 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39094 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:39102 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46794 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46216 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45100 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45114 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39116 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59070 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56138 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:56148 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51086 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57594 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49234 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49248 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60030 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46828 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50730 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:50744 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51548 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48338 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47292 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47294 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38852 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37942 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34554 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:34556 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40646 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59826 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35102 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35106 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58786 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39874 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56034 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:56046 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43004 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55428 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59756 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59764 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34020 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60858 - "GET / HTTP/1.0" 200 OK 2026-03-14 20:48:10,760 - lava_callback - INFO - Received callback for node 69b326756267e2e450f02fa9 INFO: 172.21.0.1:55478 - "POST /node/69b326756267e2e450f02fa9 HTTP/1.0" 202 Accepted 2026-03-14 20:48:10,765 - lava_callback - INFO - Starting async job submit for node 69b326756267e2e450f02fa9 2026-03-14 20:48:10,766 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 20:48:10,785 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b326756267e2e450f02fa9 HTTP/1.1" 200 None 2026-03-14 20:48:10,785 - lava_callback - DEBUG - Processing node 69b326756267e2e450f02fa9: baseline-arm-baylibre 2026-03-14 20:48:10,786 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b326756267e2e450f02fa9 2026-03-14 20:48:10,786 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 20:48:10,800 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b326756267e2e450f02fa9 HTTP/1.1" 200 None 2026-03-14 20:48:10,801 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 20:48:10,815 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b276654bce73bcf0233d14 HTTP/1.1" 200 None 2026-03-14 20:48:10,817 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 20:48:10,836 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b326756267e2e450f02fa9 HTTP/1.1" 200 None 2026-03-14 20:48:10,842 - lava_callback - ERROR - Error processing callback for node 69b326756267e2e450f02fa9: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:55488 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:55496 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41080 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53384 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38394 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38408 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59038 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57098 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45584 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:45598 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41826 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38430 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36864 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36876 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35912 - "GET / HTTP/1.0" 200 OK 2026-03-14 20:49:57,993 - lava_callback - INFO - Received callback for node 69b326ee6267e2e450f02fcf INFO: 172.21.0.1:35916 - "POST /node/69b326ee6267e2e450f02fcf HTTP/1.0" 202 Accepted 2026-03-14 20:49:57,999 - lava_callback - INFO - Starting async job submit for node 69b326ee6267e2e450f02fcf 2026-03-14 20:49:58,000 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 20:49:58,016 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b326ee6267e2e450f02fcf HTTP/1.1" 200 None 2026-03-14 20:49:58,017 - lava_callback - DEBUG - Processing node 69b326ee6267e2e450f02fcf: baseline-arm-clabbe 2026-03-14 20:49:58,018 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b326ee6267e2e450f02fcf 2026-03-14 20:49:58,018 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 20:49:58,040 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b326ee6267e2e450f02fcf HTTP/1.1" 200 None 2026-03-14 20:49:58,043 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 20:49:58,057 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b276654bce73bcf0233d14 HTTP/1.1" 200 None 2026-03-14 20:49:58,059 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 20:49:58,095 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b326ee6267e2e450f02fcf HTTP/1.1" 200 None 2026-03-14 20:49:58,097 - lava_callback - ERROR - Error processing callback for node 69b326ee6267e2e450f02fcf: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:33642 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48720 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:48724 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57212 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33470 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59240 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59250 - "GET / HTTP/1.0" 200 OK 2026-03-14 20:50:50,716 - lava_callback - INFO - Received callback for node 69b3271e6267e2e450f02fe3 INFO: 172.21.0.1:56356 - "POST /node/69b3271e6267e2e450f02fe3 HTTP/1.0" 202 Accepted 2026-03-14 20:50:50,721 - lava_callback - INFO - Starting async job submit for node 69b3271e6267e2e450f02fe3 2026-03-14 20:50:50,722 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 20:50:50,738 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b3271e6267e2e450f02fe3 HTTP/1.1" 200 None 2026-03-14 20:50:50,739 - lava_callback - DEBUG - Processing node 69b3271e6267e2e450f02fe3: baseline-arm64-baylibre 2026-03-14 20:50:50,739 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b3271e6267e2e450f02fe3 2026-03-14 20:50:50,739 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 20:50:50,752 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b3271e6267e2e450f02fe3 HTTP/1.1" 200 None 2026-03-14 20:50:50,754 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 20:50:50,767 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aafea227cb11dcdfc758f1 HTTP/1.1" 200 None 2026-03-14 20:50:50,769 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 20:50:50,789 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b3271e6267e2e450f02fe3 HTTP/1.1" 200 None 2026-03-14 20:50:50,795 - lava_callback - ERROR - Error processing callback for node 69b3271e6267e2e450f02fe3: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:56358 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51448 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57504 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:57508 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43926 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58488 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34638 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34642 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35058 - "GET / HTTP/1.0" 200 OK 2026-03-14 20:51:58,030 - lava_callback - INFO - Received callback for node 69b327686267e2e450f02fef INFO: 172.21.0.1:35064 - "POST /node/69b327686267e2e450f02fef HTTP/1.0" 202 Accepted 2026-03-14 20:51:58,035 - lava_callback - INFO - Starting async job submit for node 69b327686267e2e450f02fef 2026-03-14 20:51:58,036 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 20:51:58,051 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b327686267e2e450f02fef HTTP/1.1" 200 None 2026-03-14 20:51:58,052 - lava_callback - DEBUG - Processing node 69b327686267e2e450f02fef: baseline-arm-clabbe 2026-03-14 20:51:58,052 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b327686267e2e450f02fef 2026-03-14 20:51:58,053 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 20:51:58,066 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b327686267e2e450f02fef HTTP/1.1" 200 None 2026-03-14 20:51:58,068 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 20:51:58,081 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b276654bce73bcf0233d14 HTTP/1.1" 200 None 2026-03-14 20:51:58,082 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 20:51:58,104 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b327686267e2e450f02fef HTTP/1.1" 200 None 2026-03-14 20:51:58,105 - lava_callback - ERROR - Error processing callback for node 69b327686267e2e450f02fef: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:42910 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49830 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:49842 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51810 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35026 - "GET / HTTP/1.0" 200 OK 2026-03-14 20:52:38,011 - lava_callback - INFO - Received callback for node 69b3278f6267e2e450f03000 INFO: 172.21.0.1:35038 - "POST /node/69b3278f6267e2e450f03000 HTTP/1.0" 202 Accepted 2026-03-14 20:52:38,017 - lava_callback - INFO - Starting async job submit for node 69b3278f6267e2e450f03000 2026-03-14 20:52:38,017 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 20:52:38,032 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b3278f6267e2e450f03000 HTTP/1.1" 200 None 2026-03-14 20:52:38,033 - lava_callback - DEBUG - Processing node 69b3278f6267e2e450f03000: baseline-arm-clabbe 2026-03-14 20:52:38,033 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b3278f6267e2e450f03000 2026-03-14 20:52:38,034 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 20:52:38,065 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b3278f6267e2e450f03000 HTTP/1.1" 200 None 2026-03-14 20:52:38,067 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 20:52:38,079 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b276654bce73bcf0233d14 HTTP/1.1" 200 None 2026-03-14 20:52:38,081 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 20:52:38,104 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b3278f6267e2e450f03000 HTTP/1.1" 200 None 2026-03-14 20:52:38,105 - lava_callback - ERROR - Error processing callback for node 69b3278f6267e2e450f03000: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:45678 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45688 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37648 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33470 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45026 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:45040 - "GET / HTTP/1.0" 200 OK 2026-03-14 20:53:18,072 - lava_callback - INFO - Received callback for node 69b327b66267e2e450f0300c INFO: 172.21.0.1:45046 - "POST /node/69b327b66267e2e450f0300c HTTP/1.0" 202 Accepted 2026-03-14 20:53:18,077 - lava_callback - INFO - Starting async job submit for node 69b327b66267e2e450f0300c 2026-03-14 20:53:18,079 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 20:53:18,093 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b327b66267e2e450f0300c HTTP/1.1" 200 None 2026-03-14 20:53:18,094 - lava_callback - DEBUG - Processing node 69b327b66267e2e450f0300c: baseline-arm-clabbe 2026-03-14 20:53:18,094 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b327b66267e2e450f0300c 2026-03-14 20:53:18,094 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 20:53:18,108 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b327b66267e2e450f0300c HTTP/1.1" 200 None 2026-03-14 20:53:18,109 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 20:53:18,122 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b276654bce73bcf0233d14 HTTP/1.1" 200 None 2026-03-14 20:53:18,123 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 20:53:18,144 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b327b66267e2e450f0300c HTTP/1.1" 200 None 2026-03-14 20:53:18,151 - lava_callback - ERROR - Error processing callback for node 69b327b66267e2e450f0300c: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:60808 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36476 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38440 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38442 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52506 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52516 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52526 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56054 - "GET / HTTP/1.0" 200 OK 2026-03-14 20:54:11,005 - lava_callback - INFO - Received callback for node 69b327e66267e2e450f03016 INFO: 172.21.0.1:51626 - "POST /node/69b327e66267e2e450f03016 HTTP/1.0" 202 Accepted 2026-03-14 20:54:11,011 - lava_callback - INFO - Starting async job submit for node 69b327e66267e2e450f03016 2026-03-14 20:54:11,012 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 20:54:11,026 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b327e66267e2e450f03016 HTTP/1.1" 200 None 2026-03-14 20:54:11,027 - lava_callback - DEBUG - Processing node 69b327e66267e2e450f03016: baseline-arm64-baylibre 2026-03-14 20:54:11,027 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b327e66267e2e450f03016 2026-03-14 20:54:11,028 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 20:54:11,042 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b327e66267e2e450f03016 HTTP/1.1" 200 None 2026-03-14 20:54:11,044 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 20:54:11,059 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aafea227cb11dcdfc758f1 HTTP/1.1" 200 None 2026-03-14 20:54:11,061 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 20:54:11,088 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b327e66267e2e450f03016 HTTP/1.1" 200 None 2026-03-14 20:54:11,090 - lava_callback - ERROR - Error processing callback for node 69b327e66267e2e450f03016: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:51638 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:51652 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48368 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57756 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51908 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51924 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49010 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40674 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49406 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:49414 - "GET / HTTP/1.0" 200 OK 2026-03-14 20:55:18,181 - lava_callback - INFO - Received callback for node 69b3282e6267e2e450f03021 INFO: 172.21.0.1:49424 - "POST /node/69b3282e6267e2e450f03021 HTTP/1.0" 202 Accepted 2026-03-14 20:55:18,186 - lava_callback - INFO - Starting async job submit for node 69b3282e6267e2e450f03021 2026-03-14 20:55:18,187 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 20:55:18,202 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b3282e6267e2e450f03021 HTTP/1.1" 200 None 2026-03-14 20:55:18,203 - lava_callback - DEBUG - Processing node 69b3282e6267e2e450f03021: baseline-arm-clabbe 2026-03-14 20:55:18,203 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b3282e6267e2e450f03021 2026-03-14 20:55:18,204 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 20:55:18,217 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b3282e6267e2e450f03021 HTTP/1.1" 200 None 2026-03-14 20:55:18,218 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 20:55:18,232 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b276654bce73bcf0233d14 HTTP/1.1" 200 None 2026-03-14 20:55:18,233 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 20:55:18,254 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b3282e6267e2e450f03021 HTTP/1.1" 200 None 2026-03-14 20:55:18,260 - lava_callback - ERROR - Error processing callback for node 69b3282e6267e2e450f03021: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:42166 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57014 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36544 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36558 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36574 - "GET /login HTTP/1.0" 404 Not Found INFO: 172.21.0.1:47220 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39418 - "GET / HTTP/1.0" 200 OK 2026-03-14 20:56:11,093 - lava_callback - INFO - Received callback for node 69b3285d6267e2e450f03030 INFO: 172.21.0.1:59690 - "POST /node/69b3285d6267e2e450f03030 HTTP/1.0" 202 Accepted 2026-03-14 20:56:11,099 - lava_callback - INFO - Starting async job submit for node 69b3285d6267e2e450f03030 2026-03-14 20:56:11,100 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 20:56:11,115 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b3285d6267e2e450f03030 HTTP/1.1" 200 None 2026-03-14 20:56:11,116 - lava_callback - DEBUG - Processing node 69b3285d6267e2e450f03030: baseline-arm64-baylibre 2026-03-14 20:56:11,116 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b3285d6267e2e450f03030 2026-03-14 20:56:11,117 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 20:56:11,130 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b3285d6267e2e450f03030 HTTP/1.1" 200 None 2026-03-14 20:56:11,131 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 20:56:11,146 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aafea227cb11dcdfc758f1 HTTP/1.1" 200 None 2026-03-14 20:56:11,148 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 20:56:11,168 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b3285d6267e2e450f03030 HTTP/1.1" 200 None 2026-03-14 20:56:11,169 - lava_callback - ERROR - Error processing callback for node 69b3285d6267e2e450f03030: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:59698 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:59706 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55256 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54586 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55086 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55100 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60872 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50644 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49604 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:49620 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56594 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36682 - "GET / HTTP/1.0" 200 OK 2026-03-14 20:57:38,292 - lava_callback - INFO - Received callback for node 69b328b46267e2e450f0303d INFO: 172.21.0.1:36692 - "POST /node/69b328b46267e2e450f0303d HTTP/1.0" 202 Accepted 2026-03-14 20:57:38,297 - lava_callback - INFO - Starting async job submit for node 69b328b46267e2e450f0303d 2026-03-14 20:57:38,298 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 20:57:38,312 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b328b46267e2e450f0303d HTTP/1.1" 200 None 2026-03-14 20:57:38,313 - lava_callback - DEBUG - Processing node 69b328b46267e2e450f0303d: baseline-arm64-clabbe 2026-03-14 20:57:38,313 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b328b46267e2e450f0303d 2026-03-14 20:57:38,314 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 20:57:38,327 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b328b46267e2e450f0303d HTTP/1.1" 200 None 2026-03-14 20:57:38,328 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 20:57:38,351 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aafea227cb11dcdfc758f1 HTTP/1.1" 200 None 2026-03-14 20:57:38,352 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 20:57:38,372 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b328b46267e2e450f0303d HTTP/1.1" 200 None 2026-03-14 20:57:38,381 - lava_callback - ERROR - Error processing callback for node 69b328b46267e2e450f0303d: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:49072 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49078 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54412 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58048 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58062 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50292 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:50296 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57824 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42862 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42626 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42636 - "GET / HTTP/1.0" 200 OK 2026-03-14 20:58:51,232 - lava_callback - INFO - Received callback for node 69b328fe6267e2e450f0304e INFO: 172.21.0.1:49480 - "POST /node/69b328fe6267e2e450f0304e HTTP/1.0" 202 Accepted 2026-03-14 20:58:51,238 - lava_callback - INFO - Starting async job submit for node 69b328fe6267e2e450f0304e 2026-03-14 20:58:51,239 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 20:58:51,276 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b328fe6267e2e450f0304e HTTP/1.1" 200 None 2026-03-14 20:58:51,277 - lava_callback - DEBUG - Processing node 69b328fe6267e2e450f0304e: baseline-arm64-baylibre 2026-03-14 20:58:51,277 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b328fe6267e2e450f0304e 2026-03-14 20:58:51,278 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 20:58:51,291 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b328fe6267e2e450f0304e HTTP/1.1" 200 None 2026-03-14 20:58:51,293 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 20:58:51,316 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69afd3b0c9209b146d8e1d77 HTTP/1.1" 200 None 2026-03-14 20:58:51,318 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 20:58:51,342 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b328fe6267e2e450f0304e HTTP/1.1" 200 None 2026-03-14 20:58:51,343 - lava_callback - ERROR - Error processing callback for node 69b328fe6267e2e450f0304e: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:49492 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36832 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35968 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:35982 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33398 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47792 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40170 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40180 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57526 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50650 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35668 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:35674 - "GET / HTTP/1.0" 200 OK 2026-03-14 21:00:18,493 - lava_callback - INFO - Received callback for node 69b329576267e2e450f03061 INFO: 172.21.0.1:35680 - "POST /node/69b329576267e2e450f03061 HTTP/1.0" 202 Accepted 2026-03-14 21:00:18,498 - lava_callback - INFO - Starting async job submit for node 69b329576267e2e450f03061 2026-03-14 21:00:18,499 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 21:00:18,519 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b329576267e2e450f03061 HTTP/1.1" 200 None 2026-03-14 21:00:18,520 - lava_callback - DEBUG - Processing node 69b329576267e2e450f03061: baseline-arm64-clabbe 2026-03-14 21:00:18,520 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b329576267e2e450f03061 2026-03-14 21:00:18,521 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 21:00:18,539 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b329576267e2e450f03061 HTTP/1.1" 200 None 2026-03-14 21:00:18,541 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 21:00:18,577 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aafea227cb11dcdfc758f1 HTTP/1.1" 200 None 2026-03-14 21:00:18,578 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 21:00:18,599 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b329576267e2e450f03061 HTTP/1.1" 200 None 2026-03-14 21:00:18,601 - lava_callback - ERROR - Error processing callback for node 69b329576267e2e450f03061: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:43760 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35934 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41994 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42006 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55010 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35464 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40298 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:40308 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53910 - "GET / HTTP/1.0" 200 OK 2026-03-14 21:01:31,399 - lava_callback - INFO - Received callback for node 69b329a16267e2e450f0306b INFO: 172.21.0.1:45282 - "POST /node/69b329a16267e2e450f0306b HTTP/1.0" 202 Accepted 2026-03-14 21:01:31,405 - lava_callback - INFO - Starting async job submit for node 69b329a16267e2e450f0306b 2026-03-14 21:01:31,405 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 21:01:31,429 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b329a16267e2e450f0306b HTTP/1.1" 200 None 2026-03-14 21:01:31,430 - lava_callback - DEBUG - Processing node 69b329a16267e2e450f0306b: baseline-arm64-baylibre 2026-03-14 21:01:31,430 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b329a16267e2e450f0306b 2026-03-14 21:01:31,431 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 21:01:31,449 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b329a16267e2e450f0306b HTTP/1.1" 200 None 2026-03-14 21:01:31,450 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 21:01:31,464 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69afd3b0c9209b146d8e1d77 HTTP/1.1" 200 None 2026-03-14 21:01:31,465 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 21:01:31,488 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b329a16267e2e450f0306b HTTP/1.1" 200 None 2026-03-14 21:01:31,493 - lava_callback - ERROR - Error processing callback for node 69b329a16267e2e450f0306b: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:45298 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51558 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51568 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60520 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34714 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36110 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:36112 - "GET / HTTP/1.0" 200 OK 2026-03-14 21:02:24,987 - lava_callback - INFO - Received callback for node 69b5c4ab1727ff69d6f266db INFO: 172.21.0.1:52710 - "POST /node/69b5c4ab1727ff69d6f266db HTTP/1.0" 202 Accepted 2026-03-14 21:02:24,994 - lava_callback - INFO - Starting async job submit for node 69b5c4ab1727ff69d6f266db 2026-03-14 21:02:25,014 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 21:02:25,030 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b5c4ab1727ff69d6f266db HTTP/1.1" 200 None 2026-03-14 21:02:25,031 - lava_callback - DEBUG - Processing node 69b5c4ab1727ff69d6f266db: baseline-arm64-broonie 2026-03-14 21:02:25,229 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-14 21:02:25,390 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-14 21:02:25,392 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69b5c4ab1727ff69d6f266db/log.txt.gz 2026-03-14 21:02:25,536 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-14 21:02:25,780 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-14 21:02:25,781 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69b5c4ab1727ff69d6f266db/lava-logs.yaml 2026-03-14 21:02:25,786 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-14 21:02:25,910 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-14 21:02:25,912 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69b5c4ab1727ff69d6f266db/lava_callback.json.gz 2026-03-14 21:02:25,931 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 21:02:25,953 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b5c4ab1727ff69d6f266db HTTP/1.1" 200 None 2026-03-14 21:02:25,954 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 21:02:25,968 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b3c8061727ff69d6f21d98 HTTP/1.1" 200 None 2026-03-14 21:02:25,970 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 21:02:25,993 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b5c4ab1727ff69d6f266db HTTP/1.1" 200 None 2026-03-14 21:02:26,027 - lava_callback - INFO - Completed processing callback for node 69b5c4ab1727ff69d6f266db INFO: 172.21.0.1:52718 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56170 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35224 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35230 - "GET / HTTP/1.0" 200 OK 2026-03-14 21:02:52,851 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 21:02:52,882 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:53842 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36398 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56524 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:56540 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48224 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51386 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53616 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53624 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49536 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40732 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46606 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:46620 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60998 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39626 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42004 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42010 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48496 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52106 - "GET / HTTP/1.0" 200 OK 2026-03-14 21:05:11,586 - lava_callback - INFO - Received callback for node 69b32a826267e2e450f03093 INFO: 172.21.0.1:37768 - "POST /node/69b32a826267e2e450f03093 HTTP/1.0" 202 Accepted 2026-03-14 21:05:11,592 - lava_callback - INFO - Starting async job submit for node 69b32a826267e2e450f03093 2026-03-14 21:05:11,593 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 21:05:11,634 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b32a826267e2e450f03093 HTTP/1.1" 200 None 2026-03-14 21:05:11,634 - lava_callback - DEBUG - Processing node 69b32a826267e2e450f03093: baseline-arm64-baylibre 2026-03-14 21:05:11,635 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b32a826267e2e450f03093 2026-03-14 21:05:11,635 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 21:05:11,650 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b32a826267e2e450f03093 HTTP/1.1" 200 None 2026-03-14 21:05:11,651 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 21:05:11,675 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69afd3b0c9209b146d8e1d77 HTTP/1.1" 200 None 2026-03-14 21:05:11,677 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 21:05:11,701 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b32a826267e2e450f03093 HTTP/1.1" 200 None 2026-03-14 21:05:11,702 - lava_callback - ERROR - Error processing callback for node 69b32a826267e2e450f03093: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:37776 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:37786 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53246 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40446 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38204 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38210 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47502 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38642 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59578 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:59592 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40446 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43236 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44702 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44706 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36740 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39286 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48562 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:48572 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54286 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38744 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40532 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40534 - "GET / HTTP/1.0" 200 OK 2026-03-14 21:07:51,741 - lava_callback - INFO - Received callback for node 69b32b1f6267e2e450f030a9 INFO: 172.21.0.1:57118 - "POST /node/69b32b1f6267e2e450f030a9 HTTP/1.0" 202 Accepted 2026-03-14 21:07:51,747 - lava_callback - INFO - Starting async job submit for node 69b32b1f6267e2e450f030a9 2026-03-14 21:07:51,747 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 21:07:51,765 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b32b1f6267e2e450f030a9 HTTP/1.1" 200 None 2026-03-14 21:07:51,766 - lava_callback - DEBUG - Processing node 69b32b1f6267e2e450f030a9: baseline-arm64-baylibre 2026-03-14 21:07:51,766 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b32b1f6267e2e450f030a9 2026-03-14 21:07:51,767 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 21:07:51,798 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b32b1f6267e2e450f030a9 HTTP/1.1" 200 None 2026-03-14 21:07:51,799 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 21:07:51,817 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69afd3b0c9209b146d8e1d77 HTTP/1.1" 200 None 2026-03-14 21:07:51,819 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 21:07:51,844 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b32b1f6267e2e450f030a9 HTTP/1.1" 200 None 2026-03-14 21:07:51,846 - lava_callback - ERROR - Error processing callback for node 69b32b1f6267e2e450f030a9: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:57122 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50284 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52898 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:52914 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38668 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39522 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52538 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52550 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49042 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51990 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33606 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:33612 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59430 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40924 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53310 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53318 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39754 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41560 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52966 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:52974 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50634 - "GET / HTTP/1.0" 200 OK 2026-03-14 21:10:31,801 - lava_callback - INFO - Received callback for node 69b32bbf6267e2e450f030c0 INFO: 172.21.0.1:54462 - "POST /node/69b32bbf6267e2e450f030c0 HTTP/1.0" 202 Accepted 2026-03-14 21:10:31,807 - lava_callback - INFO - Starting async job submit for node 69b32bbf6267e2e450f030c0 2026-03-14 21:10:31,808 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 21:10:31,824 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b32bbf6267e2e450f030c0 HTTP/1.1" 200 None 2026-03-14 21:10:31,825 - lava_callback - DEBUG - Processing node 69b32bbf6267e2e450f030c0: baseline-arm64-baylibre 2026-03-14 21:10:31,825 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b32bbf6267e2e450f030c0 2026-03-14 21:10:31,826 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 21:10:31,839 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b32bbf6267e2e450f030c0 HTTP/1.1" 200 None 2026-03-14 21:10:31,840 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 21:10:31,862 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69afd3b0c9209b146d8e1d77 HTTP/1.1" 200 None 2026-03-14 21:10:31,864 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 21:10:31,885 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b32bbf6267e2e450f030c0 HTTP/1.1" 200 None 2026-03-14 21:10:31,892 - lava_callback - ERROR - Error processing callback for node 69b32bbf6267e2e450f030c0: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:54470 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43050 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43060 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49742 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57198 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54812 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:54824 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41996 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34198 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48662 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48672 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45714 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43674 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33122 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:33134 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56378 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60698 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46068 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46072 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49716 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52732 - "GET / HTTP/1.0" 200 OK 2026-03-14 21:13:12,074 - lava_callback - INFO - Received callback for node 69b32c5e6267e2e450f030e0 INFO: 172.21.0.1:58690 - "POST /node/69b32c5e6267e2e450f030e0 HTTP/1.0" 202 Accepted 2026-03-14 21:13:12,079 - lava_callback - INFO - Starting async job submit for node 69b32c5e6267e2e450f030e0 2026-03-14 21:13:12,080 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 21:13:12,106 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b32c5e6267e2e450f030e0 HTTP/1.1" 200 None 2026-03-14 21:13:12,106 - lava_callback - DEBUG - Processing node 69b32c5e6267e2e450f030e0: baseline-arm64-baylibre 2026-03-14 21:13:12,107 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b32c5e6267e2e450f030e0 2026-03-14 21:13:12,107 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 21:13:12,140 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b32c5e6267e2e450f030e0 HTTP/1.1" 200 None 2026-03-14 21:13:12,142 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 21:13:12,162 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69afd3b0c9209b146d8e1d77 HTTP/1.1" 200 None 2026-03-14 21:13:12,163 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 21:13:12,211 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b32c5e6267e2e450f030e0 HTTP/1.1" 200 None 2026-03-14 21:13:12,213 - lava_callback - ERROR - Error processing callback for node 69b32c5e6267e2e450f030e0: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:58696 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:58704 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55216 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48282 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35680 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35692 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43514 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44332 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:32848 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:32852 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42028 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57938 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42816 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42828 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43280 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:32960 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54578 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:54580 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57004 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56852 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44958 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44964 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37224 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41072 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58186 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:58190 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37410 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59524 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60244 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60258 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48816 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36222 - "GET / HTTP/1.0" 200 OK 2026-03-14 21:17:12,309 - lava_callback - INFO - Received callback for node 69b32d466267e2e450f0310e INFO: 172.21.0.1:36746 - "POST /node/69b32d466267e2e450f0310e HTTP/1.0" 202 Accepted 2026-03-14 21:17:12,315 - lava_callback - INFO - Starting async job submit for node 69b32d466267e2e450f0310e 2026-03-14 21:17:12,315 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 21:17:12,332 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b32d466267e2e450f0310e HTTP/1.1" 200 None 2026-03-14 21:17:12,333 - lava_callback - DEBUG - Processing node 69b32d466267e2e450f0310e: baseline-arm64-baylibre 2026-03-14 21:17:12,334 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b32d466267e2e450f0310e 2026-03-14 21:17:12,334 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 21:17:12,369 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b32d466267e2e450f0310e HTTP/1.1" 200 None 2026-03-14 21:17:12,370 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 21:17:12,392 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69afd3b0c9209b146d8e1d77 HTTP/1.1" 200 None 2026-03-14 21:17:12,393 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 21:17:12,415 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b32d466267e2e450f0310e HTTP/1.1" 200 None 2026-03-14 21:17:12,421 - lava_callback - ERROR - Error processing callback for node 69b32d466267e2e450f0310e: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:36756 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:36762 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52578 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58994 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39350 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39358 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55046 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42372 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38834 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:38846 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42498 - "GET / HTTP/1.0" 200 OK 2026-03-14 21:18:32,294 - lava_callback - INFO - Received callback for node 69b32d966267e2e450f03121 INFO: 172.21.0.1:46440 - "POST /node/69b32d966267e2e450f03121 HTTP/1.0" 202 Accepted 2026-03-14 21:18:32,299 - lava_callback - INFO - Starting async job submit for node 69b32d966267e2e450f03121 2026-03-14 21:18:32,300 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 21:18:32,314 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b32d966267e2e450f03121 HTTP/1.1" 200 None 2026-03-14 21:18:32,315 - lava_callback - DEBUG - Processing node 69b32d966267e2e450f03121: baseline-arm64-baylibre 2026-03-14 21:18:32,316 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b32d966267e2e450f03121 2026-03-14 21:18:32,316 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 21:18:32,330 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b32d966267e2e450f03121 HTTP/1.1" 200 None 2026-03-14 21:18:32,331 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 21:18:32,345 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69afd3b0c9209b146d8e1d77 HTTP/1.1" 200 None 2026-03-14 21:18:32,346 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 21:18:32,367 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b32d966267e2e450f03121 HTTP/1.1" 200 None 2026-03-14 21:18:32,376 - lava_callback - ERROR - Error processing callback for node 69b32d966267e2e450f03121: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:46452 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36748 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36762 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46768 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46778 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60482 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:60486 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59324 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55956 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44498 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44508 - "GET / HTTP/1.0" 200 OK 2026-03-14 21:19:52,543 - lava_callback - INFO - Received callback for node 69b32de56267e2e450f03136 INFO: 172.21.0.1:55566 - "POST /node/69b32de56267e2e450f03136 HTTP/1.0" 202 Accepted 2026-03-14 21:19:52,549 - lava_callback - INFO - Starting async job submit for node 69b32de56267e2e450f03136 2026-03-14 21:19:52,550 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 21:19:52,569 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b32de56267e2e450f03136 HTTP/1.1" 200 None 2026-03-14 21:19:52,570 - lava_callback - DEBUG - Processing node 69b32de56267e2e450f03136: baseline-arm64-baylibre 2026-03-14 21:19:52,571 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b32de56267e2e450f03136 2026-03-14 21:19:52,571 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 21:19:52,585 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b32de56267e2e450f03136 HTTP/1.1" 200 None 2026-03-14 21:19:52,586 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 21:19:52,620 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69afd3b0c9209b146d8e1d77 HTTP/1.1" 200 None 2026-03-14 21:19:52,621 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 21:19:52,651 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b32de56267e2e450f03136 HTTP/1.1" 200 None 2026-03-14 21:19:52,652 - lava_callback - ERROR - Error processing callback for node 69b32de56267e2e450f03136: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:55572 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54400 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37944 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:37958 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33238 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34836 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50162 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50170 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59012 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36714 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57234 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:57250 - "GET / HTTP/1.0" 200 OK 2026-03-14 21:21:19,493 - lava_callback - INFO - Received callback for node 69b32e3a6267e2e450f03141 INFO: 172.21.0.1:57258 - "POST /node/69b32e3a6267e2e450f03141 HTTP/1.0" 202 Accepted 2026-03-14 21:21:19,498 - lava_callback - INFO - Starting async job submit for node 69b32e3a6267e2e450f03141 2026-03-14 21:21:19,499 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 21:21:19,523 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b32e3a6267e2e450f03141 HTTP/1.1" 200 None 2026-03-14 21:21:19,524 - lava_callback - DEBUG - Processing node 69b32e3a6267e2e450f03141: baseline-arm64-clabbe 2026-03-14 21:21:19,524 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b32e3a6267e2e450f03141 2026-03-14 21:21:19,524 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 21:21:19,538 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b32e3a6267e2e450f03141 HTTP/1.1" 200 None 2026-03-14 21:21:19,540 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 21:21:19,567 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69afd3b0c9209b146d8e1d77 HTTP/1.1" 200 None 2026-03-14 21:21:19,569 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 21:21:19,601 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b32e3a6267e2e450f03141 HTTP/1.1" 200 None 2026-03-14 21:21:19,603 - lava_callback - ERROR - Error processing callback for node 69b32e3a6267e2e450f03141: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:51244 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58750 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46816 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46824 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53896 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56506 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34298 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:34304 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48906 - "GET / HTTP/1.0" 200 OK 2026-03-14 21:22:32,448 - lava_callback - INFO - Received callback for node 69b32e836267e2e450f03157 INFO: 172.21.0.1:58396 - "POST /node/69b32e836267e2e450f03157 HTTP/1.0" 202 Accepted 2026-03-14 21:22:32,453 - lava_callback - INFO - Starting async job submit for node 69b32e836267e2e450f03157 2026-03-14 21:22:32,455 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 21:22:32,471 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b32e836267e2e450f03157 HTTP/1.1" 200 None 2026-03-14 21:22:32,472 - lava_callback - DEBUG - Processing node 69b32e836267e2e450f03157: baseline-arm64-baylibre 2026-03-14 21:22:32,472 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b32e836267e2e450f03157 2026-03-14 21:22:32,473 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 21:22:32,486 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b32e836267e2e450f03157 HTTP/1.1" 200 None 2026-03-14 21:22:32,487 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 21:22:32,501 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69afd3b0c9209b146d8e1d77 HTTP/1.1" 200 None 2026-03-14 21:22:32,502 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 21:22:32,526 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b32e836267e2e450f03157 HTTP/1.1" 200 None 2026-03-14 21:22:32,528 - lava_callback - ERROR - Error processing callback for node 69b32e836267e2e450f03157: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:58402 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35418 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35428 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58300 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44228 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47062 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:47072 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45014 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46968 - "GET / HTTP/1.0" 200 OK 2026-03-14 21:23:39,439 - lava_callback - INFO - Received callback for node 69b32ed76267e2e450f03171 INFO: 172.21.0.1:46972 - "POST /node/69b32ed76267e2e450f03171 HTTP/1.0" 202 Accepted 2026-03-14 21:23:39,444 - lava_callback - INFO - Starting async job submit for node 69b32ed76267e2e450f03171 2026-03-14 21:23:39,445 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 21:23:39,467 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b32ed76267e2e450f03171 HTTP/1.1" 200 None 2026-03-14 21:23:39,468 - lava_callback - DEBUG - Processing node 69b32ed76267e2e450f03171: baseline-arm64-clabbe 2026-03-14 21:23:39,468 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b32ed76267e2e450f03171 2026-03-14 21:23:39,469 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 21:23:39,487 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b32ed76267e2e450f03171 HTTP/1.1" 200 None 2026-03-14 21:23:39,489 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 21:23:39,504 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69afd3b0c9209b146d8e1d77 HTTP/1.1" 200 None 2026-03-14 21:23:39,506 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 21:23:39,535 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b32ed76267e2e450f03171 HTTP/1.1" 200 None 2026-03-14 21:23:39,536 - lava_callback - ERROR - Error processing callback for node 69b32ed76267e2e450f03171: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:36262 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36268 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53962 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50564 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53576 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:53590 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35982 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52074 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54838 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54848 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38942 - "GET / HTTP/1.0" 200 OK 2026-03-14 21:24:59,490 - lava_callback - INFO - Received callback for node 69b32f276267e2e450f0317b INFO: 172.21.0.1:38950 - "POST /node/69b32f276267e2e450f0317b HTTP/1.0" 202 Accepted 2026-03-14 21:24:59,496 - lava_callback - INFO - Starting async job submit for node 69b32f276267e2e450f0317b 2026-03-14 21:24:59,496 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 21:24:59,516 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b32f276267e2e450f0317b HTTP/1.1" 200 None 2026-03-14 21:24:59,517 - lava_callback - DEBUG - Processing node 69b32f276267e2e450f0317b: baseline-arm64-clabbe 2026-03-14 21:24:59,518 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b32f276267e2e450f0317b 2026-03-14 21:24:59,518 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 21:24:59,531 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b32f276267e2e450f0317b HTTP/1.1" 200 None 2026-03-14 21:24:59,532 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 21:24:59,545 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69afd3b0c9209b146d8e1d77 HTTP/1.1" 200 None 2026-03-14 21:24:59,546 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 21:24:59,566 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b32f276267e2e450f0317b HTTP/1.1" 200 None 2026-03-14 21:24:59,573 - lava_callback - ERROR - Error processing callback for node 69b32f276267e2e450f0317b: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:39144 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51664 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:51670 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35896 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46458 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37616 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37620 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54626 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47552 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52454 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:52456 - "GET / HTTP/1.0" 200 OK 2026-03-14 21:26:19,547 - lava_callback - INFO - Received callback for node 69b32f756267e2e450f03190 INFO: 172.21.0.1:52466 - "POST /node/69b32f756267e2e450f03190 HTTP/1.0" 202 Accepted 2026-03-14 21:26:19,553 - lava_callback - INFO - Starting async job submit for node 69b32f756267e2e450f03190 2026-03-14 21:26:19,554 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 21:26:19,590 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b32f756267e2e450f03190 HTTP/1.1" 200 None 2026-03-14 21:26:19,591 - lava_callback - DEBUG - Processing node 69b32f756267e2e450f03190: baseline-arm64-clabbe 2026-03-14 21:26:19,591 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b32f756267e2e450f03190 2026-03-14 21:26:19,591 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 21:26:19,621 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b32f756267e2e450f03190 HTTP/1.1" 200 None 2026-03-14 21:26:19,622 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 21:26:19,637 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69afd3b0c9209b146d8e1d77 HTTP/1.1" 200 None 2026-03-14 21:26:19,639 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 21:26:19,666 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b32f756267e2e450f03190 HTTP/1.1" 200 None 2026-03-14 21:26:19,667 - lava_callback - ERROR - Error processing callback for node 69b32f756267e2e450f03190: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:35144 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54986 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43206 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43214 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40612 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35592 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40600 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:40614 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36496 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49116 - "GET / HTTP/1.0" 200 OK 2026-03-14 21:27:39,617 - lava_callback - INFO - Received callback for node 69b32fc56267e2e450f031a1 INFO: 172.21.0.1:49122 - "POST /node/69b32fc56267e2e450f031a1 HTTP/1.0" 202 Accepted 2026-03-14 21:27:39,622 - lava_callback - INFO - Starting async job submit for node 69b32fc56267e2e450f031a1 2026-03-14 21:27:39,624 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 21:27:39,639 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b32fc56267e2e450f031a1 HTTP/1.1" 200 None 2026-03-14 21:27:39,639 - lava_callback - DEBUG - Processing node 69b32fc56267e2e450f031a1: baseline-arm64-clabbe 2026-03-14 21:27:39,640 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b32fc56267e2e450f031a1 2026-03-14 21:27:39,640 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 21:27:39,683 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b32fc56267e2e450f031a1 HTTP/1.1" 200 None 2026-03-14 21:27:39,685 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 21:27:39,699 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69afd3b0c9209b146d8e1d77 HTTP/1.1" 200 None 2026-03-14 21:27:39,701 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 21:27:39,726 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b32fc56267e2e450f031a1 HTTP/1.1" 200 None 2026-03-14 21:27:39,728 - lava_callback - ERROR - Error processing callback for node 69b32fc56267e2e450f031a1: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:38764 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38768 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57110 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34044 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44024 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:44032 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44948 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53902 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49692 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49704 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51182 - "GET / HTTP/1.0" 200 OK 2026-03-14 21:28:59,688 - lava_callback - INFO - Received callback for node 69b330136267e2e450f031b3 INFO: 172.21.0.1:51190 - "POST /node/69b330136267e2e450f031b3 HTTP/1.0" 202 Accepted 2026-03-14 21:28:59,693 - lava_callback - INFO - Starting async job submit for node 69b330136267e2e450f031b3 2026-03-14 21:28:59,694 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 21:28:59,709 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b330136267e2e450f031b3 HTTP/1.1" 200 None 2026-03-14 21:28:59,709 - lava_callback - DEBUG - Processing node 69b330136267e2e450f031b3: baseline-arm64-clabbe 2026-03-14 21:28:59,710 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b330136267e2e450f031b3 2026-03-14 21:28:59,710 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 21:28:59,723 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b330136267e2e450f031b3 HTTP/1.1" 200 None 2026-03-14 21:28:59,725 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 21:28:59,738 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69afd3b0c9209b146d8e1d77 HTTP/1.1" 200 None 2026-03-14 21:28:59,740 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 21:28:59,761 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b330136267e2e450f031b3 HTTP/1.1" 200 None 2026-03-14 21:28:59,762 - lava_callback - ERROR - Error processing callback for node 69b330136267e2e450f031b3: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:55218 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44356 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:44366 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46278 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43126 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37084 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37088 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36582 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39256 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49044 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:49060 - "GET / HTTP/1.0" 200 OK 2026-03-14 21:30:19,755 - lava_callback - INFO - Received callback for node 69b330626267e2e450f031c9 INFO: 172.21.0.1:60466 - "POST /node/69b330626267e2e450f031c9 HTTP/1.0" 202 Accepted 2026-03-14 21:30:19,760 - lava_callback - INFO - Starting async job submit for node 69b330626267e2e450f031c9 2026-03-14 21:30:19,761 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 21:30:19,787 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b330626267e2e450f031c9 HTTP/1.1" 200 None 2026-03-14 21:30:19,788 - lava_callback - DEBUG - Processing node 69b330626267e2e450f031c9: baseline-arm64-clabbe 2026-03-14 21:30:19,788 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b330626267e2e450f031c9 2026-03-14 21:30:19,789 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 21:30:19,803 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b330626267e2e450f031c9 HTTP/1.1" 200 None 2026-03-14 21:30:19,804 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 21:30:19,817 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69afd3b0c9209b146d8e1d77 HTTP/1.1" 200 None 2026-03-14 21:30:19,819 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 21:30:19,839 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b330626267e2e450f031c9 HTTP/1.1" 200 None 2026-03-14 21:30:19,840 - lava_callback - ERROR - Error processing callback for node 69b330626267e2e450f031c9: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:60472 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38632 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45898 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45906 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47668 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52214 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59018 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:59028 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48930 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49060 - "GET / HTTP/1.0" 200 OK 2026-03-14 21:31:39,829 - lava_callback - INFO - Received callback for node 69b330af6267e2e450f031d5 INFO: 172.21.0.1:58576 - "POST /node/69b330af6267e2e450f031d5 HTTP/1.0" 202 Accepted 2026-03-14 21:31:39,834 - lava_callback - INFO - Starting async job submit for node 69b330af6267e2e450f031d5 2026-03-14 21:31:39,835 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 21:31:39,871 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b330af6267e2e450f031d5 HTTP/1.1" 200 None 2026-03-14 21:31:39,871 - lava_callback - DEBUG - Processing node 69b330af6267e2e450f031d5: baseline-arm64-clabbe 2026-03-14 21:31:39,872 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b330af6267e2e450f031d5 2026-03-14 21:31:39,872 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 21:31:39,909 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b330af6267e2e450f031d5 HTTP/1.1" 200 None 2026-03-14 21:31:39,911 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 21:31:39,925 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69afd3b0c9209b146d8e1d77 HTTP/1.1" 200 None 2026-03-14 21:31:39,926 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 21:31:39,946 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b330af6267e2e450f031d5 HTTP/1.1" 200 None 2026-03-14 21:31:39,948 - lava_callback - ERROR - Error processing callback for node 69b330af6267e2e450f031d5: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:58590 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58598 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53990 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53506 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36208 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:36210 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60342 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43874 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55686 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55698 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36730 - "GET / HTTP/1.0" 200 OK 2026-03-14 21:32:59,870 - lava_callback - INFO - Received callback for node 69b330fc6267e2e450f031e8 INFO: 172.21.0.1:60600 - "POST /node/69b330fc6267e2e450f031e8 HTTP/1.0" 202 Accepted 2026-03-14 21:32:59,876 - lava_callback - INFO - Starting async job submit for node 69b330fc6267e2e450f031e8 2026-03-14 21:32:59,876 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 21:32:59,914 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b330fc6267e2e450f031e8 HTTP/1.1" 200 None 2026-03-14 21:32:59,915 - lava_callback - DEBUG - Processing node 69b330fc6267e2e450f031e8: baseline-arm64-clabbe 2026-03-14 21:32:59,916 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b330fc6267e2e450f031e8 2026-03-14 21:32:59,916 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 21:32:59,950 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b330fc6267e2e450f031e8 HTTP/1.1" 200 None 2026-03-14 21:32:59,952 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 21:32:59,987 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69afd3b0c9209b146d8e1d77 HTTP/1.1" 200 None 2026-03-14 21:32:59,988 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 21:33:00,022 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b330fc6267e2e450f031e8 HTTP/1.1" 200 None 2026-03-14 21:33:00,027 - lava_callback - ERROR - Error processing callback for node 69b330fc6267e2e450f031e8: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:60604 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34878 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:34892 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47412 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38012 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56154 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56158 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40392 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58550 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34348 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:34350 - "GET / HTTP/1.0" 200 OK 2026-03-14 21:34:19,914 - lava_callback - INFO - Received callback for node 69b331496267e2e450f031f4 INFO: 172.21.0.1:35914 - "POST /node/69b331496267e2e450f031f4 HTTP/1.0" 202 Accepted 2026-03-14 21:34:19,920 - lava_callback - INFO - Starting async job submit for node 69b331496267e2e450f031f4 2026-03-14 21:34:19,921 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 21:34:19,935 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b331496267e2e450f031f4 HTTP/1.1" 200 None 2026-03-14 21:34:19,936 - lava_callback - DEBUG - Processing node 69b331496267e2e450f031f4: baseline-arm64-clabbe 2026-03-14 21:34:19,936 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b331496267e2e450f031f4 2026-03-14 21:34:19,937 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 21:34:19,951 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b331496267e2e450f031f4 HTTP/1.1" 200 None 2026-03-14 21:34:19,952 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 21:34:19,966 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69afd3b0c9209b146d8e1d77 HTTP/1.1" 200 None 2026-03-14 21:34:19,968 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 21:34:19,995 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b331496267e2e450f031f4 HTTP/1.1" 200 None 2026-03-14 21:34:19,996 - lava_callback - ERROR - Error processing callback for node 69b331496267e2e450f031f4: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:35930 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40898 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51118 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51128 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52156 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54582 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50840 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:50848 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51488 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41334 - "GET / HTTP/1.0" 200 OK 2026-03-14 21:35:39,994 - lava_callback - INFO - Received callback for node 69b331966267e2e450f03206 INFO: 172.21.0.1:43052 - "POST /node/69b331966267e2e450f03206 HTTP/1.0" 202 Accepted 2026-03-14 21:35:40,000 - lava_callback - INFO - Starting async job submit for node 69b331966267e2e450f03206 2026-03-14 21:35:40,001 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 21:35:40,023 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b331966267e2e450f03206 HTTP/1.1" 200 None 2026-03-14 21:35:40,024 - lava_callback - DEBUG - Processing node 69b331966267e2e450f03206: baseline-arm64-clabbe 2026-03-14 21:35:40,025 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b331966267e2e450f03206 2026-03-14 21:35:40,025 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 21:35:40,044 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b331966267e2e450f03206 HTTP/1.1" 200 None 2026-03-14 21:35:40,045 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 21:35:40,060 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69afd3b0c9209b146d8e1d77 HTTP/1.1" 200 None 2026-03-14 21:35:40,061 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 21:35:40,091 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b331966267e2e450f03206 HTTP/1.1" 200 None 2026-03-14 21:35:40,093 - lava_callback - ERROR - Error processing callback for node 69b331966267e2e450f03206: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:43064 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43068 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:32910 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59184 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33688 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:33702 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38776 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54578 - "GET / HTTP/1.0" 200 OK 2026-03-14 21:36:40,031 - lava_callback - INFO - Received callback for node 69b331e56267e2e450f03217 INFO: 172.21.0.1:45270 - "POST /node/69b331e56267e2e450f03217 HTTP/1.0" 202 Accepted 2026-03-14 21:36:40,037 - lava_callback - INFO - Starting async job submit for node 69b331e56267e2e450f03217 2026-03-14 21:36:40,037 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 21:36:40,061 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b331e56267e2e450f03217 HTTP/1.1" 200 None 2026-03-14 21:36:40,062 - lava_callback - DEBUG - Processing node 69b331e56267e2e450f03217: baseline-arm64-clabbe 2026-03-14 21:36:40,062 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b331e56267e2e450f03217 2026-03-14 21:36:40,063 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 21:36:40,088 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b331e56267e2e450f03217 HTTP/1.1" 200 None 2026-03-14 21:36:40,090 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 21:36:40,103 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69afd3b0c9209b146d8e1d77 HTTP/1.1" 200 None 2026-03-14 21:36:40,104 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 21:36:40,156 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b331e56267e2e450f03217 HTTP/1.1" 200 None 2026-03-14 21:36:40,158 - lava_callback - ERROR - Error processing callback for node 69b331e56267e2e450f03217: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:45280 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45282 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57782 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46340 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34254 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:34270 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44892 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53656 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40180 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40196 - "GET / HTTP/1.0" 200 OK 2026-03-14 21:37:53,357 - lava_callback - INFO - Received callback for node 69b332206267e2e450f0321d INFO: 172.21.0.1:47690 - "POST /node/69b332206267e2e450f0321d HTTP/1.0" 202 Accepted 2026-03-14 21:37:53,362 - lava_callback - INFO - Starting async job submit for node 69b332206267e2e450f0321d 2026-03-14 21:37:53,363 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 21:37:53,378 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b332206267e2e450f0321d HTTP/1.1" 200 None 2026-03-14 21:37:53,379 - lava_callback - DEBUG - Processing node 69b332206267e2e450f0321d: baseline-arm-baylibre 2026-03-14 21:37:53,379 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b332206267e2e450f0321d 2026-03-14 21:37:53,380 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 21:37:53,417 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b332206267e2e450f0321d HTTP/1.1" 200 None 2026-03-14 21:37:53,418 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 21:37:53,432 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69afd3a3c9209b146d8e1d68 HTTP/1.1" 200 None 2026-03-14 21:37:53,434 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 21:37:53,472 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b332206267e2e450f0321d HTTP/1.1" 200 None 2026-03-14 21:37:53,479 - lava_callback - ERROR - Error processing callback for node 69b332206267e2e450f0321d: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:47692 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47020 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37826 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:37838 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40962 - "GET / HTTP/1.0" 200 OK 2026-03-14 21:38:33,286 - lava_callback - INFO - Received callback for node 69b332446267e2e450f03227 INFO: 172.21.0.1:40754 - "POST /node/69b332446267e2e450f03227 HTTP/1.0" 202 Accepted 2026-03-14 21:38:33,292 - lava_callback - INFO - Starting async job submit for node 69b332446267e2e450f03227 2026-03-14 21:38:33,293 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 21:38:33,307 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b332446267e2e450f03227 HTTP/1.1" 200 None 2026-03-14 21:38:33,308 - lava_callback - DEBUG - Processing node 69b332446267e2e450f03227: baseline-arm-baylibre 2026-03-14 21:38:33,308 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b332446267e2e450f03227 2026-03-14 21:38:33,309 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 21:38:33,321 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b332446267e2e450f03227 HTTP/1.1" 200 None 2026-03-14 21:38:33,323 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 21:38:33,336 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69afd3a3c9209b146d8e1d68 HTTP/1.1" 200 None 2026-03-14 21:38:33,338 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 21:38:33,359 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b332446267e2e450f03227 HTTP/1.1" 200 None 2026-03-14 21:38:33,364 - lava_callback - ERROR - Error processing callback for node 69b332446267e2e450f03227: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:40760 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60534 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60550 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38572 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58020 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41096 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:41098 - "GET / HTTP/1.0" 200 OK 2026-03-14 21:39:20,148 - lava_callback - INFO - Received callback for node 69b332796267e2e450f0323b INFO: 172.21.0.1:55628 - "POST /node/69b332796267e2e450f0323b HTTP/1.0" 202 Accepted 2026-03-14 21:39:20,154 - lava_callback - INFO - Starting async job submit for node 69b332796267e2e450f0323b 2026-03-14 21:39:20,155 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 21:39:20,169 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b332796267e2e450f0323b HTTP/1.1" 200 None 2026-03-14 21:39:20,170 - lava_callback - DEBUG - Processing node 69b332796267e2e450f0323b: baseline-arm64-clabbe 2026-03-14 21:39:20,171 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b332796267e2e450f0323b 2026-03-14 21:39:20,171 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 21:39:20,191 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b332796267e2e450f0323b HTTP/1.1" 200 None 2026-03-14 21:39:20,193 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 21:39:20,207 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69afd3b0c9209b146d8e1d77 HTTP/1.1" 200 None 2026-03-14 21:39:20,209 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 21:39:20,241 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b332796267e2e450f0323b HTTP/1.1" 200 None 2026-03-14 21:39:20,242 - lava_callback - ERROR - Error processing callback for node 69b332796267e2e450f0323b: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:55630 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51834 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48306 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48314 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44604 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48014 - "GET / HTTP/1.0" 200 OK 2026-03-14 21:40:13,516 - lava_callback - INFO - Received callback for node 69b332b46267e2e450f03246 INFO: 172.21.0.1:38126 - "POST /node/69b332b46267e2e450f03246 HTTP/1.0" 202 Accepted 2026-03-14 21:40:13,521 - lava_callback - INFO - Starting async job submit for node 69b332b46267e2e450f03246 2026-03-14 21:40:13,522 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 21:40:13,551 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b332b46267e2e450f03246 HTTP/1.1" 200 None 2026-03-14 21:40:13,552 - lava_callback - DEBUG - Processing node 69b332b46267e2e450f03246: baseline-arm-baylibre 2026-03-14 21:40:13,552 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b332b46267e2e450f03246 2026-03-14 21:40:13,553 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 21:40:13,574 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b332b46267e2e450f03246 HTTP/1.1" 200 None 2026-03-14 21:40:13,576 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 21:40:13,599 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69afd3a3c9209b146d8e1d68 HTTP/1.1" 200 None 2026-03-14 21:40:13,600 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 21:40:13,622 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b332b46267e2e450f03246 HTTP/1.1" 200 None 2026-03-14 21:40:13,624 - lava_callback - ERROR - Error processing callback for node 69b332b46267e2e450f03246: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:38140 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:38144 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42546 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58488 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33824 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33840 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55464 - "GET / HTTP/1.0" 200 OK 2026-03-14 21:41:00,245 - lava_callback - INFO - Received callback for node 69b332e96267e2e450f03252 INFO: 172.21.0.1:34050 - "POST /node/69b332e96267e2e450f03252 HTTP/1.0" 202 Accepted 2026-03-14 21:41:00,251 - lava_callback - INFO - Starting async job submit for node 69b332e96267e2e450f03252 2026-03-14 21:41:00,252 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 21:41:00,267 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b332e96267e2e450f03252 HTTP/1.1" 200 None 2026-03-14 21:41:00,268 - lava_callback - DEBUG - Processing node 69b332e96267e2e450f03252: baseline-arm64-clabbe 2026-03-14 21:41:00,268 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b332e96267e2e450f03252 2026-03-14 21:41:00,269 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 21:41:00,283 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b332e96267e2e450f03252 HTTP/1.1" 200 None 2026-03-14 21:41:00,284 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 21:41:00,298 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69afd3b0c9209b146d8e1d77 HTTP/1.1" 200 None 2026-03-14 21:41:00,299 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 21:41:00,323 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b332e96267e2e450f03252 HTTP/1.1" 200 None 2026-03-14 21:41:00,329 - lava_callback - ERROR - Error processing callback for node 69b332e96267e2e450f03252: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:34062 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43962 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:43964 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56472 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42710 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51382 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51388 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36446 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52692 - "GET / HTTP/1.0" 200 OK 2026-03-14 21:42:13,569 - lava_callback - INFO - Received callback for node 69b333256267e2e450f03261 INFO: 172.21.0.1:47040 - "POST /node/69b333256267e2e450f03261 HTTP/1.0" 202 Accepted 2026-03-14 21:42:13,574 - lava_callback - INFO - Starting async job submit for node 69b333256267e2e450f03261 2026-03-14 21:42:13,575 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 21:42:13,590 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b333256267e2e450f03261 HTTP/1.1" 200 None 2026-03-14 21:42:13,590 - lava_callback - DEBUG - Processing node 69b333256267e2e450f03261: baseline-arm-baylibre 2026-03-14 21:42:13,591 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b333256267e2e450f03261 2026-03-14 21:42:13,591 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 21:42:13,604 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b333256267e2e450f03261 HTTP/1.1" 200 None 2026-03-14 21:42:13,605 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 21:42:13,618 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69afd3a3c9209b146d8e1d68 HTTP/1.1" 200 None 2026-03-14 21:42:13,620 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 21:42:13,646 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b333256267e2e450f03261 HTTP/1.1" 200 None 2026-03-14 21:42:13,656 - lava_callback - ERROR - Error processing callback for node 69b333256267e2e450f03261: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:47050 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:47054 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48712 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42042 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33172 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33182 - "GET / HTTP/1.0" 200 OK 2026-03-14 21:42:53,563 - lava_callback - INFO - Received callback for node 69b3334a6267e2e450f0326d INFO: 172.21.0.1:43030 - "POST /node/69b3334a6267e2e450f0326d HTTP/1.0" 202 Accepted 2026-03-14 21:42:53,568 - lava_callback - INFO - Starting async job submit for node 69b3334a6267e2e450f0326d 2026-03-14 21:42:53,569 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 21:42:53,584 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b3334a6267e2e450f0326d HTTP/1.1" 200 None 2026-03-14 21:42:53,585 - lava_callback - DEBUG - Processing node 69b3334a6267e2e450f0326d: baseline-arm-baylibre 2026-03-14 21:42:53,585 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b3334a6267e2e450f0326d 2026-03-14 21:42:53,586 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 21:42:53,599 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b3334a6267e2e450f0326d HTTP/1.1" 200 None 2026-03-14 21:42:53,600 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 21:42:53,614 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69afd3a3c9209b146d8e1d68 HTTP/1.1" 200 None 2026-03-14 21:42:53,615 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 21:42:53,642 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b3334a6267e2e450f0326d HTTP/1.1" 200 None 2026-03-14 21:42:53,644 - lava_callback - ERROR - Error processing callback for node 69b3334a6267e2e450f0326d: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:43042 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49256 - "GET / HTTP/1.0" 200 OK 2026-03-14 21:43:13,611 - lava_callback - INFO - Received callback for node 69b3336e6267e2e450f03275 INFO: 172.21.0.1:42624 - "POST /node/69b3336e6267e2e450f03275 HTTP/1.0" 202 Accepted 2026-03-14 21:43:13,617 - lava_callback - INFO - Starting async job submit for node 69b3336e6267e2e450f03275 2026-03-14 21:43:13,618 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 21:43:13,633 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b3336e6267e2e450f03275 HTTP/1.1" 200 None 2026-03-14 21:43:13,634 - lava_callback - DEBUG - Processing node 69b3336e6267e2e450f03275: baseline-arm-baylibre 2026-03-14 21:43:13,634 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b3336e6267e2e450f03275 2026-03-14 21:43:13,635 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 21:43:13,648 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b3336e6267e2e450f03275 HTTP/1.1" 200 None 2026-03-14 21:43:13,650 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 21:43:13,664 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69afd3a3c9209b146d8e1d68 HTTP/1.1" 200 None 2026-03-14 21:43:13,665 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 21:43:13,686 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b3336e6267e2e450f03275 HTTP/1.1" 200 None 2026-03-14 21:43:13,687 - lava_callback - ERROR - Error processing callback for node 69b3336e6267e2e450f03275: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:42630 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:42634 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42898 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37054 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45076 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45086 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33344 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51466 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59574 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:59580 - "GET / HTTP/1.0" 200 OK 2026-03-14 21:44:20,543 - lava_callback - INFO - Received callback for node 69b333a56267e2e450f0328a INFO: 172.21.0.1:55292 - "POST /node/69b333a56267e2e450f0328a HTTP/1.0" 202 Accepted 2026-03-14 21:44:20,548 - lava_callback - INFO - Starting async job submit for node 69b333a56267e2e450f0328a 2026-03-14 21:44:20,549 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 21:44:20,566 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b333a56267e2e450f0328a HTTP/1.1" 200 None 2026-03-14 21:44:20,567 - lava_callback - DEBUG - Processing node 69b333a56267e2e450f0328a: baseline-arm64-clabbe 2026-03-14 21:44:20,567 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b333a56267e2e450f0328a 2026-03-14 21:44:20,568 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 21:44:20,602 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b333a56267e2e450f0328a HTTP/1.1" 200 None 2026-03-14 21:44:20,603 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 21:44:20,616 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69afd3b0c9209b146d8e1d77 HTTP/1.1" 200 None 2026-03-14 21:44:20,618 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 21:44:20,638 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b333a56267e2e450f0328a HTTP/1.1" 200 None 2026-03-14 21:44:20,643 - lava_callback - ERROR - Error processing callback for node 69b333a56267e2e450f0328a: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:55302 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34466 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48562 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48576 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45970 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42838 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33102 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:33110 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53696 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39156 - "GET / HTTP/1.0" 200 OK 2026-03-14 21:45:40,480 - lava_callback - INFO - Received callback for node 69b333fe6267e2e450f0329c INFO: 172.21.0.1:50228 - "POST /node/69b333fe6267e2e450f0329c HTTP/1.0" 202 Accepted 2026-03-14 21:45:40,485 - lava_callback - INFO - Starting async job submit for node 69b333fe6267e2e450f0329c 2026-03-14 21:45:40,486 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 21:45:40,501 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b333fe6267e2e450f0329c HTTP/1.1" 200 None 2026-03-14 21:45:40,501 - lava_callback - DEBUG - Processing node 69b333fe6267e2e450f0329c: baseline-arm64-clabbe 2026-03-14 21:45:40,502 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b333fe6267e2e450f0329c 2026-03-14 21:45:40,502 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 21:45:40,515 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b333fe6267e2e450f0329c HTTP/1.1" 200 None 2026-03-14 21:45:40,517 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 21:45:40,532 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69afd3b0c9209b146d8e1d77 HTTP/1.1" 200 None 2026-03-14 21:45:40,533 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 21:45:40,553 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b333fe6267e2e450f0329c HTTP/1.1" 200 None 2026-03-14 21:45:40,561 - lava_callback - ERROR - Error processing callback for node 69b333fe6267e2e450f0329c: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:50242 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50256 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45108 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34198 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41906 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:41910 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37408 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38756 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48792 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48798 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49844 - "GET / HTTP/1.0" 200 OK 2026-03-14 21:47:00,708 - lava_callback - INFO - Received callback for node 69b3343f6267e2e450f032a4 INFO: 172.21.0.1:53388 - "POST /node/69b3343f6267e2e450f032a4 HTTP/1.0" 202 Accepted 2026-03-14 21:47:00,714 - lava_callback - INFO - Starting async job submit for node 69b3343f6267e2e450f032a4 2026-03-14 21:47:00,715 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 21:47:00,730 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b3343f6267e2e450f032a4 HTTP/1.1" 200 None 2026-03-14 21:47:00,731 - lava_callback - DEBUG - Processing node 69b3343f6267e2e450f032a4: baseline-arm-clabbe 2026-03-14 21:47:00,731 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b3343f6267e2e450f032a4 2026-03-14 21:47:00,732 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 21:47:00,747 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b3343f6267e2e450f032a4 HTTP/1.1" 200 None 2026-03-14 21:47:00,748 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 21:47:00,783 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69afd3a3c9209b146d8e1d68 HTTP/1.1" 200 None 2026-03-14 21:47:00,784 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 21:47:00,805 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b3343f6267e2e450f032a4 HTTP/1.1" 200 None 2026-03-14 21:47:00,813 - lava_callback - ERROR - Error processing callback for node 69b3343f6267e2e450f032a4: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:53404 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53274 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:53290 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60210 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41670 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43832 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43846 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48790 - "GET / HTTP/1.0" 200 OK 2026-03-14 21:48:00,601 - lava_callback - INFO - Received callback for node 69b3347b6267e2e450f032b4 INFO: 172.21.0.1:50772 - "POST /node/69b3347b6267e2e450f032b4 HTTP/1.0" 202 Accepted 2026-03-14 21:48:00,606 - lava_callback - INFO - Starting async job submit for node 69b3347b6267e2e450f032b4 2026-03-14 21:48:00,607 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 21:48:00,621 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b3347b6267e2e450f032b4 HTTP/1.1" 200 None 2026-03-14 21:48:00,622 - lava_callback - DEBUG - Processing node 69b3347b6267e2e450f032b4: baseline-arm64-clabbe 2026-03-14 21:48:00,622 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b3347b6267e2e450f032b4 2026-03-14 21:48:00,623 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 21:48:00,637 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b3347b6267e2e450f032b4 HTTP/1.1" 200 None 2026-03-14 21:48:00,639 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 21:48:00,651 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69afd3b0c9209b146d8e1d77 HTTP/1.1" 200 None 2026-03-14 21:48:00,653 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 21:48:00,674 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b3347b6267e2e450f032b4 HTTP/1.1" 200 None 2026-03-14 21:48:00,675 - lava_callback - ERROR - Error processing callback for node 69b3347b6267e2e450f032b4: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:50778 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39014 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:39022 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59124 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52790 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55066 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55078 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38960 - "GET / HTTP/1.0" 200 OK 2026-03-14 21:49:00,619 - lava_callback - INFO - Received callback for node 69b334be6267e2e450f032bc INFO: 172.21.0.1:38294 - "POST /node/69b334be6267e2e450f032bc HTTP/1.0" 202 Accepted 2026-03-14 21:49:00,625 - lava_callback - INFO - Starting async job submit for node 69b334be6267e2e450f032bc 2026-03-14 21:49:00,626 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 21:49:00,641 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b334be6267e2e450f032bc HTTP/1.1" 200 None 2026-03-14 21:49:00,641 - lava_callback - DEBUG - Processing node 69b334be6267e2e450f032bc: baseline-arm-clabbe 2026-03-14 21:49:00,642 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b334be6267e2e450f032bc 2026-03-14 21:49:00,642 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 21:49:00,656 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b334be6267e2e450f032bc HTTP/1.1" 200 None 2026-03-14 21:49:00,657 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 21:49:00,670 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69afd3a3c9209b146d8e1d68 HTTP/1.1" 200 None 2026-03-14 21:49:00,672 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 21:49:00,693 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b334be6267e2e450f032bc HTTP/1.1" 200 None 2026-03-14 21:49:00,704 - lava_callback - ERROR - Error processing callback for node 69b334be6267e2e450f032bc: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:38308 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34736 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:34742 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50722 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:32870 - "GET / HTTP/1.0" 200 OK 2026-03-14 21:49:40,622 - lava_callback - INFO - Received callback for node 69b334e76267e2e450f032c6 INFO: 172.21.0.1:35138 - "POST /node/69b334e76267e2e450f032c6 HTTP/1.0" 202 Accepted 2026-03-14 21:49:40,627 - lava_callback - INFO - Starting async job submit for node 69b334e76267e2e450f032c6 2026-03-14 21:49:40,628 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 21:49:40,648 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b334e76267e2e450f032c6 HTTP/1.1" 200 None 2026-03-14 21:49:40,649 - lava_callback - DEBUG - Processing node 69b334e76267e2e450f032c6: baseline-arm-clabbe 2026-03-14 21:49:40,649 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b334e76267e2e450f032c6 2026-03-14 21:49:40,650 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 21:49:40,664 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b334e76267e2e450f032c6 HTTP/1.1" 200 None 2026-03-14 21:49:40,666 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 21:49:40,679 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69afd3a3c9209b146d8e1d68 HTTP/1.1" 200 None 2026-03-14 21:49:40,681 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 21:49:40,702 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b334e76267e2e450f032c6 HTTP/1.1" 200 None 2026-03-14 21:49:40,709 - lava_callback - ERROR - Error processing callback for node 69b334e76267e2e450f032c6: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:35146 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35150 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34636 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55866 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52494 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:52498 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47570 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57220 - "GET / HTTP/1.0" 200 OK 2026-03-14 21:50:40,682 - lava_callback - INFO - Received callback for node 69b3351d6267e2e450f032d4 INFO: 172.21.0.1:34174 - "POST /node/69b3351d6267e2e450f032d4 HTTP/1.0" 202 Accepted 2026-03-14 21:50:40,687 - lava_callback - INFO - Starting async job submit for node 69b3351d6267e2e450f032d4 2026-03-14 21:50:40,688 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 21:50:40,725 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b3351d6267e2e450f032d4 HTTP/1.1" 200 None 2026-03-14 21:50:40,726 - lava_callback - DEBUG - Processing node 69b3351d6267e2e450f032d4: baseline-arm64-clabbe 2026-03-14 21:50:40,726 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b3351d6267e2e450f032d4 2026-03-14 21:50:40,727 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 21:50:40,741 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b3351d6267e2e450f032d4 HTTP/1.1" 200 None 2026-03-14 21:50:40,742 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 21:50:40,758 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69afd3b0c9209b146d8e1d77 HTTP/1.1" 200 None 2026-03-14 21:50:40,759 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 21:50:40,786 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b3351d6267e2e450f032d4 HTTP/1.1" 200 None 2026-03-14 21:50:40,788 - lava_callback - ERROR - Error processing callback for node 69b3351d6267e2e450f032d4: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:34176 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34178 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35892 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40562 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37994 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:38006 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36186 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34844 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36924 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36938 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46886 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48464 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59984 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:59990 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33640 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37414 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44312 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44324 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56394 - "GET / HTTP/1.0" 200 OK 2026-03-14 21:53:00,811 - lava_callback - INFO - Received callback for node 69b335aa6267e2e450f032fa INFO: 172.21.0.1:58576 - "POST /node/69b335aa6267e2e450f032fa HTTP/1.0" 202 Accepted 2026-03-14 21:53:00,817 - lava_callback - INFO - Starting async job submit for node 69b335aa6267e2e450f032fa 2026-03-14 21:53:00,818 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 21:53:00,834 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b335aa6267e2e450f032fa HTTP/1.1" 200 None 2026-03-14 21:53:00,835 - lava_callback - DEBUG - Processing node 69b335aa6267e2e450f032fa: baseline-arm-clabbe 2026-03-14 21:53:00,835 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b335aa6267e2e450f032fa 2026-03-14 21:53:00,836 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 21:53:00,849 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b335aa6267e2e450f032fa HTTP/1.1" 200 None 2026-03-14 21:53:00,851 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 21:53:00,864 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69afd3a3c9209b146d8e1d68 HTTP/1.1" 200 None 2026-03-14 21:53:00,865 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 21:53:00,886 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b335aa6267e2e450f032fa HTTP/1.1" 200 None 2026-03-14 21:53:00,887 - lava_callback - ERROR - Error processing callback for node 69b335aa6267e2e450f032fa: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:58592 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35792 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:35800 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46120 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46308 - "GET / HTTP/1.0" 200 OK 2026-03-14 21:53:40,806 - lava_callback - INFO - Received callback for node 69b335d16267e2e450f03305 INFO: 172.21.0.1:53746 - "POST /node/69b335d16267e2e450f03305 HTTP/1.0" 202 Accepted 2026-03-14 21:53:40,811 - lava_callback - INFO - Starting async job submit for node 69b335d16267e2e450f03305 2026-03-14 21:53:40,812 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 21:53:40,827 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b335d16267e2e450f03305 HTTP/1.1" 200 None 2026-03-14 21:53:40,828 - lava_callback - DEBUG - Processing node 69b335d16267e2e450f03305: baseline-arm-clabbe 2026-03-14 21:53:40,828 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b335d16267e2e450f03305 2026-03-14 21:53:40,829 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 21:53:40,851 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b335d16267e2e450f03305 HTTP/1.1" 200 None 2026-03-14 21:53:40,852 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 21:53:40,866 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69afd3a3c9209b146d8e1d68 HTTP/1.1" 200 None 2026-03-14 21:53:40,867 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 21:53:40,888 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b335d16267e2e450f03305 HTTP/1.1" 200 None 2026-03-14 21:53:40,896 - lava_callback - ERROR - Error processing callback for node 69b335d16267e2e450f03305: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:53750 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53766 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37934 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42996 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50360 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:50364 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47480 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47180 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56108 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56114 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43688 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43218 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56040 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:56054 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50116 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56852 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50640 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50646 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50648 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47120 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58076 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:58090 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55118 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59208 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53274 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53278 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57126 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54728 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54552 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:54560 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33412 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59578 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:32980 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:32984 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58032 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46268 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60068 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:60072 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43144 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46008 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44196 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44200 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60316 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56702 - "GET / HTTP/1.0" 200 OK 2026-03-14 21:59:14,576 - lava_callback - INFO - Received callback for node 69b337266267e2e450f03354 INFO: 172.21.0.1:57774 - "POST /node/69b337266267e2e450f03354 HTTP/1.0" 202 Accepted 2026-03-14 21:59:14,581 - lava_callback - INFO - Starting async job submit for node 69b337266267e2e450f03354 2026-03-14 21:59:14,582 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 21:59:14,596 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b337266267e2e450f03354 HTTP/1.1" 200 None 2026-03-14 21:59:14,597 - lava_callback - DEBUG - Processing node 69b337266267e2e450f03354: baseline-arm-baylibre 2026-03-14 21:59:14,597 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b337266267e2e450f03354 2026-03-14 21:59:14,598 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 21:59:14,640 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b337266267e2e450f03354 HTTP/1.1" 200 None 2026-03-14 21:59:14,641 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 21:59:14,656 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69afd3a3c9209b146d8e1d68 HTTP/1.1" 200 None 2026-03-14 21:59:14,657 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 21:59:14,701 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b337266267e2e450f03354 HTTP/1.1" 200 None 2026-03-14 21:59:14,707 - lava_callback - ERROR - Error processing callback for node 69b337266267e2e450f03354: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:57786 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:57792 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34440 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46962 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60002 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60018 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42914 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56884 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52584 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:52594 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51994 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48998 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48808 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48814 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52386 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51254 - "GET / HTTP/1.0" 200 OK 2026-03-14 22:01:14,560 - lava_callback - INFO - Received callback for node 69b337a26267e2e450f03376 INFO: 172.21.0.1:60312 - "POST /node/69b337a26267e2e450f03376 HTTP/1.0" 202 Accepted 2026-03-14 22:01:14,566 - lava_callback - INFO - Starting async job submit for node 69b337a26267e2e450f03376 2026-03-14 22:01:14,567 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 22:01:14,582 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b337a26267e2e450f03376 HTTP/1.1" 200 None 2026-03-14 22:01:14,583 - lava_callback - DEBUG - Processing node 69b337a26267e2e450f03376: baseline-arm64-baylibre 2026-03-14 22:01:14,583 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b337a26267e2e450f03376 2026-03-14 22:01:14,583 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 22:01:14,610 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b337a26267e2e450f03376 HTTP/1.1" 200 None 2026-03-14 22:01:14,612 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 22:01:14,626 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b276764bce73bcf0233d23 HTTP/1.1" 200 None 2026-03-14 22:01:14,628 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 22:01:14,654 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b337a26267e2e450f03376 HTTP/1.1" 200 None 2026-03-14 22:01:14,656 - lava_callback - ERROR - Error processing callback for node 69b337a26267e2e450f03376: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:60316 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:60332 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38960 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58880 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51122 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51124 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57646 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44992 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41318 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:41328 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33196 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60288 - "GET / HTTP/1.0" 200 OK 2026-03-14 22:02:41,161 - lava_callback - INFO - Received callback for node 69b337f46267e2e450f03381 INFO: 172.21.0.1:45002 - "POST /node/69b337f46267e2e450f03381 HTTP/1.0" 202 Accepted 2026-03-14 22:02:41,167 - lava_callback - INFO - Starting async job submit for node 69b337f46267e2e450f03381 2026-03-14 22:02:41,167 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 22:02:41,187 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b337f46267e2e450f03381 HTTP/1.1" 200 None 2026-03-14 22:02:41,189 - lava_callback - DEBUG - Processing node 69b337f46267e2e450f03381: baseline-arm64-clabbe 2026-03-14 22:02:41,189 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b337f46267e2e450f03381 2026-03-14 22:02:41,190 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 22:02:41,206 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b337f46267e2e450f03381 HTTP/1.1" 200 None 2026-03-14 22:02:41,207 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 22:02:41,255 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b276764bce73bcf0233d23 HTTP/1.1" 200 None 2026-03-14 22:02:41,256 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 22:02:41,297 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b337f46267e2e450f03381 HTTP/1.1" 200 None 2026-03-14 22:02:41,298 - lava_callback - ERROR - Error processing callback for node 69b337f46267e2e450f03381: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:45014 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45018 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42360 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37516 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59442 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:59454 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57040 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46824 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41964 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41970 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53714 - "GET / HTTP/1.0" 200 OK 2026-03-14 22:04:01,241 - lava_callback - INFO - Received callback for node 69b338446267e2e450f03397 INFO: 172.21.0.1:41230 - "POST /node/69b338446267e2e450f03397 HTTP/1.0" 202 Accepted 2026-03-14 22:04:01,246 - lava_callback - INFO - Starting async job submit for node 69b338446267e2e450f03397 2026-03-14 22:04:01,247 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 22:04:01,265 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b338446267e2e450f03397 HTTP/1.1" 200 None 2026-03-14 22:04:01,266 - lava_callback - DEBUG - Processing node 69b338446267e2e450f03397: baseline-arm64-clabbe 2026-03-14 22:04:01,266 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b338446267e2e450f03397 2026-03-14 22:04:01,267 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 22:04:01,281 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b338446267e2e450f03397 HTTP/1.1" 200 None 2026-03-14 22:04:01,282 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 22:04:01,297 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b276764bce73bcf0233d23 HTTP/1.1" 200 None 2026-03-14 22:04:01,299 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 22:04:01,323 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b338446267e2e450f03397 HTTP/1.1" 200 None 2026-03-14 22:04:01,326 - lava_callback - ERROR - Error processing callback for node 69b338446267e2e450f03397: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:41232 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44890 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:44904 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45164 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33942 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33392 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33394 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44770 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41668 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50880 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:50888 - "GET / HTTP/1.0" 200 OK 2026-03-14 22:05:21,271 - lava_callback - INFO - Received callback for node 69b338946267e2e450f033ad INFO: 172.21.0.1:49248 - "POST /node/69b338946267e2e450f033ad HTTP/1.0" 202 Accepted 2026-03-14 22:05:21,277 - lava_callback - INFO - Starting async job submit for node 69b338946267e2e450f033ad 2026-03-14 22:05:21,277 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 22:05:21,296 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b338946267e2e450f033ad HTTP/1.1" 200 None 2026-03-14 22:05:21,297 - lava_callback - DEBUG - Processing node 69b338946267e2e450f033ad: baseline-arm64-clabbe 2026-03-14 22:05:21,297 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b338946267e2e450f033ad 2026-03-14 22:05:21,298 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 22:05:21,318 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b338946267e2e450f033ad HTTP/1.1" 200 None 2026-03-14 22:05:21,320 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 22:05:21,332 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b276764bce73bcf0233d23 HTTP/1.1" 200 None 2026-03-14 22:05:21,334 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 22:05:21,354 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b338946267e2e450f033ad HTTP/1.1" 200 None 2026-03-14 22:05:21,361 - lava_callback - ERROR - Error processing callback for node 69b338946267e2e450f033ad: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:49260 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56670 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52760 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52768 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59450 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45324 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45648 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:45656 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38736 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48110 - "GET / HTTP/1.0" 200 OK 2026-03-14 22:06:41,298 - lava_callback - INFO - Received callback for node 69b338e26267e2e450f033bb INFO: 172.21.0.1:43176 - "POST /node/69b338e26267e2e450f033bb HTTP/1.0" 202 Accepted 2026-03-14 22:06:41,303 - lava_callback - INFO - Starting async job submit for node 69b338e26267e2e450f033bb 2026-03-14 22:06:41,304 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 22:06:41,319 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b338e26267e2e450f033bb HTTP/1.1" 200 None 2026-03-14 22:06:41,320 - lava_callback - DEBUG - Processing node 69b338e26267e2e450f033bb: baseline-arm64-clabbe 2026-03-14 22:06:41,320 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b338e26267e2e450f033bb 2026-03-14 22:06:41,321 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 22:06:41,333 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b338e26267e2e450f033bb HTTP/1.1" 200 None 2026-03-14 22:06:41,335 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 22:06:41,348 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b276764bce73bcf0233d23 HTTP/1.1" 200 None 2026-03-14 22:06:41,349 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 22:06:41,370 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b338e26267e2e450f033bb HTTP/1.1" 200 None 2026-03-14 22:06:41,377 - lava_callback - ERROR - Error processing callback for node 69b338e26267e2e450f033bb: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:43182 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43188 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45510 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36318 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36106 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:36118 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40258 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57358 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39982 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39990 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52526 - "GET / HTTP/1.0" 200 OK 2026-03-14 22:08:01,296 - lava_callback - INFO - Received callback for node 69b339326267e2e450f033d2 INFO: 172.21.0.1:39944 - "POST /node/69b339326267e2e450f033d2 HTTP/1.0" 202 Accepted 2026-03-14 22:08:01,302 - lava_callback - INFO - Starting async job submit for node 69b339326267e2e450f033d2 2026-03-14 22:08:01,303 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 22:08:01,320 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b339326267e2e450f033d2 HTTP/1.1" 200 None 2026-03-14 22:08:01,321 - lava_callback - DEBUG - Processing node 69b339326267e2e450f033d2: baseline-arm64-clabbe 2026-03-14 22:08:01,321 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b339326267e2e450f033d2 2026-03-14 22:08:01,322 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 22:08:01,335 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b339326267e2e450f033d2 HTTP/1.1" 200 None 2026-03-14 22:08:01,337 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 22:08:01,350 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b276764bce73bcf0233d23 HTTP/1.1" 200 None 2026-03-14 22:08:01,352 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 22:08:01,374 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b339326267e2e450f033d2 HTTP/1.1" 200 None 2026-03-14 22:08:01,375 - lava_callback - ERROR - Error processing callback for node 69b339326267e2e450f033d2: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:39950 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50246 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:50248 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50910 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54974 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39894 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39896 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51384 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46702 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55604 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:55620 - "GET / HTTP/1.0" 200 OK 2026-03-14 22:09:21,387 - lava_callback - INFO - Received callback for node 69b339816267e2e450f033ea INFO: 172.21.0.1:53700 - "POST /node/69b339816267e2e450f033ea HTTP/1.0" 202 Accepted 2026-03-14 22:09:21,392 - lava_callback - INFO - Starting async job submit for node 69b339816267e2e450f033ea 2026-03-14 22:09:21,393 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 22:09:21,407 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b339816267e2e450f033ea HTTP/1.1" 200 None 2026-03-14 22:09:21,408 - lava_callback - DEBUG - Processing node 69b339816267e2e450f033ea: baseline-arm64-clabbe 2026-03-14 22:09:21,409 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b339816267e2e450f033ea 2026-03-14 22:09:21,409 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 22:09:21,425 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b339816267e2e450f033ea HTTP/1.1" 200 None 2026-03-14 22:09:21,426 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 22:09:21,440 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b276764bce73bcf0233d23 HTTP/1.1" 200 None 2026-03-14 22:09:21,441 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 22:09:21,462 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b339816267e2e450f033ea HTTP/1.1" 200 None 2026-03-14 22:09:21,463 - lava_callback - ERROR - Error processing callback for node 69b339816267e2e450f033ea: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:53704 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50662 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36778 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36784 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53546 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59526 - "GET / HTTP/1.0" 200 OK 2026-03-14 22:10:15,109 - lava_callback - INFO - Received callback for node 69b339be6267e2e450f033f5 INFO: 172.21.0.1:35710 - "POST /node/69b339be6267e2e450f033f5 HTTP/1.0" 202 Accepted 2026-03-14 22:10:15,114 - lava_callback - INFO - Starting async job submit for node 69b339be6267e2e450f033f5 2026-03-14 22:10:15,115 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 22:10:15,152 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b339be6267e2e450f033f5 HTTP/1.1" 200 None 2026-03-14 22:10:15,153 - lava_callback - DEBUG - Processing node 69b339be6267e2e450f033f5: baseline-arm-baylibre 2026-03-14 22:10:15,153 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b339be6267e2e450f033f5 2026-03-14 22:10:15,154 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 INFO: 172.21.0.1:35714 - "GET /api/metrics HTTP/1.0" 200 OK 2026-03-14 22:10:15,169 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b339be6267e2e450f033f5 HTTP/1.1" 200 None 2026-03-14 22:10:15,170 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 22:10:15,183 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69afd3a3c9209b146d8e1d68 HTTP/1.1" 200 None 2026-03-14 22:10:15,185 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 22:10:15,211 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b339be6267e2e450f033f5 HTTP/1.1" 200 None 2026-03-14 22:10:15,212 - lava_callback - ERROR - Error processing callback for node 69b339be6267e2e450f033f5: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:35730 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38840 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36194 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37366 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37376 - "GET / HTTP/1.0" 200 OK 2026-03-14 22:10:55,063 - lava_callback - INFO - Received callback for node 69b339e26267e2e450f033fd INFO: 172.21.0.1:57510 - "POST /node/69b339e26267e2e450f033fd HTTP/1.0" 202 Accepted 2026-03-14 22:10:55,069 - lava_callback - INFO - Starting async job submit for node 69b339e26267e2e450f033fd 2026-03-14 22:10:55,069 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 22:10:55,084 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b339e26267e2e450f033fd HTTP/1.1" 200 None 2026-03-14 22:10:55,085 - lava_callback - DEBUG - Processing node 69b339e26267e2e450f033fd: baseline-arm-baylibre 2026-03-14 22:10:55,086 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b339e26267e2e450f033fd 2026-03-14 22:10:55,086 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 22:10:55,115 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b339e26267e2e450f033fd HTTP/1.1" 200 None 2026-03-14 22:10:55,117 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 22:10:55,146 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69afd3a3c9209b146d8e1d68 HTTP/1.1" 200 None 2026-03-14 22:10:55,148 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 22:10:55,171 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b339e26267e2e450f033fd HTTP/1.1" 200 None 2026-03-14 22:10:55,173 - lava_callback - ERROR - Error processing callback for node 69b339e26267e2e450f033fd: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:57522 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43334 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40602 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:40618 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40578 - "GET / HTTP/1.0" 200 OK 2026-03-14 22:11:35,119 - lava_callback - INFO - Received callback for node 69b33a076267e2e450f03407 INFO: 172.21.0.1:37380 - "POST /node/69b33a076267e2e450f03407 HTTP/1.0" 202 Accepted 2026-03-14 22:11:35,124 - lava_callback - INFO - Starting async job submit for node 69b33a076267e2e450f03407 2026-03-14 22:11:35,125 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 22:11:35,144 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b33a076267e2e450f03407 HTTP/1.1" 200 None 2026-03-14 22:11:35,145 - lava_callback - DEBUG - Processing node 69b33a076267e2e450f03407: baseline-arm-baylibre 2026-03-14 22:11:35,146 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b33a076267e2e450f03407 2026-03-14 22:11:35,146 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 22:11:35,159 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b33a076267e2e450f03407 HTTP/1.1" 200 None 2026-03-14 22:11:35,161 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 22:11:35,174 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69afd3a3c9209b146d8e1d68 HTTP/1.1" 200 None 2026-03-14 22:11:35,175 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 22:11:35,196 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b33a076267e2e450f03407 HTTP/1.1" 200 None 2026-03-14 22:11:35,203 - lava_callback - ERROR - Error processing callback for node 69b33a076267e2e450f03407: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:37396 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49376 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49378 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36142 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36196 - "GET / HTTP/1.0" 200 OK 2026-03-14 22:12:15,128 - lava_callback - INFO - Received callback for node 69b33a2c6267e2e450f03413 INFO: 172.21.0.1:50284 - "POST /node/69b33a2c6267e2e450f03413 HTTP/1.0" 202 Accepted 2026-03-14 22:12:15,133 - lava_callback - INFO - Starting async job submit for node 69b33a2c6267e2e450f03413 2026-03-14 22:12:15,134 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 22:12:15,148 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b33a2c6267e2e450f03413 HTTP/1.1" 200 None 2026-03-14 22:12:15,149 - lava_callback - DEBUG - Processing node 69b33a2c6267e2e450f03413: baseline-arm-baylibre 2026-03-14 22:12:15,150 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b33a2c6267e2e450f03413 2026-03-14 22:12:15,150 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 INFO: 172.21.0.1:50290 - "GET /api/metrics HTTP/1.0" 200 OK 2026-03-14 22:12:15,164 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b33a2c6267e2e450f03413 HTTP/1.1" 200 None 2026-03-14 22:12:15,165 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 22:12:15,178 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69afd3a3c9209b146d8e1d68 HTTP/1.1" 200 None 2026-03-14 22:12:15,180 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 22:12:15,203 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b33a2c6267e2e450f03413 HTTP/1.1" 200 None 2026-03-14 22:12:15,204 - lava_callback - ERROR - Error processing callback for node 69b33a2c6267e2e450f03413: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:50302 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40100 - "GET / HTTP/1.0" 200 OK 2026-03-14 22:12:35,174 - lava_callback - INFO - Received callback for node 69b33a516267e2e450f03421 INFO: 172.21.0.1:50634 - "POST /node/69b33a516267e2e450f03421 HTTP/1.0" 202 Accepted 2026-03-14 22:12:35,180 - lava_callback - INFO - Starting async job submit for node 69b33a516267e2e450f03421 2026-03-14 22:12:35,181 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 22:12:35,200 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b33a516267e2e450f03421 HTTP/1.1" 200 None 2026-03-14 22:12:35,201 - lava_callback - DEBUG - Processing node 69b33a516267e2e450f03421: baseline-arm-baylibre 2026-03-14 22:12:35,201 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b33a516267e2e450f03421 2026-03-14 22:12:35,201 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 22:12:35,219 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b33a516267e2e450f03421 HTTP/1.1" 200 None 2026-03-14 22:12:35,220 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 22:12:35,233 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69afd3a3c9209b146d8e1d68 HTTP/1.1" 200 None 2026-03-14 22:12:35,235 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 22:12:35,255 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b33a516267e2e450f03421 HTTP/1.1" 200 None 2026-03-14 22:12:35,264 - lava_callback - ERROR - Error processing callback for node 69b33a516267e2e450f03421: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:50644 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38334 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38350 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54110 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44824 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47700 - "GET /api/metrics HTTP/1.0" 200 OK 2026-03-14 22:13:15,689 - lava_callback - INFO - Received callback for node 69b33a746267e2e450f0342c INFO: 172.21.0.1:47706 - "POST /node/69b33a746267e2e450f0342c HTTP/1.0" 202 Accepted 2026-03-14 22:13:15,694 - lava_callback - INFO - Starting async job submit for node 69b33a746267e2e450f0342c 2026-03-14 22:13:15,695 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 22:13:15,721 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b33a746267e2e450f0342c HTTP/1.1" 200 None 2026-03-14 22:13:15,721 - lava_callback - DEBUG - Processing node 69b33a746267e2e450f0342c: baseline-arm-baylibre 2026-03-14 22:13:15,722 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b33a746267e2e450f0342c 2026-03-14 22:13:15,722 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 22:13:15,736 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b33a746267e2e450f0342c HTTP/1.1" 200 None 2026-03-14 22:13:15,737 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 22:13:15,750 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69afd3a3c9209b146d8e1d68 HTTP/1.1" 200 None 2026-03-14 22:13:15,752 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 22:13:15,772 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b33a746267e2e450f0342c HTTP/1.1" 200 None 2026-03-14 22:13:15,777 - lava_callback - ERROR - Error processing callback for node 69b33a746267e2e450f0342c: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:47710 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38974 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35018 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50380 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50384 - "GET / HTTP/1.0" 200 OK 2026-03-14 22:13:55,251 - lava_callback - INFO - Received callback for node 69b33a9b6267e2e450f03438 INFO: 172.21.0.1:44980 - "POST /node/69b33a9b6267e2e450f03438 HTTP/1.0" 202 Accepted 2026-03-14 22:13:55,257 - lava_callback - INFO - Starting async job submit for node 69b33a9b6267e2e450f03438 2026-03-14 22:13:55,258 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 22:13:55,272 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b33a9b6267e2e450f03438 HTTP/1.1" 200 None 2026-03-14 22:13:55,273 - lava_callback - DEBUG - Processing node 69b33a9b6267e2e450f03438: baseline-arm-baylibre 2026-03-14 22:13:55,273 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b33a9b6267e2e450f03438 2026-03-14 22:13:55,274 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 22:13:55,287 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b33a9b6267e2e450f03438 HTTP/1.1" 200 None 2026-03-14 22:13:55,288 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 22:13:55,301 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69afd3a3c9209b146d8e1d68 HTTP/1.1" 200 None 2026-03-14 22:13:55,303 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 22:13:55,332 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b33a9b6267e2e450f03438 HTTP/1.1" 200 None 2026-03-14 22:13:55,334 - lava_callback - ERROR - Error processing callback for node 69b33a9b6267e2e450f03438: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:44996 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36334 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37184 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:37188 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40770 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41208 - "GET / HTTP/1.0" 200 OK 2026-03-14 22:14:41,497 - lava_callback - INFO - Received callback for node 69b33ac46267e2e450f03443 INFO: 172.21.0.1:50778 - "POST /node/69b33ac46267e2e450f03443 HTTP/1.0" 202 Accepted 2026-03-14 22:14:41,503 - lava_callback - INFO - Starting async job submit for node 69b33ac46267e2e450f03443 2026-03-14 22:14:41,504 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 22:14:41,528 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b33ac46267e2e450f03443 HTTP/1.1" 200 None 2026-03-14 22:14:41,529 - lava_callback - DEBUG - Processing node 69b33ac46267e2e450f03443: baseline-arm-clabbe 2026-03-14 22:14:41,530 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b33ac46267e2e450f03443 2026-03-14 22:14:41,530 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 22:14:41,544 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b33ac46267e2e450f03443 HTTP/1.1" 200 None 2026-03-14 22:14:41,545 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 22:14:41,570 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69afd3a3c9209b146d8e1d68 HTTP/1.1" 200 None 2026-03-14 22:14:41,572 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 22:14:41,595 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b33ac46267e2e450f03443 HTTP/1.1" 200 None 2026-03-14 22:14:41,597 - lava_callback - ERROR - Error processing callback for node 69b33ac46267e2e450f03443: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:50794 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50802 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52322 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35912 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35990 - "GET /api/metrics HTTP/1.0" 200 OK 2026-03-14 22:15:15,371 - lava_callback - INFO - Received callback for node 69b33ae56267e2e450f0344e INFO: 172.21.0.1:35998 - "POST /node/69b33ae56267e2e450f0344e HTTP/1.0" 202 Accepted 2026-03-14 22:15:15,376 - lava_callback - INFO - Starting async job submit for node 69b33ae56267e2e450f0344e 2026-03-14 22:15:15,377 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 22:15:15,391 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b33ae56267e2e450f0344e HTTP/1.1" 200 None 2026-03-14 22:15:15,392 - lava_callback - DEBUG - Processing node 69b33ae56267e2e450f0344e: baseline-arm-baylibre 2026-03-14 22:15:15,392 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b33ae56267e2e450f0344e 2026-03-14 22:15:15,393 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 22:15:15,409 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b33ae56267e2e450f0344e HTTP/1.1" 200 None 2026-03-14 22:15:15,410 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 22:15:15,426 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69afd3a3c9209b146d8e1d68 HTTP/1.1" 200 None 2026-03-14 22:15:15,427 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 22:15:15,448 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b33ae56267e2e450f0344e HTTP/1.1" 200 None 2026-03-14 22:15:15,455 - lava_callback - ERROR - Error processing callback for node 69b33ae56267e2e450f0344e: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:36010 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48798 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35244 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46266 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46278 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54536 - "GET / HTTP/1.0" 200 OK 2026-03-14 22:16:01,527 - lava_callback - INFO - Received callback for node 69b33b0c6267e2e450f0345d INFO: 172.21.0.1:59032 - "POST /node/69b33b0c6267e2e450f0345d HTTP/1.0" 202 Accepted 2026-03-14 22:16:01,532 - lava_callback - INFO - Starting async job submit for node 69b33b0c6267e2e450f0345d 2026-03-14 22:16:01,533 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 22:16:01,548 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b33b0c6267e2e450f0345d HTTP/1.1" 200 None 2026-03-14 22:16:01,549 - lava_callback - DEBUG - Processing node 69b33b0c6267e2e450f0345d: baseline-arm-clabbe 2026-03-14 22:16:01,549 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b33b0c6267e2e450f0345d 2026-03-14 22:16:01,549 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 22:16:01,566 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b33b0c6267e2e450f0345d HTTP/1.1" 200 None 2026-03-14 22:16:01,567 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 22:16:01,585 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69afd3a3c9209b146d8e1d68 HTTP/1.1" 200 None 2026-03-14 22:16:01,587 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 22:16:01,607 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b33b0c6267e2e450f0345d HTTP/1.1" 200 None 2026-03-14 22:16:01,608 - lava_callback - ERROR - Error processing callback for node 69b33b0c6267e2e450f0345d: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:59046 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36056 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:36064 - "GET / HTTP/1.0" 200 OK 2026-03-14 22:16:21,640 - lava_callback - INFO - Received callback for node 69b33b306267e2e450f0346a INFO: 172.21.0.1:56734 - "POST /node/69b33b306267e2e450f0346a HTTP/1.0" 202 Accepted 2026-03-14 22:16:21,647 - lava_callback - INFO - Starting async job submit for node 69b33b306267e2e450f0346a 2026-03-14 22:16:21,649 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 22:16:21,672 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b33b306267e2e450f0346a HTTP/1.1" 200 None 2026-03-14 22:16:21,673 - lava_callback - DEBUG - Processing node 69b33b306267e2e450f0346a: baseline-arm-clabbe 2026-03-14 22:16:21,673 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b33b306267e2e450f0346a 2026-03-14 22:16:21,674 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 22:16:21,688 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b33b306267e2e450f0346a HTTP/1.1" 200 None 2026-03-14 22:16:21,689 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 22:16:21,702 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69afd3a3c9209b146d8e1d68 HTTP/1.1" 200 None 2026-03-14 22:16:21,704 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 22:16:21,732 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b33b306267e2e450f0346a HTTP/1.1" 200 None 2026-03-14 22:16:21,734 - lava_callback - ERROR - Error processing callback for node 69b33b306267e2e450f0346a: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:56738 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48972 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40648 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40664 - "GET / HTTP/1.0" 200 OK 2026-03-14 22:16:55,553 - lava_callback - INFO - Received callback for node 69b33b516267e2e450f03476 INFO: 172.21.0.1:44240 - "POST /node/69b33b516267e2e450f03476 HTTP/1.0" 202 Accepted 2026-03-14 22:16:55,559 - lava_callback - INFO - Starting async job submit for node 69b33b516267e2e450f03476 2026-03-14 22:16:55,560 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 22:16:55,574 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b33b516267e2e450f03476 HTTP/1.1" 200 None 2026-03-14 22:16:55,575 - lava_callback - DEBUG - Processing node 69b33b516267e2e450f03476: baseline-arm-baylibre 2026-03-14 22:16:55,575 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b33b516267e2e450f03476 2026-03-14 22:16:55,576 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 22:16:55,589 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b33b516267e2e450f03476 HTTP/1.1" 200 None 2026-03-14 22:16:55,590 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 22:16:55,603 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69afd3a3c9209b146d8e1d68 HTTP/1.1" 200 None 2026-03-14 22:16:55,605 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 22:16:55,629 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b33b516267e2e450f03476 HTTP/1.1" 200 None 2026-03-14 22:16:55,630 - lava_callback - ERROR - Error processing callback for node 69b33b516267e2e450f03476: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:44250 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41446 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52208 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:52218 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35402 - "GET / HTTP/1.0" 200 OK 2026-03-14 22:17:35,452 - lava_callback - INFO - Received callback for node 69b33b756267e2e450f03482 INFO: 172.21.0.1:48086 - "POST /node/69b33b756267e2e450f03482 HTTP/1.0" 202 Accepted 2026-03-14 22:17:35,457 - lava_callback - INFO - Starting async job submit for node 69b33b756267e2e450f03482 2026-03-14 22:17:35,458 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 22:17:35,472 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b33b756267e2e450f03482 HTTP/1.1" 200 None 2026-03-14 22:17:35,473 - lava_callback - DEBUG - Processing node 69b33b756267e2e450f03482: baseline-arm-baylibre 2026-03-14 22:17:35,473 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b33b756267e2e450f03482 2026-03-14 22:17:35,474 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 22:17:35,488 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b33b756267e2e450f03482 HTTP/1.1" 200 None 2026-03-14 22:17:35,490 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 22:17:35,504 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69afd3a3c9209b146d8e1d68 HTTP/1.1" 200 None 2026-03-14 22:17:35,505 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 22:17:35,526 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b33b756267e2e450f03482 HTTP/1.1" 200 None 2026-03-14 22:17:35,531 - lava_callback - ERROR - Error processing callback for node 69b33b756267e2e450f03482: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:48098 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:32910 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:32924 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55766 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35772 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38698 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:38712 - "GET / HTTP/1.0" 200 OK 2026-03-14 22:18:21,679 - lava_callback - INFO - Received callback for node 69b33b9b6267e2e450f0348f INFO: 172.21.0.1:57864 - "POST /node/69b33b9b6267e2e450f0348f HTTP/1.0" 202 Accepted 2026-03-14 22:18:21,684 - lava_callback - INFO - Starting async job submit for node 69b33b9b6267e2e450f0348f 2026-03-14 22:18:21,685 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 22:18:21,699 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b33b9b6267e2e450f0348f HTTP/1.1" 200 None 2026-03-14 22:18:21,700 - lava_callback - DEBUG - Processing node 69b33b9b6267e2e450f0348f: baseline-arm-clabbe 2026-03-14 22:18:21,700 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b33b9b6267e2e450f0348f 2026-03-14 22:18:21,701 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 22:18:21,714 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b33b9b6267e2e450f0348f HTTP/1.1" 200 None 2026-03-14 22:18:21,716 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 22:18:21,729 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69afd3a3c9209b146d8e1d68 HTTP/1.1" 200 None 2026-03-14 22:18:21,731 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 22:18:21,751 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b33b9b6267e2e450f0348f HTTP/1.1" 200 None 2026-03-14 22:18:21,762 - lava_callback - ERROR - Error processing callback for node 69b33b9b6267e2e450f0348f: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:57866 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60494 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39800 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39812 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48984 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48936 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51902 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:51910 - "GET / HTTP/1.0" 200 OK 2026-03-14 22:19:21,700 - lava_callback - INFO - Received callback for node 69b33be36267e2e450f034b6 INFO: 172.21.0.1:60978 - "POST /node/69b33be36267e2e450f034b6 HTTP/1.0" 202 Accepted 2026-03-14 22:19:21,705 - lava_callback - INFO - Starting async job submit for node 69b33be36267e2e450f034b6 2026-03-14 22:19:21,706 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 22:19:21,719 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b33be36267e2e450f034b6 HTTP/1.1" 200 None 2026-03-14 22:19:21,720 - lava_callback - DEBUG - Processing node 69b33be36267e2e450f034b6: baseline-arm-clabbe 2026-03-14 22:19:21,721 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b33be36267e2e450f034b6 2026-03-14 22:19:21,721 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 22:19:21,734 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b33be36267e2e450f034b6 HTTP/1.1" 200 None 2026-03-14 22:19:21,735 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 22:19:21,748 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69afd3a3c9209b146d8e1d68 HTTP/1.1" 200 None 2026-03-14 22:19:21,750 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 22:19:21,777 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b33be36267e2e450f034b6 HTTP/1.1" 200 None 2026-03-14 22:19:21,778 - lava_callback - ERROR - Error processing callback for node 69b33be36267e2e450f034b6: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:60982 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47240 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52914 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52924 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53156 - "GET / HTTP/1.0" 200 OK 2026-03-14 22:20:01,653 - lava_callback - INFO - Received callback for node 69b33c086267e2e450f034c4 INFO: 172.21.0.1:57248 - "POST /node/69b33c086267e2e450f034c4 HTTP/1.0" 202 Accepted 2026-03-14 22:20:01,658 - lava_callback - INFO - Starting async job submit for node 69b33c086267e2e450f034c4 2026-03-14 22:20:01,659 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 22:20:01,674 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b33c086267e2e450f034c4 HTTP/1.1" 200 None 2026-03-14 22:20:01,674 - lava_callback - DEBUG - Processing node 69b33c086267e2e450f034c4: baseline-arm-clabbe 2026-03-14 22:20:01,675 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b33c086267e2e450f034c4 2026-03-14 22:20:01,675 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 22:20:01,688 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b33c086267e2e450f034c4 HTTP/1.1" 200 None 2026-03-14 22:20:01,689 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 22:20:01,735 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69afd3a3c9209b146d8e1d68 HTTP/1.1" 200 None 2026-03-14 22:20:01,737 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 22:20:01,757 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b33c086267e2e450f034c4 HTTP/1.1" 200 None 2026-03-14 22:20:01,758 - lava_callback - ERROR - Error processing callback for node 69b33c086267e2e450f034c4: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:57250 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37956 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:37972 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48154 - "GET / HTTP/1.0" 200 OK 2026-03-14 22:20:35,672 - lava_callback - INFO - Received callback for node 69b33c286267e2e450f034d2 INFO: 172.21.0.1:40724 - "POST /node/69b33c286267e2e450f034d2 HTTP/1.0" 202 Accepted 2026-03-14 22:20:35,680 - lava_callback - INFO - Starting async job submit for node 69b33c286267e2e450f034d2 2026-03-14 22:20:35,681 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 22:20:35,697 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b33c286267e2e450f034d2 HTTP/1.1" 200 None 2026-03-14 22:20:35,697 - lava_callback - DEBUG - Processing node 69b33c286267e2e450f034d2: baseline-arm-baylibre 2026-03-14 22:20:35,698 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b33c286267e2e450f034d2 2026-03-14 22:20:35,698 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 22:20:35,722 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b33c286267e2e450f034d2 HTTP/1.1" 200 None 2026-03-14 22:20:35,723 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 22:20:35,737 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69afd826ae557f2600f0f036 HTTP/1.1" 200 None 2026-03-14 22:20:35,739 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 22:20:35,763 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b33c286267e2e450f034d2 HTTP/1.1" 200 None 2026-03-14 22:20:35,765 - lava_callback - ERROR - Error processing callback for node 69b33c286267e2e450f034d2: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:40726 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53998 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54004 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56036 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51880 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33120 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:33130 - "GET / HTTP/1.0" 200 OK 2026-03-14 22:21:21,806 - lava_callback - INFO - Received callback for node 69b33c516267e2e450f034e2 INFO: 172.21.0.1:40312 - "POST /node/69b33c516267e2e450f034e2 HTTP/1.0" 202 Accepted 2026-03-14 22:21:21,811 - lava_callback - INFO - Starting async job submit for node 69b33c516267e2e450f034e2 2026-03-14 22:21:21,812 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 22:21:21,827 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b33c516267e2e450f034e2 HTTP/1.1" 200 None 2026-03-14 22:21:21,828 - lava_callback - DEBUG - Processing node 69b33c516267e2e450f034e2: baseline-arm-clabbe 2026-03-14 22:21:21,828 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b33c516267e2e450f034e2 2026-03-14 22:21:21,829 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 22:21:21,894 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b33c516267e2e450f034e2 HTTP/1.1" 200 None 2026-03-14 22:21:21,896 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 22:21:21,910 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69afd3a3c9209b146d8e1d68 HTTP/1.1" 200 None 2026-03-14 22:21:21,911 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 22:21:21,936 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b33c516267e2e450f034e2 HTTP/1.1" 200 None 2026-03-14 22:21:21,942 - lava_callback - ERROR - Error processing callback for node 69b33c516267e2e450f034e2: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:40328 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39850 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40608 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40616 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46374 - "GET / HTTP/1.0" 200 OK 2026-03-14 22:22:01,789 - lava_callback - INFO - Received callback for node 69b33c756267e2e450f034f3 INFO: 172.21.0.1:32890 - "POST /node/69b33c756267e2e450f034f3 HTTP/1.0" 202 Accepted 2026-03-14 22:22:01,794 - lava_callback - INFO - Starting async job submit for node 69b33c756267e2e450f034f3 2026-03-14 22:22:01,795 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 22:22:01,812 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b33c756267e2e450f034f3 HTTP/1.1" 200 None 2026-03-14 22:22:01,813 - lava_callback - DEBUG - Processing node 69b33c756267e2e450f034f3: baseline-arm-clabbe 2026-03-14 22:22:01,813 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b33c756267e2e450f034f3 2026-03-14 22:22:01,813 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 22:22:01,826 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b33c756267e2e450f034f3 HTTP/1.1" 200 None 2026-03-14 22:22:01,828 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 22:22:01,841 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69afd3a3c9209b146d8e1d68 HTTP/1.1" 200 None 2026-03-14 22:22:01,842 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 22:22:01,864 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b33c756267e2e450f034f3 HTTP/1.1" 200 None 2026-03-14 22:22:01,866 - lava_callback - ERROR - Error processing callback for node 69b33c756267e2e450f034f3: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:32896 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54806 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:54812 - "GET / HTTP/1.0" 200 OK 2026-03-14 22:22:21,831 - lava_callback - INFO - Received callback for node 69b33c9a6267e2e450f03500 INFO: 172.21.0.1:44362 - "POST /node/69b33c9a6267e2e450f03500 HTTP/1.0" 202 Accepted 2026-03-14 22:22:21,837 - lava_callback - INFO - Starting async job submit for node 69b33c9a6267e2e450f03500 2026-03-14 22:22:21,837 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 22:22:21,874 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b33c9a6267e2e450f03500 HTTP/1.1" 200 None 2026-03-14 22:22:21,875 - lava_callback - DEBUG - Processing node 69b33c9a6267e2e450f03500: baseline-arm-clabbe 2026-03-14 22:22:21,876 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b33c9a6267e2e450f03500 2026-03-14 22:22:21,876 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 22:22:21,897 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b33c9a6267e2e450f03500 HTTP/1.1" 200 None 2026-03-14 22:22:21,899 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 22:22:21,912 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69afd3a3c9209b146d8e1d68 HTTP/1.1" 200 None 2026-03-14 22:22:21,914 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 22:22:21,943 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b33c9a6267e2e450f03500 HTTP/1.1" 200 None 2026-03-14 22:22:21,948 - lava_callback - ERROR - Error processing callback for node 69b33c9a6267e2e450f03500: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:44364 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59122 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36244 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36254 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40204 - "GET / HTTP/1.0" 200 OK 2026-03-14 22:23:01,803 - lava_callback - INFO - Received callback for node 69b33cc06267e2e450f03513 INFO: 172.21.0.1:38532 - "POST /node/69b33cc06267e2e450f03513 HTTP/1.0" 202 Accepted 2026-03-14 22:23:01,808 - lava_callback - INFO - Starting async job submit for node 69b33cc06267e2e450f03513 2026-03-14 22:23:01,809 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 22:23:01,845 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b33cc06267e2e450f03513 HTTP/1.1" 200 None 2026-03-14 22:23:01,846 - lava_callback - DEBUG - Processing node 69b33cc06267e2e450f03513: baseline-arm-clabbe 2026-03-14 22:23:01,846 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b33cc06267e2e450f03513 2026-03-14 22:23:01,847 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 22:23:01,859 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b33cc06267e2e450f03513 HTTP/1.1" 200 None 2026-03-14 22:23:01,861 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 22:23:01,891 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69afd3a3c9209b146d8e1d68 HTTP/1.1" 200 None 2026-03-14 22:23:01,893 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 22:23:01,927 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b33cc06267e2e450f03513 HTTP/1.1" 200 None 2026-03-14 22:23:01,928 - lava_callback - ERROR - Error processing callback for node 69b33cc06267e2e450f03513: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:38540 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45574 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:45580 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60298 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59370 - "GET / HTTP/1.0" 200 OK 2026-03-14 22:23:41,886 - lava_callback - INFO - Received callback for node 69b33ce66267e2e450f03523 INFO: 172.21.0.1:50000 - "POST /node/69b33ce66267e2e450f03523 HTTP/1.0" 202 Accepted 2026-03-14 22:23:41,892 - lava_callback - INFO - Starting async job submit for node 69b33ce66267e2e450f03523 2026-03-14 22:23:41,893 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 22:23:41,913 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b33ce66267e2e450f03523 HTTP/1.1" 200 None 2026-03-14 22:23:41,913 - lava_callback - DEBUG - Processing node 69b33ce66267e2e450f03523: baseline-arm-clabbe 2026-03-14 22:23:41,914 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b33ce66267e2e450f03523 2026-03-14 22:23:41,914 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 22:23:41,928 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b33ce66267e2e450f03523 HTTP/1.1" 200 None 2026-03-14 22:23:41,930 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 22:23:41,942 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69afd826ae557f2600f0f036 HTTP/1.1" 200 None 2026-03-14 22:23:41,944 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 22:23:41,965 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b33ce66267e2e450f03523 HTTP/1.1" 200 None 2026-03-14 22:23:41,966 - lava_callback - ERROR - Error processing callback for node 69b33ce66267e2e450f03523: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:50016 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50020 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34730 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44056 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46426 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:46428 - "GET / HTTP/1.0" 200 OK 2026-03-14 22:24:21,873 - lava_callback - INFO - Received callback for node 69b33d0a6267e2e450f03535 INFO: 172.21.0.1:50684 - "POST /node/69b33d0a6267e2e450f03535 HTTP/1.0" 202 Accepted 2026-03-14 22:24:21,879 - lava_callback - INFO - Starting async job submit for node 69b33d0a6267e2e450f03535 2026-03-14 22:24:21,879 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 22:24:21,902 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b33d0a6267e2e450f03535 HTTP/1.1" 200 None 2026-03-14 22:24:21,902 - lava_callback - DEBUG - Processing node 69b33d0a6267e2e450f03535: baseline-arm-clabbe 2026-03-14 22:24:21,903 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b33d0a6267e2e450f03535 2026-03-14 22:24:21,903 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 22:24:21,916 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b33d0a6267e2e450f03535 HTTP/1.1" 200 None 2026-03-14 22:24:21,918 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 22:24:21,931 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69afd826ae557f2600f0f036 HTTP/1.1" 200 None 2026-03-14 22:24:21,932 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 22:24:21,953 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b33d0a6267e2e450f03535 HTTP/1.1" 200 None 2026-03-14 22:24:21,958 - lava_callback - ERROR - Error processing callback for node 69b33d0a6267e2e450f03535: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:50698 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38630 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44170 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44172 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36212 - "GET / HTTP/1.0" 200 OK 2026-03-14 22:25:01,896 - lava_callback - INFO - Received callback for node 69b33d2f6267e2e450f03545 INFO: 172.21.0.1:52322 - "POST /node/69b33d2f6267e2e450f03545 HTTP/1.0" 202 Accepted 2026-03-14 22:25:01,901 - lava_callback - INFO - Starting async job submit for node 69b33d2f6267e2e450f03545 2026-03-14 22:25:01,902 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 22:25:01,918 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b33d2f6267e2e450f03545 HTTP/1.1" 200 None 2026-03-14 22:25:01,919 - lava_callback - DEBUG - Processing node 69b33d2f6267e2e450f03545: baseline-arm-clabbe 2026-03-14 22:25:01,919 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b33d2f6267e2e450f03545 2026-03-14 22:25:01,920 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 22:25:01,933 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b33d2f6267e2e450f03545 HTTP/1.1" 200 None 2026-03-14 22:25:01,934 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 22:25:01,979 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69afd826ae557f2600f0f036 HTTP/1.1" 200 None 2026-03-14 22:25:01,981 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 22:25:02,003 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b33d2f6267e2e450f03545 HTTP/1.1" 200 None 2026-03-14 22:25:02,005 - lava_callback - ERROR - Error processing callback for node 69b33d2f6267e2e450f03545: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:52324 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54912 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:54922 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56166 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55054 - "GET / HTTP/1.0" 200 OK 2026-03-14 22:25:41,943 - lava_callback - INFO - Received callback for node 69b33d536267e2e450f03555 INFO: 172.21.0.1:41356 - "POST /node/69b33d536267e2e450f03555 HTTP/1.0" 202 Accepted 2026-03-14 22:25:41,949 - lava_callback - INFO - Starting async job submit for node 69b33d536267e2e450f03555 2026-03-14 22:25:41,950 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 22:25:41,965 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b33d536267e2e450f03555 HTTP/1.1" 200 None 2026-03-14 22:25:41,966 - lava_callback - DEBUG - Processing node 69b33d536267e2e450f03555: baseline-arm-clabbe 2026-03-14 22:25:41,966 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b33d536267e2e450f03555 2026-03-14 22:25:41,967 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 22:25:41,980 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b33d536267e2e450f03555 HTTP/1.1" 200 None 2026-03-14 22:25:41,981 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 22:25:42,005 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69afd826ae557f2600f0f036 HTTP/1.1" 200 None 2026-03-14 22:25:42,007 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 22:25:42,028 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b33d536267e2e450f03555 HTTP/1.1" 200 None 2026-03-14 22:25:42,029 - lava_callback - ERROR - Error processing callback for node 69b33d536267e2e450f03555: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:41372 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41386 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46316 - "GET / HTTP/1.0" 200 OK 2026-03-14 22:26:01,987 - lava_callback - INFO - Received callback for node 69b33d776267e2e450f03568 INFO: 172.21.0.1:43984 - "POST /node/69b33d776267e2e450f03568 HTTP/1.0" 202 Accepted 2026-03-14 22:26:01,993 - lava_callback - INFO - Starting async job submit for node 69b33d776267e2e450f03568 2026-03-14 22:26:01,994 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 22:26:02,018 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b33d776267e2e450f03568 HTTP/1.1" 200 None 2026-03-14 22:26:02,019 - lava_callback - DEBUG - Processing node 69b33d776267e2e450f03568: baseline-arm-clabbe 2026-03-14 22:26:02,019 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b33d776267e2e450f03568 2026-03-14 22:26:02,020 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 22:26:02,034 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b33d776267e2e450f03568 HTTP/1.1" 200 None 2026-03-14 22:26:02,035 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 22:26:02,058 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69afd826ae557f2600f0f036 HTTP/1.1" 200 None 2026-03-14 22:26:02,059 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 22:26:02,080 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b33d776267e2e450f03568 HTTP/1.1" 200 None 2026-03-14 22:26:02,086 - lava_callback - ERROR - Error processing callback for node 69b33d776267e2e450f03568: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:43994 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52580 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:52594 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41416 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42694 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38522 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38530 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38608 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41048 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41430 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:41432 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48050 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59072 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60864 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60868 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50586 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39864 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44556 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:44570 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45458 - "GET / HTTP/1.0" 200 OK 2026-03-14 22:28:36,084 - lava_callback - INFO - Received callback for node 69b33e076267e2e450f0359f INFO: 172.21.0.1:40408 - "POST /node/69b33e076267e2e450f0359f HTTP/1.0" 202 Accepted 2026-03-14 22:28:36,089 - lava_callback - INFO - Starting async job submit for node 69b33e076267e2e450f0359f 2026-03-14 22:28:36,090 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 22:28:36,105 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b33e076267e2e450f0359f HTTP/1.1" 200 None 2026-03-14 22:28:36,105 - lava_callback - DEBUG - Processing node 69b33e076267e2e450f0359f: baseline-arm64-baylibre 2026-03-14 22:28:36,106 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b33e076267e2e450f0359f 2026-03-14 22:28:36,106 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 22:28:36,126 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b33e076267e2e450f0359f HTTP/1.1" 200 None 2026-03-14 22:28:36,127 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 22:28:36,141 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69afd839ae557f2600f0f045 HTTP/1.1" 200 None 2026-03-14 22:28:36,142 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 22:28:36,163 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b33e076267e2e450f0359f HTTP/1.1" 200 None 2026-03-14 22:28:36,164 - lava_callback - ERROR - Error processing callback for node 69b33e076267e2e450f0359f: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:40418 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52036 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52050 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40582 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37396 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58884 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:58896 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37724 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55552 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35596 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35602 - "GET / HTTP/1.0" 200 OK 2026-03-14 22:29:56,202 - lava_callback - INFO - Received callback for node 69b33e556267e2e450f035b1 INFO: 172.21.0.1:45068 - "POST /node/69b33e556267e2e450f035b1 HTTP/1.0" 202 Accepted 2026-03-14 22:29:56,208 - lava_callback - INFO - Starting async job submit for node 69b33e556267e2e450f035b1 2026-03-14 22:29:56,209 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 22:29:56,236 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b33e556267e2e450f035b1 HTTP/1.1" 200 None 2026-03-14 22:29:56,237 - lava_callback - DEBUG - Processing node 69b33e556267e2e450f035b1: baseline-arm64-baylibre 2026-03-14 22:29:56,237 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b33e556267e2e450f035b1 2026-03-14 22:29:56,237 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 22:29:56,259 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b33e556267e2e450f035b1 HTTP/1.1" 200 None 2026-03-14 22:29:56,261 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 22:29:56,306 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69afd839ae557f2600f0f045 HTTP/1.1" 200 None 2026-03-14 22:29:56,308 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 22:29:56,337 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b33e556267e2e450f035b1 HTTP/1.1" 200 None 2026-03-14 22:29:56,338 - lava_callback - ERROR - Error processing callback for node 69b33e556267e2e450f035b1: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:45080 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60226 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49264 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:49270 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44362 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44664 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48700 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48706 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49140 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52812 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52242 - "GET /api/metrics HTTP/1.0" 200 OK 2026-03-14 22:31:16,216 - lava_callback - INFO - Received callback for node 69b33ea76267e2e450f035bf INFO: 172.21.0.1:52252 - "POST /node/69b33ea76267e2e450f035bf HTTP/1.0" 202 Accepted 2026-03-14 22:31:16,222 - lava_callback - INFO - Starting async job submit for node 69b33ea76267e2e450f035bf 2026-03-14 22:31:16,223 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 22:31:16,259 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b33ea76267e2e450f035bf HTTP/1.1" 200 None 2026-03-14 22:31:16,260 - lava_callback - DEBUG - Processing node 69b33ea76267e2e450f035bf: baseline-arm64-baylibre 2026-03-14 22:31:16,260 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b33ea76267e2e450f035bf 2026-03-14 22:31:16,261 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 22:31:16,275 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b33ea76267e2e450f035bf HTTP/1.1" 200 None 2026-03-14 22:31:16,276 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 22:31:16,319 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69afd839ae557f2600f0f045 HTTP/1.1" 200 None 2026-03-14 22:31:16,322 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 22:31:16,353 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b33ea76267e2e450f035bf HTTP/1.1" 200 None 2026-03-14 22:31:16,355 - lava_callback - ERROR - Error processing callback for node 69b33ea76267e2e450f035bf: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:52254 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48044 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36990 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54748 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54758 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55946 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41068 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38562 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:38570 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52774 - "GET / HTTP/1.0" 200 OK 2026-03-14 22:32:36,257 - lava_callback - INFO - Received callback for node 69b33ef46267e2e450f035d3 INFO: 172.21.0.1:39622 - "POST /node/69b33ef46267e2e450f035d3 HTTP/1.0" 202 Accepted 2026-03-14 22:32:36,262 - lava_callback - INFO - Starting async job submit for node 69b33ef46267e2e450f035d3 2026-03-14 22:32:36,263 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 22:32:36,278 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b33ef46267e2e450f035d3 HTTP/1.1" 200 None 2026-03-14 22:32:36,279 - lava_callback - DEBUG - Processing node 69b33ef46267e2e450f035d3: baseline-arm64-baylibre 2026-03-14 22:32:36,279 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b33ef46267e2e450f035d3 2026-03-14 22:32:36,279 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 22:32:36,292 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b33ef46267e2e450f035d3 HTTP/1.1" 200 None 2026-03-14 22:32:36,294 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 22:32:36,306 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69afd839ae557f2600f0f045 HTTP/1.1" 200 None 2026-03-14 22:32:36,308 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 22:32:36,329 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b33ef46267e2e450f035d3 HTTP/1.1" 200 None 2026-03-14 22:32:36,334 - lava_callback - ERROR - Error processing callback for node 69b33ef46267e2e450f035d3: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:39636 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49652 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49660 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44782 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46430 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40060 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:40062 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52416 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55236 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34340 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34354 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56364 - "GET / HTTP/1.0" 200 OK 2026-03-14 22:34:02,370 - lava_callback - INFO - Received callback for node 69b33f486267e2e450f035e7 INFO: 172.21.0.1:38928 - "POST /node/69b33f486267e2e450f035e7 HTTP/1.0" 202 Accepted 2026-03-14 22:34:02,376 - lava_callback - INFO - Starting async job submit for node 69b33f486267e2e450f035e7 2026-03-14 22:34:02,376 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 22:34:02,391 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b33f486267e2e450f035e7 HTTP/1.1" 200 None 2026-03-14 22:34:02,392 - lava_callback - DEBUG - Processing node 69b33f486267e2e450f035e7: baseline-arm64-clabbe 2026-03-14 22:34:02,392 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b33f486267e2e450f035e7 2026-03-14 22:34:02,392 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 22:34:02,411 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b33f486267e2e450f035e7 HTTP/1.1" 200 None 2026-03-14 22:34:02,412 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 22:34:02,443 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69afd839ae557f2600f0f045 HTTP/1.1" 200 None 2026-03-14 22:34:02,445 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 22:34:02,466 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b33f486267e2e450f035e7 HTTP/1.1" 200 None 2026-03-14 22:34:02,471 - lava_callback - ERROR - Error processing callback for node 69b33f486267e2e450f035e7: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:38944 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51454 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:51466 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48874 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48354 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35338 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35350 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57980 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35700 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39484 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:39488 - "GET / HTTP/1.0" 200 OK 2026-03-14 22:35:22,417 - lava_callback - INFO - Received callback for node 69b33f9c6267e2e450f035f9 INFO: 172.21.0.1:50544 - "POST /node/69b33f9c6267e2e450f035f9 HTTP/1.0" 202 Accepted 2026-03-14 22:35:22,422 - lava_callback - INFO - Starting async job submit for node 69b33f9c6267e2e450f035f9 2026-03-14 22:35:22,423 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 22:35:22,443 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b33f9c6267e2e450f035f9 HTTP/1.1" 200 None 2026-03-14 22:35:22,444 - lava_callback - DEBUG - Processing node 69b33f9c6267e2e450f035f9: baseline-arm64-clabbe 2026-03-14 22:35:22,444 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b33f9c6267e2e450f035f9 2026-03-14 22:35:22,445 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 22:35:22,458 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b33f9c6267e2e450f035f9 HTTP/1.1" 200 None 2026-03-14 22:35:22,459 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 22:35:22,472 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69afd839ae557f2600f0f045 HTTP/1.1" 200 None 2026-03-14 22:35:22,474 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 22:35:22,494 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b33f9c6267e2e450f035f9 HTTP/1.1" 200 None 2026-03-14 22:35:22,500 - lava_callback - ERROR - Error processing callback for node 69b33f9c6267e2e450f035f9: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:50554 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55670 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34388 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34390 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60408 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41162 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50634 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:50640 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48110 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58430 - "GET / HTTP/1.0" 200 OK 2026-03-14 22:36:42,506 - lava_callback - INFO - Received callback for node 69b33fec6267e2e450f03601 INFO: 172.21.0.1:52854 - "POST /node/69b33fec6267e2e450f03601 HTTP/1.0" 202 Accepted 2026-03-14 22:36:42,512 - lava_callback - INFO - Starting async job submit for node 69b33fec6267e2e450f03601 2026-03-14 22:36:42,513 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 22:36:42,528 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b33fec6267e2e450f03601 HTTP/1.1" 200 None 2026-03-14 22:36:42,528 - lava_callback - DEBUG - Processing node 69b33fec6267e2e450f03601: baseline-arm64-clabbe 2026-03-14 22:36:42,529 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b33fec6267e2e450f03601 2026-03-14 22:36:42,529 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 22:36:42,544 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b33fec6267e2e450f03601 HTTP/1.1" 200 None 2026-03-14 22:36:42,546 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 22:36:42,564 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69afd839ae557f2600f0f045 HTTP/1.1" 200 None 2026-03-14 22:36:42,565 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 22:36:42,587 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b33fec6267e2e450f03601 HTTP/1.1" 200 None 2026-03-14 22:36:42,589 - lava_callback - ERROR - Error processing callback for node 69b33fec6267e2e450f03601: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:52858 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52862 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41288 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41902 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59538 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:59544 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35398 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48620 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56852 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56854 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48086 - "GET / HTTP/1.0" 200 OK 2026-03-14 22:38:02,560 - lava_callback - INFO - Received callback for node 69b3403c6267e2e450f03614 INFO: 172.21.0.1:53384 - "POST /node/69b3403c6267e2e450f03614 HTTP/1.0" 202 Accepted 2026-03-14 22:38:02,565 - lava_callback - INFO - Starting async job submit for node 69b3403c6267e2e450f03614 2026-03-14 22:38:02,566 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 22:38:02,581 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b3403c6267e2e450f03614 HTTP/1.1" 200 None 2026-03-14 22:38:02,582 - lava_callback - DEBUG - Processing node 69b3403c6267e2e450f03614: baseline-arm64-clabbe 2026-03-14 22:38:02,582 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b3403c6267e2e450f03614 2026-03-14 22:38:02,582 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 22:38:02,596 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b3403c6267e2e450f03614 HTTP/1.1" 200 None 2026-03-14 22:38:02,598 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 22:38:02,615 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69afd839ae557f2600f0f045 HTTP/1.1" 200 None 2026-03-14 22:38:02,616 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 22:38:02,637 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b3403c6267e2e450f03614 HTTP/1.1" 200 None 2026-03-14 22:38:02,638 - lava_callback - ERROR - Error processing callback for node 69b3403c6267e2e450f03614: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:53398 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33520 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:33530 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35196 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37212 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54596 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54612 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44204 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51026 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44344 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:44346 - "GET / HTTP/1.0" 200 OK 2026-03-14 22:39:22,616 - lava_callback - INFO - Received callback for node 69b3408b6267e2e450f03628 INFO: 172.21.0.1:56932 - "POST /node/69b3408b6267e2e450f03628 HTTP/1.0" 202 Accepted 2026-03-14 22:39:22,621 - lava_callback - INFO - Starting async job submit for node 69b3408b6267e2e450f03628 2026-03-14 22:39:22,622 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 22:39:22,658 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b3408b6267e2e450f03628 HTTP/1.1" 200 None 2026-03-14 22:39:22,659 - lava_callback - DEBUG - Processing node 69b3408b6267e2e450f03628: baseline-arm64-clabbe 2026-03-14 22:39:22,659 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b3408b6267e2e450f03628 2026-03-14 22:39:22,660 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 22:39:22,682 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b3408b6267e2e450f03628 HTTP/1.1" 200 None 2026-03-14 22:39:22,683 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 22:39:22,696 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69afd839ae557f2600f0f045 HTTP/1.1" 200 None 2026-03-14 22:39:22,698 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 22:39:22,729 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b3408b6267e2e450f03628 HTTP/1.1" 200 None 2026-03-14 22:39:22,730 - lava_callback - ERROR - Error processing callback for node 69b3408b6267e2e450f03628: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:56934 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44174 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39038 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39050 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46400 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57560 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48892 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:48902 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42628 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33732 - "GET / HTTP/1.0" 200 OK 2026-03-14 22:40:42,715 - lava_callback - INFO - Received callback for node 69b340db6267e2e450f03631 INFO: 172.21.0.1:49012 - "POST /node/69b340db6267e2e450f03631 HTTP/1.0" 202 Accepted 2026-03-14 22:40:42,720 - lava_callback - INFO - Starting async job submit for node 69b340db6267e2e450f03631 2026-03-14 22:40:42,721 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 22:40:42,736 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b340db6267e2e450f03631 HTTP/1.1" 200 None 2026-03-14 22:40:42,737 - lava_callback - DEBUG - Processing node 69b340db6267e2e450f03631: baseline-arm64-clabbe 2026-03-14 22:40:42,737 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b340db6267e2e450f03631 2026-03-14 22:40:42,738 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 22:40:42,772 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b340db6267e2e450f03631 HTTP/1.1" 200 None 2026-03-14 22:40:42,774 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 22:40:42,786 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69afd839ae557f2600f0f045 HTTP/1.1" 200 None 2026-03-14 22:40:42,788 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 22:40:42,808 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b340db6267e2e450f03631 HTTP/1.1" 200 None 2026-03-14 22:40:42,814 - lava_callback - ERROR - Error processing callback for node 69b340db6267e2e450f03631: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:49016 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49026 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56270 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38192 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50944 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:50950 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52602 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60908 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39724 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39726 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48268 - "GET / HTTP/1.0" 200 OK 2026-03-14 22:42:02,787 - lava_callback - INFO - Received callback for node 69b341296267e2e450f03644 INFO: 172.21.0.1:36148 - "POST /node/69b341296267e2e450f03644 HTTP/1.0" 202 Accepted 2026-03-14 22:42:02,793 - lava_callback - INFO - Starting async job submit for node 69b341296267e2e450f03644 2026-03-14 22:42:02,794 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 22:42:02,831 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b341296267e2e450f03644 HTTP/1.1" 200 None 2026-03-14 22:42:02,832 - lava_callback - DEBUG - Processing node 69b341296267e2e450f03644: baseline-arm64-clabbe 2026-03-14 22:42:02,833 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b341296267e2e450f03644 2026-03-14 22:42:02,833 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 22:42:02,846 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b341296267e2e450f03644 HTTP/1.1" 200 None 2026-03-14 22:42:02,847 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 22:42:02,869 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69afd839ae557f2600f0f045 HTTP/1.1" 200 None 2026-03-14 22:42:02,871 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 22:42:02,895 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b341296267e2e450f03644 HTTP/1.1" 200 None 2026-03-14 22:42:02,896 - lava_callback - ERROR - Error processing callback for node 69b341296267e2e450f03644: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:36154 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41340 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:41344 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48756 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48998 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35836 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35852 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37626 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58082 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43392 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:43404 - "GET / HTTP/1.0" 200 OK 2026-03-14 22:43:22,823 - lava_callback - INFO - Received callback for node 69b341776267e2e450f0364f INFO: 172.21.0.1:46794 - "POST /node/69b341776267e2e450f0364f HTTP/1.0" 202 Accepted 2026-03-14 22:43:22,831 - lava_callback - INFO - Starting async job submit for node 69b341776267e2e450f0364f 2026-03-14 22:43:22,832 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 22:43:22,873 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b341776267e2e450f0364f HTTP/1.1" 200 None 2026-03-14 22:43:22,874 - lava_callback - DEBUG - Processing node 69b341776267e2e450f0364f: baseline-arm64-clabbe 2026-03-14 22:43:22,874 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b341776267e2e450f0364f 2026-03-14 22:43:22,875 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 22:43:22,898 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b341776267e2e450f0364f HTTP/1.1" 200 None 2026-03-14 22:43:22,899 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 22:43:22,913 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69afd839ae557f2600f0f045 HTTP/1.1" 200 None 2026-03-14 22:43:22,915 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 22:43:22,954 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b341776267e2e450f0364f HTTP/1.1" 200 None 2026-03-14 22:43:22,961 - lava_callback - ERROR - Error processing callback for node 69b341776267e2e450f0364f: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:46798 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40138 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53024 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53040 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37094 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60124 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50368 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:50384 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55794 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51810 - "GET / HTTP/1.0" 200 OK 2026-03-14 22:44:42,894 - lava_callback - INFO - Received callback for node 69b341c56267e2e450f03661 INFO: 172.21.0.1:40774 - "POST /node/69b341c56267e2e450f03661 HTTP/1.0" 202 Accepted 2026-03-14 22:44:42,899 - lava_callback - INFO - Starting async job submit for node 69b341c56267e2e450f03661 2026-03-14 22:44:42,900 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 22:44:42,915 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b341c56267e2e450f03661 HTTP/1.1" 200 None 2026-03-14 22:44:42,916 - lava_callback - DEBUG - Processing node 69b341c56267e2e450f03661: baseline-arm64-clabbe 2026-03-14 22:44:42,916 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b341c56267e2e450f03661 2026-03-14 22:44:42,917 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 22:44:42,930 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b341c56267e2e450f03661 HTTP/1.1" 200 None 2026-03-14 22:44:42,931 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 22:44:42,944 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69afd839ae557f2600f0f045 HTTP/1.1" 200 None 2026-03-14 22:44:42,946 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 22:44:42,966 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b341c56267e2e450f03661 HTTP/1.1" 200 None 2026-03-14 22:44:42,972 - lava_callback - ERROR - Error processing callback for node 69b341c56267e2e450f03661: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:40780 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40790 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55624 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51096 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57038 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:57040 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53962 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39516 - "GET / HTTP/1.0" 200 OK 2026-03-14 22:45:43,048 - lava_callback - INFO - Received callback for node 69b342126267e2e450f03674 INFO: 172.21.0.1:52264 - "POST /node/69b342126267e2e450f03674 HTTP/1.0" 202 Accepted 2026-03-14 22:45:43,054 - lava_callback - INFO - Starting async job submit for node 69b342126267e2e450f03674 2026-03-14 22:45:43,055 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 22:45:43,091 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b342126267e2e450f03674 HTTP/1.1" 200 None 2026-03-14 22:45:43,092 - lava_callback - DEBUG - Processing node 69b342126267e2e450f03674: baseline-arm64-clabbe 2026-03-14 22:45:43,093 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b342126267e2e450f03674 2026-03-14 22:45:43,093 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 22:45:43,111 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b342126267e2e450f03674 HTTP/1.1" 200 None 2026-03-14 22:45:43,113 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 22:45:43,129 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69afd839ae557f2600f0f045 HTTP/1.1" 200 None 2026-03-14 22:45:43,130 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 22:45:43,156 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b342126267e2e450f03674 HTTP/1.1" 200 None 2026-03-14 22:45:43,157 - lava_callback - ERROR - Error processing callback for node 69b342126267e2e450f03674: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:52278 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52282 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60206 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56318 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41206 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:41216 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48086 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36688 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52912 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52928 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50294 - "GET / HTTP/1.0" 200 OK 2026-03-14 22:47:03,055 - lava_callback - INFO - Received callback for node 69b3425e6267e2e450f0367d INFO: 172.21.0.1:52130 - "POST /node/69b3425e6267e2e450f0367d HTTP/1.0" 202 Accepted 2026-03-14 22:47:03,060 - lava_callback - INFO - Starting async job submit for node 69b3425e6267e2e450f0367d 2026-03-14 22:47:03,061 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 22:47:03,109 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b3425e6267e2e450f0367d HTTP/1.1" 200 None 2026-03-14 22:47:03,110 - lava_callback - DEBUG - Processing node 69b3425e6267e2e450f0367d: baseline-arm64-clabbe 2026-03-14 22:47:03,110 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b3425e6267e2e450f0367d 2026-03-14 22:47:03,111 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 22:47:03,129 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b3425e6267e2e450f0367d HTTP/1.1" 200 None 2026-03-14 22:47:03,131 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 22:47:03,171 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69afd839ae557f2600f0f045 HTTP/1.1" 200 None 2026-03-14 22:47:03,172 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 22:47:03,215 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b3425e6267e2e450f0367d HTTP/1.1" 200 None 2026-03-14 22:47:03,217 - lava_callback - ERROR - Error processing callback for node 69b3425e6267e2e450f0367d: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:52144 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47458 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:47460 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50488 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54862 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50974 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45812 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45816 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51168 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39150 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:39164 - "GET / HTTP/1.0" 200 OK 2026-03-14 22:48:23,057 - lava_callback - INFO - Received callback for node 69b342ad6267e2e450f03694 INFO: 172.21.0.1:42988 - "POST /node/69b342ad6267e2e450f03694 HTTP/1.0" 202 Accepted 2026-03-14 22:48:23,062 - lava_callback - INFO - Starting async job submit for node 69b342ad6267e2e450f03694 2026-03-14 22:48:23,063 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 22:48:23,083 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b342ad6267e2e450f03694 HTTP/1.1" 200 None 2026-03-14 22:48:23,084 - lava_callback - DEBUG - Processing node 69b342ad6267e2e450f03694: baseline-arm64-clabbe 2026-03-14 22:48:23,085 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b342ad6267e2e450f03694 2026-03-14 22:48:23,085 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 22:48:23,110 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b342ad6267e2e450f03694 HTTP/1.1" 200 None 2026-03-14 22:48:23,111 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 22:48:23,125 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69afd839ae557f2600f0f045 HTTP/1.1" 200 None 2026-03-14 22:48:23,127 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 22:48:23,158 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b342ad6267e2e450f03694 HTTP/1.1" 200 None 2026-03-14 22:48:23,168 - lava_callback - ERROR - Error processing callback for node 69b342ad6267e2e450f03694: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:42992 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56256 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36980 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52774 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52788 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53190 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60934 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:60940 - "GET / HTTP/1.0" 200 OK 2026-03-14 22:49:17,474 - lava_callback - INFO - Received callback for node 69b342e96267e2e450f036aa INFO: 172.21.0.1:60950 - "POST /node/69b342e96267e2e450f036aa HTTP/1.0" 202 Accepted 2026-03-14 22:49:17,479 - lava_callback - INFO - Starting async job submit for node 69b342e96267e2e450f036aa 2026-03-14 22:49:17,480 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 22:49:17,495 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b342e96267e2e450f036aa HTTP/1.1" 200 None 2026-03-14 22:49:17,496 - lava_callback - DEBUG - Processing node 69b342e96267e2e450f036aa: baseline-arm-baylibre 2026-03-14 22:49:17,496 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b342e96267e2e450f036aa 2026-03-14 22:49:17,497 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 22:49:17,511 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b342e96267e2e450f036aa HTTP/1.1" 200 None 2026-03-14 22:49:17,512 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 22:49:17,525 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ada13b8fc97e5ba07d4d75 HTTP/1.1" 200 None 2026-03-14 22:49:17,527 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 22:49:17,548 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b342e96267e2e450f036aa HTTP/1.1" 200 None 2026-03-14 22:49:17,557 - lava_callback - ERROR - Error processing callback for node 69b342e96267e2e450f036aa: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:57834 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34264 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35514 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51478 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51490 - "GET / HTTP/1.0" 200 OK 2026-03-14 22:49:57,143 - lava_callback - INFO - Received callback for node 69b3430c6267e2e450f036be INFO: 172.21.0.1:51496 - "POST /node/69b3430c6267e2e450f036be HTTP/1.0" 202 Accepted 2026-03-14 22:49:57,148 - lava_callback - INFO - Starting async job submit for node 69b3430c6267e2e450f036be 2026-03-14 22:49:57,149 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 22:49:57,166 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b3430c6267e2e450f036be HTTP/1.1" 200 None 2026-03-14 22:49:57,167 - lava_callback - DEBUG - Processing node 69b3430c6267e2e450f036be: baseline-arm-baylibre 2026-03-14 22:49:57,167 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b3430c6267e2e450f036be 2026-03-14 22:49:57,168 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 22:49:57,191 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b3430c6267e2e450f036be HTTP/1.1" 200 None 2026-03-14 22:49:57,192 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 22:49:57,206 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ada13b8fc97e5ba07d4d75 HTTP/1.1" 200 None 2026-03-14 22:49:57,207 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 22:49:57,236 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b3430c6267e2e450f036be HTTP/1.1" 200 None 2026-03-14 22:49:57,237 - lava_callback - ERROR - Error processing callback for node 69b3430c6267e2e450f036be: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:45594 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50560 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:50568 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49360 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44062 - "GET / HTTP/1.0" 200 OK 2026-03-14 22:50:37,330 - lava_callback - INFO - Received callback for node 69b3432f6267e2e450f036cd INFO: 172.21.0.1:44076 - "POST /node/69b3432f6267e2e450f036cd HTTP/1.0" 202 Accepted 2026-03-14 22:50:37,335 - lava_callback - INFO - Starting async job submit for node 69b3432f6267e2e450f036cd 2026-03-14 22:50:37,336 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 22:50:37,355 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b3432f6267e2e450f036cd HTTP/1.1" 200 None 2026-03-14 22:50:37,356 - lava_callback - DEBUG - Processing node 69b3432f6267e2e450f036cd: baseline-arm-baylibre 2026-03-14 22:50:37,356 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b3432f6267e2e450f036cd 2026-03-14 22:50:37,357 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 22:50:37,371 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b3432f6267e2e450f036cd HTTP/1.1" 200 None 2026-03-14 22:50:37,372 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 22:50:37,411 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ada13b8fc97e5ba07d4d75 HTTP/1.1" 200 None 2026-03-14 22:50:37,413 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 22:50:37,451 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b3432f6267e2e450f036cd HTTP/1.1" 200 None 2026-03-14 22:50:37,457 - lava_callback - ERROR - Error processing callback for node 69b3432f6267e2e450f036cd: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:55108 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53582 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53586 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41102 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52844 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:52850 - "GET / HTTP/1.0" 200 OK 2026-03-14 22:51:17,199 - lava_callback - INFO - Received callback for node 69b343546267e2e450f036ea INFO: 172.21.0.1:52866 - "POST /node/69b343546267e2e450f036ea HTTP/1.0" 202 Accepted 2026-03-14 22:51:17,204 - lava_callback - INFO - Starting async job submit for node 69b343546267e2e450f036ea 2026-03-14 22:51:17,205 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 22:51:17,226 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b343546267e2e450f036ea HTTP/1.1" 200 None 2026-03-14 22:51:17,227 - lava_callback - DEBUG - Processing node 69b343546267e2e450f036ea: baseline-arm-baylibre 2026-03-14 22:51:17,227 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b343546267e2e450f036ea 2026-03-14 22:51:17,227 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 22:51:17,241 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b343546267e2e450f036ea HTTP/1.1" 200 None 2026-03-14 22:51:17,243 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 22:51:17,266 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ada13b8fc97e5ba07d4d75 HTTP/1.1" 200 None 2026-03-14 22:51:17,268 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 22:51:17,289 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b343546267e2e450f036ea HTTP/1.1" 200 None 2026-03-14 22:51:17,290 - lava_callback - ERROR - Error processing callback for node 69b343546267e2e450f036ea: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:55180 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45496 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55572 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59754 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59756 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37800 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39940 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:39948 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58952 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60712 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55438 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48672 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48674 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47234 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56682 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:56686 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57820 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59546 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59044 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54466 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54468 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45932 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36464 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:36468 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35060 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39712 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45692 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57488 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57502 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:32948 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33558 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:33560 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57390 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49142 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46150 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48856 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48872 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52230 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36208 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:36214 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45626 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51126 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39572 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53404 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53416 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50332 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41956 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:41960 - "GET / HTTP/1.0" 200 OK 2026-03-14 22:57:17,576 - lava_callback - INFO - Received callback for node 69b344bf6267e2e450f03739 INFO: 172.21.0.1:41974 - "POST /node/69b344bf6267e2e450f03739 HTTP/1.0" 202 Accepted 2026-03-14 22:57:17,582 - lava_callback - INFO - Starting async job submit for node 69b344bf6267e2e450f03739 2026-03-14 22:57:17,582 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 22:57:17,597 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b344bf6267e2e450f03739 HTTP/1.1" 200 None 2026-03-14 22:57:17,598 - lava_callback - DEBUG - Processing node 69b344bf6267e2e450f03739: baseline-arm-baylibre 2026-03-14 22:57:17,598 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b344bf6267e2e450f03739 2026-03-14 22:57:17,599 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 22:57:17,612 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b344bf6267e2e450f03739 HTTP/1.1" 200 None 2026-03-14 22:57:17,613 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 22:57:17,626 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ada13b8fc97e5ba07d4d75 HTTP/1.1" 200 None 2026-03-14 22:57:17,627 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 22:57:17,649 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b344bf6267e2e450f03739 HTTP/1.1" 200 None 2026-03-14 22:57:17,650 - lava_callback - ERROR - Error processing callback for node 69b344bf6267e2e450f03739: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:35258 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60990 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56168 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46692 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46696 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37932 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54682 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:54690 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34042 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39670 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35370 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36090 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36104 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34840 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38378 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:38394 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38798 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48852 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42474 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60056 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60060 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55768 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46520 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:46534 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49436 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52802 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34678 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53476 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53488 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44504 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35292 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:35304 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52110 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51556 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33158 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46752 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46756 - "GET / HTTP/1.0" 200 OK 2026-03-14 23:01:57,812 - lava_callback - INFO - Received callback for node 69b345d76267e2e450f037a9 INFO: 172.21.0.1:46762 - "POST /node/69b345d76267e2e450f037a9 HTTP/1.0" 202 Accepted 2026-03-14 23:01:57,818 - lava_callback - INFO - Starting async job submit for node 69b345d76267e2e450f037a9 2026-03-14 23:01:57,819 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 23:01:57,833 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b345d76267e2e450f037a9 HTTP/1.1" 200 None 2026-03-14 23:01:57,834 - lava_callback - DEBUG - Processing node 69b345d76267e2e450f037a9: baseline-arm64-baylibre 2026-03-14 23:01:57,834 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b345d76267e2e450f037a9 2026-03-14 23:01:57,835 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 23:01:57,859 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b345d76267e2e450f037a9 HTTP/1.1" 200 None 2026-03-14 23:01:57,861 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 23:01:57,874 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b2e73e6267e2e450f02132 HTTP/1.1" 200 None 2026-03-14 23:01:57,875 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 23:01:57,900 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b345d76267e2e450f037a9 HTTP/1.1" 200 None 2026-03-14 23:01:57,902 - lava_callback - ERROR - Error processing callback for node 69b345d76267e2e450f037a9: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:45266 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35186 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:35188 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36786 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49286 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53364 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46188 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46190 - "GET / HTTP/1.0" 200 OK 2026-03-14 23:02:57,823 - lava_callback - INFO - Received callback for node 69b3461d6267e2e450f037c5 INFO: 172.21.0.1:46192 - "POST /node/69b3461d6267e2e450f037c5 HTTP/1.0" 202 Accepted 2026-03-14 23:02:57,829 - lava_callback - INFO - Starting async job submit for node 69b3461d6267e2e450f037c5 2026-03-14 23:02:57,829 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 23:02:57,844 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b3461d6267e2e450f037c5 HTTP/1.1" 200 None 2026-03-14 23:02:57,845 - lava_callback - DEBUG - Processing node 69b3461d6267e2e450f037c5: baseline-arm-baylibre 2026-03-14 23:02:57,845 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b3461d6267e2e450f037c5 2026-03-14 23:02:57,845 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 23:02:57,867 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b3461d6267e2e450f037c5 HTTP/1.1" 200 None 2026-03-14 23:02:57,869 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 23:02:57,882 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ada13b8fc97e5ba07d4d75 HTTP/1.1" 200 None 2026-03-14 23:02:57,883 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 23:02:57,904 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b3461d6267e2e450f037c5 HTTP/1.1" 200 None 2026-03-14 23:02:57,905 - lava_callback - ERROR - Error processing callback for node 69b3461d6267e2e450f037c5: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:52568 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55692 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:55698 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57598 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35974 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41558 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57986 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58002 - "GET / HTTP/1.0" 200 OK 2026-03-14 23:04:03,839 - lava_callback - INFO - Received callback for node 69b346516267e2e450f037df INFO: 172.21.0.1:49214 - "POST /node/69b346516267e2e450f037df HTTP/1.0" 202 Accepted 2026-03-14 23:04:03,845 - lava_callback - INFO - Starting async job submit for node 69b346516267e2e450f037df 2026-03-14 23:04:03,845 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 23:04:03,859 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b346516267e2e450f037df HTTP/1.1" 200 None 2026-03-14 23:04:03,860 - lava_callback - DEBUG - Processing node 69b346516267e2e450f037df: baseline-arm64-clabbe 2026-03-14 23:04:03,861 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b346516267e2e450f037df 2026-03-14 23:04:03,861 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 23:04:03,874 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b346516267e2e450f037df HTTP/1.1" 200 None 2026-03-14 23:04:03,876 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 23:04:03,888 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b2e73e6267e2e450f02132 HTTP/1.1" 200 None 2026-03-14 23:04:03,890 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 23:04:03,911 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b346516267e2e450f037df HTTP/1.1" 200 None 2026-03-14 23:04:03,917 - lava_callback - ERROR - Error processing callback for node 69b346516267e2e450f037df: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:49228 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59638 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:59642 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46072 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35580 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46644 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53904 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53912 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47092 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37832 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:37848 - "GET / HTTP/1.0" 200 OK 2026-03-14 23:05:23,866 - lava_callback - INFO - Received callback for node 69b346a16267e2e450f037e8 INFO: 172.21.0.1:47968 - "POST /node/69b346a16267e2e450f037e8 HTTP/1.0" 202 Accepted 2026-03-14 23:05:23,872 - lava_callback - INFO - Starting async job submit for node 69b346a16267e2e450f037e8 2026-03-14 23:05:23,872 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 23:05:23,898 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b346a16267e2e450f037e8 HTTP/1.1" 200 None 2026-03-14 23:05:23,899 - lava_callback - DEBUG - Processing node 69b346a16267e2e450f037e8: baseline-arm64-clabbe 2026-03-14 23:05:23,899 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b346a16267e2e450f037e8 2026-03-14 23:05:23,900 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 23:05:23,913 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b346a16267e2e450f037e8 HTTP/1.1" 200 None 2026-03-14 23:05:23,914 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 23:05:23,928 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b2e73e6267e2e450f02132 HTTP/1.1" 200 None 2026-03-14 23:05:23,929 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 23:05:23,951 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b346a16267e2e450f037e8 HTTP/1.1" 200 None 2026-03-14 23:05:23,952 - lava_callback - ERROR - Error processing callback for node 69b346a16267e2e450f037e8: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:47974 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44918 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35476 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38150 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38154 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55998 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55724 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:55730 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56844 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55782 - "GET / HTTP/1.0" 200 OK 2026-03-14 23:06:43,914 - lava_callback - INFO - Received callback for node 69b346f26267e2e450f037fb INFO: 172.21.0.1:52930 - "POST /node/69b346f26267e2e450f037fb HTTP/1.0" 202 Accepted 2026-03-14 23:06:43,919 - lava_callback - INFO - Starting async job submit for node 69b346f26267e2e450f037fb 2026-03-14 23:06:43,920 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 23:06:43,943 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b346f26267e2e450f037fb HTTP/1.1" 200 None 2026-03-14 23:06:43,943 - lava_callback - DEBUG - Processing node 69b346f26267e2e450f037fb: baseline-arm64-clabbe 2026-03-14 23:06:43,944 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b346f26267e2e450f037fb 2026-03-14 23:06:43,944 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 23:06:43,975 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b346f26267e2e450f037fb HTTP/1.1" 200 None 2026-03-14 23:06:43,976 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 23:06:43,989 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b2e73e6267e2e450f02132 HTTP/1.1" 200 None 2026-03-14 23:06:43,991 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 23:06:44,012 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b346f26267e2e450f037fb HTTP/1.1" 200 None 2026-03-14 23:06:44,017 - lava_callback - ERROR - Error processing callback for node 69b346f26267e2e450f037fb: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:52946 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48640 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48648 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37054 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52752 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:52762 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35416 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35168 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34734 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51266 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51280 - "GET / HTTP/1.0" 200 OK 2026-03-14 23:08:04,031 - lava_callback - INFO - Received callback for node 69b347436267e2e450f03829 INFO: 172.21.0.1:33472 - "POST /node/69b347436267e2e450f03829 HTTP/1.0" 202 Accepted 2026-03-14 23:08:04,036 - lava_callback - INFO - Starting async job submit for node 69b347436267e2e450f03829 2026-03-14 23:08:04,037 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 23:08:04,051 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b347436267e2e450f03829 HTTP/1.1" 200 None 2026-03-14 23:08:04,052 - lava_callback - DEBUG - Processing node 69b347436267e2e450f03829: baseline-arm64-clabbe 2026-03-14 23:08:04,052 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b347436267e2e450f03829 2026-03-14 23:08:04,053 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 23:08:04,066 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b347436267e2e450f03829 HTTP/1.1" 200 None 2026-03-14 23:08:04,067 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 23:08:04,080 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b2e73e6267e2e450f02132 HTTP/1.1" 200 None 2026-03-14 23:08:04,082 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 23:08:04,112 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b347436267e2e450f03829 HTTP/1.1" 200 None 2026-03-14 23:08:04,113 - lava_callback - ERROR - Error processing callback for node 69b347436267e2e450f03829: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:33484 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35470 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:35486 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53130 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58268 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43188 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41860 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41866 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52610 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36710 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:36714 - "GET / HTTP/1.0" 200 OK 2026-03-14 23:09:24,081 - lava_callback - INFO - Received callback for node 69b347956267e2e450f03851 INFO: 172.21.0.1:53956 - "POST /node/69b347956267e2e450f03851 HTTP/1.0" 202 Accepted 2026-03-14 23:09:24,086 - lava_callback - INFO - Starting async job submit for node 69b347956267e2e450f03851 2026-03-14 23:09:24,087 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 23:09:24,111 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b347956267e2e450f03851 HTTP/1.1" 200 None 2026-03-14 23:09:24,112 - lava_callback - DEBUG - Processing node 69b347956267e2e450f03851: baseline-arm64-clabbe 2026-03-14 23:09:24,112 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b347956267e2e450f03851 2026-03-14 23:09:24,112 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 23:09:24,125 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b347956267e2e450f03851 HTTP/1.1" 200 None 2026-03-14 23:09:24,126 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 23:09:24,144 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b2e73e6267e2e450f02132 HTTP/1.1" 200 None 2026-03-14 23:09:24,145 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 23:09:24,174 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b347956267e2e450f03851 HTTP/1.1" 200 None 2026-03-14 23:09:24,177 - lava_callback - ERROR - Error processing callback for node 69b347956267e2e450f03851: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:53970 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38272 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52170 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42994 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43010 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34610 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44526 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:44530 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56108 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35432 - "GET / HTTP/1.0" 200 OK 2026-03-14 23:10:44,179 - lava_callback - INFO - Received callback for node 69b347eb6267e2e450f0386c INFO: 172.21.0.1:36806 - "POST /node/69b347eb6267e2e450f0386c HTTP/1.0" 202 Accepted 2026-03-14 23:10:44,184 - lava_callback - INFO - Starting async job submit for node 69b347eb6267e2e450f0386c 2026-03-14 23:10:44,185 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 23:10:44,218 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b347eb6267e2e450f0386c HTTP/1.1" 200 None 2026-03-14 23:10:44,219 - lava_callback - DEBUG - Processing node 69b347eb6267e2e450f0386c: baseline-arm64-clabbe 2026-03-14 23:10:44,219 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b347eb6267e2e450f0386c 2026-03-14 23:10:44,219 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 23:10:44,233 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b347eb6267e2e450f0386c HTTP/1.1" 200 None 2026-03-14 23:10:44,234 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 23:10:44,247 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b2e73e6267e2e450f02132 HTTP/1.1" 200 None 2026-03-14 23:10:44,249 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 23:10:44,269 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b347eb6267e2e450f0386c HTTP/1.1" 200 None 2026-03-14 23:10:44,280 - lava_callback - ERROR - Error processing callback for node 69b347eb6267e2e450f0386c: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:36814 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51404 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51408 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50962 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39764 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:39780 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58042 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41764 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45336 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33980 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33994 - "GET / HTTP/1.0" 200 OK 2026-03-14 23:12:04,196 - lava_callback - INFO - Received callback for node 69b348306267e2e450f03896 INFO: 172.21.0.1:54630 - "POST /node/69b348306267e2e450f03896 HTTP/1.0" 202 Accepted 2026-03-14 23:12:04,201 - lava_callback - INFO - Starting async job submit for node 69b348306267e2e450f03896 2026-03-14 23:12:04,202 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 23:12:04,217 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b348306267e2e450f03896 HTTP/1.1" 200 None 2026-03-14 23:12:04,218 - lava_callback - DEBUG - Processing node 69b348306267e2e450f03896: baseline-arm-clabbe 2026-03-14 23:12:04,218 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b348306267e2e450f03896 2026-03-14 23:12:04,218 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 23:12:04,232 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b348306267e2e450f03896 HTTP/1.1" 200 None 2026-03-14 23:12:04,233 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 23:12:04,246 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ada13b8fc97e5ba07d4d75 HTTP/1.1" 200 None 2026-03-14 23:12:04,248 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 23:12:04,273 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b348306267e2e450f03896 HTTP/1.1" 200 None 2026-03-14 23:12:04,274 - lava_callback - ERROR - Error processing callback for node 69b348306267e2e450f03896: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:54638 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44694 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:44696 - "GET / HTTP/1.0" 200 OK 2026-03-14 23:12:24,173 - lava_callback - INFO - Received callback for node 69b348556267e2e450f038a6 INFO: 172.21.0.1:39006 - "POST /node/69b348556267e2e450f038a6 HTTP/1.0" 202 Accepted 2026-03-14 23:12:24,178 - lava_callback - INFO - Starting async job submit for node 69b348556267e2e450f038a6 2026-03-14 23:12:24,179 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 23:12:24,192 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b348556267e2e450f038a6 HTTP/1.1" 200 None 2026-03-14 23:12:24,193 - lava_callback - DEBUG - Processing node 69b348556267e2e450f038a6: baseline-arm-clabbe 2026-03-14 23:12:24,193 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b348556267e2e450f038a6 2026-03-14 23:12:24,194 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 23:12:24,209 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b348556267e2e450f038a6 HTTP/1.1" 200 None 2026-03-14 23:12:24,211 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 23:12:24,226 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ada13b8fc97e5ba07d4d75 HTTP/1.1" 200 None 2026-03-14 23:12:24,228 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 23:12:24,258 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b348556267e2e450f038a6 HTTP/1.1" 200 None 2026-03-14 23:12:24,266 - lava_callback - ERROR - Error processing callback for node 69b348556267e2e450f038a6: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:39008 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42116 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54038 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36126 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36142 - "GET / HTTP/1.0" 200 OK 2026-03-14 23:13:04,349 - lava_callback - INFO - Received callback for node 69b3487a6267e2e450f038b6 INFO: 172.21.0.1:45922 - "POST /node/69b3487a6267e2e450f038b6 HTTP/1.0" 202 Accepted 2026-03-14 23:13:04,355 - lava_callback - INFO - Starting async job submit for node 69b3487a6267e2e450f038b6 2026-03-14 23:13:04,356 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 23:13:04,371 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b3487a6267e2e450f038b6 HTTP/1.1" 200 None 2026-03-14 23:13:04,372 - lava_callback - DEBUG - Processing node 69b3487a6267e2e450f038b6: baseline-arm-clabbe 2026-03-14 23:13:04,372 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b3487a6267e2e450f038b6 2026-03-14 23:13:04,373 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 23:13:04,387 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b3487a6267e2e450f038b6 HTTP/1.1" 200 None 2026-03-14 23:13:04,388 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 23:13:04,407 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ada13b8fc97e5ba07d4d75 HTTP/1.1" 200 None 2026-03-14 23:13:04,409 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 23:13:04,430 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b3487a6267e2e450f038b6 HTTP/1.1" 200 None 2026-03-14 23:13:04,436 - lava_callback - ERROR - Error processing callback for node 69b3487a6267e2e450f038b6: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:45938 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54952 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:54958 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39430 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58994 - "GET / HTTP/1.0" 200 OK 2026-03-14 23:13:44,237 - lava_callback - INFO - Received callback for node 69b3489e6267e2e450f038c5 INFO: 172.21.0.1:47050 - "POST /node/69b3489e6267e2e450f038c5 HTTP/1.0" 202 Accepted 2026-03-14 23:13:44,243 - lava_callback - INFO - Starting async job submit for node 69b3489e6267e2e450f038c5 2026-03-14 23:13:44,244 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 23:13:44,268 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b3489e6267e2e450f038c5 HTTP/1.1" 200 None 2026-03-14 23:13:44,269 - lava_callback - DEBUG - Processing node 69b3489e6267e2e450f038c5: baseline-arm-clabbe 2026-03-14 23:13:44,270 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b3489e6267e2e450f038c5 2026-03-14 23:13:44,270 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 23:13:44,283 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b3489e6267e2e450f038c5 HTTP/1.1" 200 None 2026-03-14 23:13:44,285 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 23:13:44,300 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ada13b8fc97e5ba07d4d75 HTTP/1.1" 200 None 2026-03-14 23:13:44,301 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 23:13:44,321 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b3489e6267e2e450f038c5 HTTP/1.1" 200 None 2026-03-14 23:13:44,327 - lava_callback - ERROR - Error processing callback for node 69b3489e6267e2e450f038c5: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:47064 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43672 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43678 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40554 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45740 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:45754 - "GET / HTTP/1.0" 200 OK 2026-03-14 23:14:18,904 - lava_callback - INFO - Received callback for node 69b348bd6267e2e450f038d7 INFO: 172.21.0.1:45770 - "POST /node/69b348bd6267e2e450f038d7 HTTP/1.0" 202 Accepted 2026-03-14 23:14:18,910 - lava_callback - INFO - Starting async job submit for node 69b348bd6267e2e450f038d7 2026-03-14 23:14:18,910 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 23:14:18,931 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b348bd6267e2e450f038d7 HTTP/1.1" 200 None 2026-03-14 23:14:18,932 - lava_callback - DEBUG - Processing node 69b348bd6267e2e450f038d7: baseline-arm-baylibre 2026-03-14 23:14:18,932 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b348bd6267e2e450f038d7 2026-03-14 23:14:18,933 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 23:14:18,946 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b348bd6267e2e450f038d7 HTTP/1.1" 200 None 2026-03-14 23:14:18,947 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 23:14:18,960 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ada13b8fc97e5ba07d4d75 HTTP/1.1" 200 None 2026-03-14 23:14:18,962 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 23:14:18,982 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b348bd6267e2e450f038d7 HTTP/1.1" 200 None 2026-03-14 23:14:18,984 - lava_callback - ERROR - Error processing callback for node 69b348bd6267e2e450f038d7: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:53052 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40762 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37746 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45724 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45740 - "GET / HTTP/1.0" 200 OK 2026-03-14 23:15:04,435 - lava_callback - INFO - Received callback for node 69b348e76267e2e450f038ea INFO: 172.21.0.1:46720 - "POST /node/69b348e76267e2e450f038ea HTTP/1.0" 202 Accepted 2026-03-14 23:15:04,441 - lava_callback - INFO - Starting async job submit for node 69b348e76267e2e450f038ea 2026-03-14 23:15:04,442 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 23:15:04,459 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b348e76267e2e450f038ea HTTP/1.1" 200 None 2026-03-14 23:15:04,460 - lava_callback - DEBUG - Processing node 69b348e76267e2e450f038ea: baseline-arm-clabbe 2026-03-14 23:15:04,460 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b348e76267e2e450f038ea 2026-03-14 23:15:04,461 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 23:15:04,475 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b348e76267e2e450f038ea HTTP/1.1" 200 None 2026-03-14 23:15:04,476 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 23:15:04,490 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ada13b8fc97e5ba07d4d75 HTTP/1.1" 200 None 2026-03-14 23:15:04,492 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 23:15:04,513 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b348e76267e2e450f038ea HTTP/1.1" 200 None 2026-03-14 23:15:04,518 - lava_callback - ERROR - Error processing callback for node 69b348e76267e2e450f038ea: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:46736 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41752 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:41758 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44806 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53736 - "GET / HTTP/1.0" 200 OK 2026-03-14 23:15:44,311 - lava_callback - INFO - Received callback for node 69b3490b6267e2e450f038fd INFO: 172.21.0.1:38748 - "POST /node/69b3490b6267e2e450f038fd HTTP/1.0" 202 Accepted 2026-03-14 23:15:44,317 - lava_callback - INFO - Starting async job submit for node 69b3490b6267e2e450f038fd 2026-03-14 23:15:44,317 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 23:15:44,333 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b3490b6267e2e450f038fd HTTP/1.1" 200 None 2026-03-14 23:15:44,334 - lava_callback - DEBUG - Processing node 69b3490b6267e2e450f038fd: baseline-arm-clabbe 2026-03-14 23:15:44,334 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b3490b6267e2e450f038fd 2026-03-14 23:15:44,334 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 23:15:44,348 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b3490b6267e2e450f038fd HTTP/1.1" 200 None 2026-03-14 23:15:44,350 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 23:15:44,363 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ada13b8fc97e5ba07d4d75 HTTP/1.1" 200 None 2026-03-14 23:15:44,364 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 23:15:44,405 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b3490b6267e2e450f038fd HTTP/1.1" 200 None 2026-03-14 23:15:44,406 - lava_callback - ERROR - Error processing callback for node 69b3490b6267e2e450f038fd: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:38754 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43220 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43224 - "GET / HTTP/1.0" 200 OK 2026-03-14 23:16:04,359 - lava_callback - INFO - Received callback for node 69b3492f6267e2e450f0390f INFO: 172.21.0.1:36906 - "POST /node/69b3492f6267e2e450f0390f HTTP/1.0" 202 Accepted 2026-03-14 23:16:04,365 - lava_callback - INFO - Starting async job submit for node 69b3492f6267e2e450f0390f 2026-03-14 23:16:04,366 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 23:16:04,379 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b3492f6267e2e450f0390f HTTP/1.1" 200 None 2026-03-14 23:16:04,380 - lava_callback - DEBUG - Processing node 69b3492f6267e2e450f0390f: baseline-arm-clabbe 2026-03-14 23:16:04,380 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b3492f6267e2e450f0390f 2026-03-14 23:16:04,381 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 23:16:04,394 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b3492f6267e2e450f0390f HTTP/1.1" 200 None 2026-03-14 23:16:04,396 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 23:16:04,415 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ada13b8fc97e5ba07d4d75 HTTP/1.1" 200 None 2026-03-14 23:16:04,416 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 23:16:04,436 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b3492f6267e2e450f0390f HTTP/1.1" 200 None 2026-03-14 23:16:04,438 - lava_callback - ERROR - Error processing callback for node 69b3492f6267e2e450f0390f: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:36910 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46096 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:46112 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58948 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45748 - "GET / HTTP/1.0" 200 OK 2026-03-14 23:16:44,385 - lava_callback - INFO - Received callback for node 69b349536267e2e450f03920 INFO: 172.21.0.1:44464 - "POST /node/69b349536267e2e450f03920 HTTP/1.0" 202 Accepted 2026-03-14 23:16:44,391 - lava_callback - INFO - Starting async job submit for node 69b349536267e2e450f03920 2026-03-14 23:16:44,392 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 23:16:44,407 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b349536267e2e450f03920 HTTP/1.1" 200 None 2026-03-14 23:16:44,408 - lava_callback - DEBUG - Processing node 69b349536267e2e450f03920: baseline-arm-clabbe 2026-03-14 23:16:44,409 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b349536267e2e450f03920 2026-03-14 23:16:44,409 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 23:16:44,434 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b349536267e2e450f03920 HTTP/1.1" 200 None 2026-03-14 23:16:44,436 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 23:16:44,449 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ada13b8fc97e5ba07d4d75 HTTP/1.1" 200 None 2026-03-14 23:16:44,451 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 23:16:44,492 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b349536267e2e450f03920 HTTP/1.1" 200 None 2026-03-14 23:16:44,498 - lava_callback - ERROR - Error processing callback for node 69b349536267e2e450f03920: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:44476 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59732 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59744 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49156 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35304 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:35314 - "GET / HTTP/1.0" 200 OK 2026-03-14 23:17:24,455 - lava_callback - INFO - Received callback for node 69b349786267e2e450f03932 INFO: 172.21.0.1:60964 - "POST /node/69b349786267e2e450f03932 HTTP/1.0" 202 Accepted 2026-03-14 23:17:24,460 - lava_callback - INFO - Starting async job submit for node 69b349786267e2e450f03932 2026-03-14 23:17:24,461 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 23:17:24,481 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b349786267e2e450f03932 HTTP/1.1" 200 None 2026-03-14 23:17:24,482 - lava_callback - DEBUG - Processing node 69b349786267e2e450f03932: baseline-arm-clabbe 2026-03-14 23:17:24,483 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b349786267e2e450f03932 2026-03-14 23:17:24,484 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 23:17:24,498 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b349786267e2e450f03932 HTTP/1.1" 200 None 2026-03-14 23:17:24,499 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 23:17:24,518 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ada13b8fc97e5ba07d4d75 HTTP/1.1" 200 None 2026-03-14 23:17:24,520 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 23:17:24,542 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b349786267e2e450f03932 HTTP/1.1" 200 None 2026-03-14 23:17:24,551 - lava_callback - ERROR - Error processing callback for node 69b349786267e2e450f03932: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:60978 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58068 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58484 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39004 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39016 - "GET / HTTP/1.0" 200 OK 2026-03-14 23:18:04,442 - lava_callback - INFO - Received callback for node 69b3499c6267e2e450f03940 INFO: 172.21.0.1:55006 - "POST /node/69b3499c6267e2e450f03940 HTTP/1.0" 202 Accepted 2026-03-14 23:18:04,447 - lava_callback - INFO - Starting async job submit for node 69b3499c6267e2e450f03940 2026-03-14 23:18:04,448 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 23:18:04,463 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b3499c6267e2e450f03940 HTTP/1.1" 200 None 2026-03-14 23:18:04,464 - lava_callback - DEBUG - Processing node 69b3499c6267e2e450f03940: baseline-arm-clabbe 2026-03-14 23:18:04,464 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b3499c6267e2e450f03940 2026-03-14 23:18:04,465 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 23:18:04,478 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b3499c6267e2e450f03940 HTTP/1.1" 200 None 2026-03-14 23:18:04,479 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 23:18:04,492 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ada13b8fc97e5ba07d4d75 HTTP/1.1" 200 None 2026-03-14 23:18:04,494 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 23:18:04,514 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b3499c6267e2e450f03940 HTTP/1.1" 200 None 2026-03-14 23:18:04,520 - lava_callback - ERROR - Error processing callback for node 69b3499c6267e2e450f03940: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:55010 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56224 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:56238 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59472 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42874 - "GET / HTTP/1.0" 200 OK 2026-03-14 23:18:38,794 - lava_callback - INFO - Received callback for node 69b349c56267e2e450f0394f INFO: 172.21.0.1:42878 - "POST /node/69b349c56267e2e450f0394f HTTP/1.0" 202 Accepted 2026-03-14 23:18:38,800 - lava_callback - INFO - Starting async job submit for node 69b349c56267e2e450f0394f 2026-03-14 23:18:38,801 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 23:18:38,814 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b349c56267e2e450f0394f HTTP/1.1" 200 None 2026-03-14 23:18:38,815 - lava_callback - DEBUG - Processing node 69b349c56267e2e450f0394f: baseline-arm64-baylibre 2026-03-14 23:18:38,815 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b349c56267e2e450f0394f 2026-03-14 23:18:38,816 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 23:18:38,846 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b349c56267e2e450f0394f HTTP/1.1" 200 None 2026-03-14 23:18:38,847 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 23:18:38,861 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ada1488fc97e5ba07d4d8d HTTP/1.1" 200 None 2026-03-14 23:18:38,862 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 23:18:38,882 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b349c56267e2e450f0394f HTTP/1.1" 200 None 2026-03-14 23:18:38,888 - lava_callback - ERROR - Error processing callback for node 69b349c56267e2e450f0394f: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:60870 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59474 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59476 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58622 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38922 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:38924 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47052 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59038 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59672 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54504 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54508 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42552 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49268 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:49284 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33712 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56372 - "GET / HTTP/1.0" 200 OK 2026-03-14 23:20:39,080 - lava_callback - INFO - Received callback for node 69b34a3b6267e2e450f0397c INFO: 172.21.0.1:56378 - "POST /node/69b34a3b6267e2e450f0397c HTTP/1.0" 202 Accepted 2026-03-14 23:20:39,086 - lava_callback - INFO - Starting async job submit for node 69b34a3b6267e2e450f0397c 2026-03-14 23:20:39,086 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 23:20:39,113 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b34a3b6267e2e450f0397c HTTP/1.1" 200 None 2026-03-14 23:20:39,114 - lava_callback - DEBUG - Processing node 69b34a3b6267e2e450f0397c: baseline-arm64-baylibre 2026-03-14 23:20:39,114 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b34a3b6267e2e450f0397c 2026-03-14 23:20:39,115 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 23:20:39,128 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b34a3b6267e2e450f0397c HTTP/1.1" 200 None 2026-03-14 23:20:39,129 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 23:20:39,142 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ada1488fc97e5ba07d4d8d HTTP/1.1" 200 None 2026-03-14 23:20:39,143 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 23:20:39,163 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b34a3b6267e2e450f0397c HTTP/1.1" 200 None 2026-03-14 23:20:39,164 - lava_callback - ERROR - Error processing callback for node 69b34a3b6267e2e450f0397c: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:55884 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51908 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51914 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43786 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43478 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:43486 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46054 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37882 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40590 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38088 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38096 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42944 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44202 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:44206 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45302 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57246 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48922 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47988 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48000 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55892 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36906 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:36916 - "GET / HTTP/1.0" 200 OK 2026-03-14 23:23:18,987 - lava_callback - INFO - Received callback for node 69b34ad26267e2e450f039ba INFO: 172.21.0.1:36920 - "POST /node/69b34ad26267e2e450f039ba HTTP/1.0" 202 Accepted 2026-03-14 23:23:18,993 - lava_callback - INFO - Starting async job submit for node 69b34ad26267e2e450f039ba 2026-03-14 23:23:18,994 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 23:23:19,008 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b34ad26267e2e450f039ba HTTP/1.1" 200 None 2026-03-14 23:23:19,009 - lava_callback - DEBUG - Processing node 69b34ad26267e2e450f039ba: baseline-arm64-baylibre 2026-03-14 23:23:19,009 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b34ad26267e2e450f039ba 2026-03-14 23:23:19,010 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 23:23:19,030 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b34ad26267e2e450f039ba HTTP/1.1" 200 None 2026-03-14 23:23:19,032 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 23:23:19,045 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ada1488fc97e5ba07d4d8d HTTP/1.1" 200 None 2026-03-14 23:23:19,046 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 23:23:19,078 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b34ad26267e2e450f039ba HTTP/1.1" 200 None 2026-03-14 23:23:19,079 - lava_callback - ERROR - Error processing callback for node 69b34ad26267e2e450f039ba: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:43572 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50264 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54920 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45748 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45762 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46594 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60950 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:60958 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57346 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52270 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40294 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57352 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57356 - "GET / HTTP/1.0" 200 OK 2026-03-14 23:24:59,095 - lava_callback - INFO - Received callback for node 69b34b466267e2e450f039d8 INFO: 172.21.0.1:57362 - "POST /node/69b34b466267e2e450f039d8 HTTP/1.0" 202 Accepted 2026-03-14 23:24:59,100 - lava_callback - INFO - Starting async job submit for node 69b34b466267e2e450f039d8 2026-03-14 23:24:59,101 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 23:24:59,121 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b34b466267e2e450f039d8 HTTP/1.1" 200 None 2026-03-14 23:24:59,121 - lava_callback - DEBUG - Processing node 69b34b466267e2e450f039d8: baseline-arm64-baylibre 2026-03-14 23:24:59,122 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b34b466267e2e450f039d8 2026-03-14 23:24:59,122 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 23:24:59,136 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b34b466267e2e450f039d8 HTTP/1.1" 200 None 2026-03-14 23:24:59,137 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 23:24:59,151 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ada1488fc97e5ba07d4d8d HTTP/1.1" 200 None 2026-03-14 23:24:59,153 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 23:24:59,181 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b34b466267e2e450f039d8 HTTP/1.1" 200 None 2026-03-14 23:24:59,184 - lava_callback - ERROR - Error processing callback for node 69b34b466267e2e450f039d8: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:41324 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60576 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:60590 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57320 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49540 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47038 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45052 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45058 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37382 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58732 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:58746 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33942 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50062 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47824 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40260 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40274 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52534 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55310 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:55326 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42826 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45172 - "GET / HTTP/1.0" 200 OK 2026-03-14 23:27:39,383 - lava_callback - INFO - Received callback for node 69b34bdb6267e2e450f039ff INFO: 172.21.0.1:45178 - "POST /node/69b34bdb6267e2e450f039ff HTTP/1.0" 202 Accepted 2026-03-14 23:27:39,388 - lava_callback - INFO - Starting async job submit for node 69b34bdb6267e2e450f039ff 2026-03-14 23:27:39,389 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 23:27:39,404 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b34bdb6267e2e450f039ff HTTP/1.1" 200 None 2026-03-14 23:27:39,405 - lava_callback - DEBUG - Processing node 69b34bdb6267e2e450f039ff: baseline-arm64-baylibre 2026-03-14 23:27:39,405 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b34bdb6267e2e450f039ff 2026-03-14 23:27:39,405 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 23:27:39,419 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b34bdb6267e2e450f039ff HTTP/1.1" 200 None 2026-03-14 23:27:39,421 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 23:27:39,439 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ada1488fc97e5ba07d4d8d HTTP/1.1" 200 None 2026-03-14 23:27:39,441 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 23:27:39,471 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b34bdb6267e2e450f039ff HTTP/1.1" 200 None 2026-03-14 23:27:39,476 - lava_callback - ERROR - Error processing callback for node 69b34bdb6267e2e450f039ff: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:46648 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46106 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46112 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46104 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57180 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:57186 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51720 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56762 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51646 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55180 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55192 - "GET / HTTP/1.0" 200 OK 2026-03-14 23:28:59,309 - lava_callback - INFO - Received callback for node 69b34c2c6267e2e450f03a16 INFO: 172.21.0.1:55206 - "POST /node/69b34c2c6267e2e450f03a16 HTTP/1.0" 202 Accepted 2026-03-14 23:28:59,316 - lava_callback - INFO - Starting async job submit for node 69b34c2c6267e2e450f03a16 2026-03-14 23:28:59,317 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 23:28:59,343 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b34c2c6267e2e450f03a16 HTTP/1.1" 200 None 2026-03-14 23:28:59,343 - lava_callback - DEBUG - Processing node 69b34c2c6267e2e450f03a16: baseline-arm64-baylibre 2026-03-14 23:28:59,344 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b34c2c6267e2e450f03a16 2026-03-14 23:28:59,344 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 23:28:59,357 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b34c2c6267e2e450f03a16 HTTP/1.1" 200 None 2026-03-14 23:28:59,359 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 23:28:59,383 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ada1488fc97e5ba07d4d8d HTTP/1.1" 200 None 2026-03-14 23:28:59,385 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 23:28:59,411 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b34c2c6267e2e450f03a16 HTTP/1.1" 200 None 2026-03-14 23:28:59,413 - lava_callback - ERROR - Error processing callback for node 69b34c2c6267e2e450f03a16: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:52944 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45718 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:45728 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43518 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38930 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38500 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44284 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44298 - "GET / HTTP/1.0" 200 OK 2026-03-14 23:30:05,208 - lava_callback - INFO - Received callback for node 69b34c756267e2e450f03a31 INFO: 172.21.0.1:47858 - "POST /node/69b34c756267e2e450f03a31 HTTP/1.0" 202 Accepted 2026-03-14 23:30:05,214 - lava_callback - INFO - Starting async job submit for node 69b34c756267e2e450f03a31 2026-03-14 23:30:05,215 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 23:30:05,258 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b34c756267e2e450f03a31 HTTP/1.1" 200 None 2026-03-14 23:30:05,259 - lava_callback - DEBUG - Processing node 69b34c756267e2e450f03a31: baseline-arm-clabbe 2026-03-14 23:30:05,259 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b34c756267e2e450f03a31 2026-03-14 23:30:05,260 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 23:30:05,284 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b34c756267e2e450f03a31 HTTP/1.1" 200 None 2026-03-14 23:30:05,286 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 23:30:05,307 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ada13b8fc97e5ba07d4d75 HTTP/1.1" 200 None 2026-03-14 23:30:05,308 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 23:30:05,365 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b34c756267e2e450f03a31 HTTP/1.1" 200 None 2026-03-14 23:30:05,367 - lava_callback - ERROR - Error processing callback for node 69b34c756267e2e450f03a31: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:47870 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53702 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:53712 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57906 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58724 - "GET / HTTP/1.0" 200 OK 2026-03-14 23:30:44,961 - lava_callback - INFO - Received callback for node 69b34c996267e2e450f03a4d INFO: 172.21.0.1:58638 - "POST /node/69b34c996267e2e450f03a4d HTTP/1.0" 202 Accepted 2026-03-14 23:30:44,966 - lava_callback - INFO - Starting async job submit for node 69b34c996267e2e450f03a4d 2026-03-14 23:30:44,967 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 23:30:45,004 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b34c996267e2e450f03a4d HTTP/1.1" 200 None 2026-03-14 23:30:45,005 - lava_callback - DEBUG - Processing node 69b34c996267e2e450f03a4d: baseline-arm-clabbe 2026-03-14 23:30:45,005 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b34c996267e2e450f03a4d 2026-03-14 23:30:45,006 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 23:30:45,021 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b34c996267e2e450f03a4d HTTP/1.1" 200 None 2026-03-14 23:30:45,023 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 23:30:45,036 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ada13b8fc97e5ba07d4d75 HTTP/1.1" 200 None 2026-03-14 23:30:45,038 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 23:30:45,059 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b34c996267e2e450f03a4d HTTP/1.1" 200 None 2026-03-14 23:30:45,060 - lava_callback - ERROR - Error processing callback for node 69b34c996267e2e450f03a4d: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:58648 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53200 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53210 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43774 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46492 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:46498 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39940 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50998 - "GET / HTTP/1.0" 200 OK 2026-03-14 23:31:45,037 - lava_callback - INFO - Received callback for node 69b34ccc6267e2e450f03a5e INFO: 172.21.0.1:37832 - "POST /node/69b34ccc6267e2e450f03a5e HTTP/1.0" 202 Accepted 2026-03-14 23:31:45,042 - lava_callback - INFO - Starting async job submit for node 69b34ccc6267e2e450f03a5e 2026-03-14 23:31:45,043 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 23:31:45,064 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b34ccc6267e2e450f03a5e HTTP/1.1" 200 None 2026-03-14 23:31:45,065 - lava_callback - DEBUG - Processing node 69b34ccc6267e2e450f03a5e: baseline-arm64-clabbe 2026-03-14 23:31:45,065 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b34ccc6267e2e450f03a5e 2026-03-14 23:31:45,066 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 23:31:45,079 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b34ccc6267e2e450f03a5e HTTP/1.1" 200 None 2026-03-14 23:31:45,081 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 23:31:45,093 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ada1488fc97e5ba07d4d8d HTTP/1.1" 200 None 2026-03-14 23:31:45,095 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 23:31:45,117 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b34ccc6267e2e450f03a5e HTTP/1.1" 200 None 2026-03-14 23:31:45,123 - lava_callback - ERROR - Error processing callback for node 69b34ccc6267e2e450f03a5e: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:37846 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40258 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40268 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59604 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48980 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:48994 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41542 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60884 - "GET / HTTP/1.0" 200 OK 2026-03-14 23:32:45,084 - lava_callback - INFO - Received callback for node 69b34d0f6267e2e450f03a76 INFO: 172.21.0.1:60358 - "POST /node/69b34d0f6267e2e450f03a76 HTTP/1.0" 202 Accepted 2026-03-14 23:32:45,089 - lava_callback - INFO - Starting async job submit for node 69b34d0f6267e2e450f03a76 2026-03-14 23:32:45,090 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 23:32:45,143 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b34d0f6267e2e450f03a76 HTTP/1.1" 200 None 2026-03-14 23:32:45,143 - lava_callback - DEBUG - Processing node 69b34d0f6267e2e450f03a76: baseline-arm-clabbe 2026-03-14 23:32:45,144 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b34d0f6267e2e450f03a76 2026-03-14 23:32:45,144 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 23:32:45,188 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b34d0f6267e2e450f03a76 HTTP/1.1" 200 None 2026-03-14 23:32:45,190 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 23:32:45,226 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ada13b8fc97e5ba07d4d75 HTTP/1.1" 200 None 2026-03-14 23:32:45,228 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 23:32:45,275 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b34d0f6267e2e450f03a76 HTTP/1.1" 200 None 2026-03-14 23:32:45,276 - lava_callback - ERROR - Error processing callback for node 69b34d0f6267e2e450f03a76: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:60364 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43694 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43702 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51150 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60174 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:60176 - "GET / HTTP/1.0" 200 OK 2026-03-14 23:33:25,098 - lava_callback - INFO - Received callback for node 69b34d336267e2e450f03a90 INFO: 172.21.0.1:52584 - "POST /node/69b34d336267e2e450f03a90 HTTP/1.0" 202 Accepted 2026-03-14 23:33:25,103 - lava_callback - INFO - Starting async job submit for node 69b34d336267e2e450f03a90 2026-03-14 23:33:25,104 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 23:33:25,131 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b34d336267e2e450f03a90 HTTP/1.1" 200 None 2026-03-14 23:33:25,132 - lava_callback - DEBUG - Processing node 69b34d336267e2e450f03a90: baseline-arm-clabbe 2026-03-14 23:33:25,132 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b34d336267e2e450f03a90 2026-03-14 23:33:25,133 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 23:33:25,147 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b34d336267e2e450f03a90 HTTP/1.1" 200 None 2026-03-14 23:33:25,149 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 23:33:25,175 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ada13b8fc97e5ba07d4d75 HTTP/1.1" 200 None 2026-03-14 23:33:25,176 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 23:33:25,198 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b34d336267e2e450f03a90 HTTP/1.1" 200 None 2026-03-14 23:33:25,200 - lava_callback - ERROR - Error processing callback for node 69b34d336267e2e450f03a90: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:52592 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34172 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46360 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54652 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54658 - "GET / HTTP/1.0" 200 OK 2026-03-14 23:34:05,167 - lava_callback - INFO - Received callback for node 69b34d666267e2e450f03aa3 INFO: 172.21.0.1:40394 - "POST /node/69b34d666267e2e450f03aa3 HTTP/1.0" 202 Accepted 2026-03-14 23:34:05,172 - lava_callback - INFO - Starting async job submit for node 69b34d666267e2e450f03aa3 2026-03-14 23:34:05,173 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 23:34:05,326 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b34d666267e2e450f03aa3 HTTP/1.1" 200 None 2026-03-14 23:34:05,327 - lava_callback - DEBUG - Processing node 69b34d666267e2e450f03aa3: baseline-arm64-clabbe 2026-03-14 23:34:05,328 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b34d666267e2e450f03aa3 2026-03-14 23:34:05,328 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 23:34:05,341 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b34d666267e2e450f03aa3 HTTP/1.1" 200 None 2026-03-14 23:34:05,343 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 23:34:05,356 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ada1488fc97e5ba07d4d8d HTTP/1.1" 200 None 2026-03-14 23:34:05,358 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 23:34:05,401 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b34d666267e2e450f03aa3 HTTP/1.1" 200 None 2026-03-14 23:34:05,403 - lava_callback - ERROR - Error processing callback for node 69b34d666267e2e450f03aa3: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:40400 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54484 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:54500 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35916 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52894 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54806 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34176 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34178 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53974 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54564 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:54566 - "GET / HTTP/1.0" 200 OK 2026-03-14 23:35:25,204 - lava_callback - INFO - Received callback for node 69b34da76267e2e450f03ab5 INFO: 172.21.0.1:41546 - "POST /node/69b34da76267e2e450f03ab5 HTTP/1.0" 202 Accepted 2026-03-14 23:35:25,209 - lava_callback - INFO - Starting async job submit for node 69b34da76267e2e450f03ab5 2026-03-14 23:35:25,210 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 23:35:25,241 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b34da76267e2e450f03ab5 HTTP/1.1" 200 None 2026-03-14 23:35:25,242 - lava_callback - DEBUG - Processing node 69b34da76267e2e450f03ab5: baseline-arm-clabbe 2026-03-14 23:35:25,242 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b34da76267e2e450f03ab5 2026-03-14 23:35:25,242 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 23:35:25,255 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b34da76267e2e450f03ab5 HTTP/1.1" 200 None 2026-03-14 23:35:25,257 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 23:35:25,280 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ada13b8fc97e5ba07d4d75 HTTP/1.1" 200 None 2026-03-14 23:35:25,281 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 23:35:25,301 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b34da76267e2e450f03ab5 HTTP/1.1" 200 None 2026-03-14 23:35:25,308 - lava_callback - ERROR - Error processing callback for node 69b34da76267e2e450f03ab5: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:41548 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37058 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49018 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56326 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56336 - "GET / HTTP/1.0" 200 OK 2026-03-14 23:36:05,173 - lava_callback - INFO - Received callback for node 69b34dda6267e2e450f03ac7 INFO: 172.21.0.1:55448 - "POST /node/69b34dda6267e2e450f03ac7 HTTP/1.0" 202 Accepted 2026-03-14 23:36:05,179 - lava_callback - INFO - Starting async job submit for node 69b34dda6267e2e450f03ac7 2026-03-14 23:36:05,180 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 23:36:05,199 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b34dda6267e2e450f03ac7 HTTP/1.1" 200 None 2026-03-14 23:36:05,199 - lava_callback - DEBUG - Processing node 69b34dda6267e2e450f03ac7: baseline-arm64-clabbe 2026-03-14 23:36:05,200 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b34dda6267e2e450f03ac7 2026-03-14 23:36:05,200 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 23:36:05,222 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b34dda6267e2e450f03ac7 HTTP/1.1" 200 None 2026-03-14 23:36:05,223 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 23:36:05,256 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ada1488fc97e5ba07d4d8d HTTP/1.1" 200 None 2026-03-14 23:36:05,257 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 23:36:05,278 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b34dda6267e2e450f03ac7 HTTP/1.1" 200 None 2026-03-14 23:36:05,283 - lava_callback - ERROR - Error processing callback for node 69b34dda6267e2e450f03ac7: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:55456 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56344 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:56356 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45472 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42558 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51560 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48044 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48050 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46984 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53454 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:53458 - "GET / HTTP/1.0" 200 OK 2026-03-14 23:37:25,224 - lava_callback - INFO - Received callback for node 69b34e2a6267e2e450f03ade INFO: 172.21.0.1:39214 - "POST /node/69b34e2a6267e2e450f03ade HTTP/1.0" 202 Accepted 2026-03-14 23:37:25,229 - lava_callback - INFO - Starting async job submit for node 69b34e2a6267e2e450f03ade 2026-03-14 23:37:25,230 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 23:37:25,265 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b34e2a6267e2e450f03ade HTTP/1.1" 200 None 2026-03-14 23:37:25,266 - lava_callback - DEBUG - Processing node 69b34e2a6267e2e450f03ade: baseline-arm64-clabbe 2026-03-14 23:37:25,266 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b34e2a6267e2e450f03ade 2026-03-14 23:37:25,267 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 23:37:25,281 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b34e2a6267e2e450f03ade HTTP/1.1" 200 None 2026-03-14 23:37:25,282 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 23:37:25,295 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ada1488fc97e5ba07d4d8d HTTP/1.1" 200 None 2026-03-14 23:37:25,297 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 23:37:25,352 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b34e2a6267e2e450f03ade HTTP/1.1" 200 None 2026-03-14 23:37:25,359 - lava_callback - ERROR - Error processing callback for node 69b34e2a6267e2e450f03ade: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:39226 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49304 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45064 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57640 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57646 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51398 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34534 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:34546 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59798 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39292 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58608 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36242 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36248 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35200 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45940 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:45942 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34250 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35226 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46058 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50738 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50740 - "GET / HTTP/1.0" 200 OK 2026-03-14 23:40:05,502 - lava_callback - INFO - Received callback for node 69b34ecd6267e2e450f03af2 INFO: 172.21.0.1:57764 - "POST /node/69b34ecd6267e2e450f03af2 HTTP/1.0" 202 Accepted 2026-03-14 23:40:05,507 - lava_callback - INFO - Starting async job submit for node 69b34ecd6267e2e450f03af2 2026-03-14 23:40:05,508 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 23:40:05,532 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b34ecd6267e2e450f03af2 HTTP/1.1" 200 None 2026-03-14 23:40:05,533 - lava_callback - DEBUG - Processing node 69b34ecd6267e2e450f03af2: baseline-arm64-clabbe 2026-03-14 23:40:05,533 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b34ecd6267e2e450f03af2 2026-03-14 23:40:05,534 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 23:40:05,547 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b34ecd6267e2e450f03af2 HTTP/1.1" 200 None 2026-03-14 23:40:05,548 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 23:40:05,562 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ada1488fc97e5ba07d4d8d HTTP/1.1" 200 None 2026-03-14 23:40:05,563 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 23:40:05,584 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b34ecd6267e2e450f03af2 HTTP/1.1" 200 None 2026-03-14 23:40:05,586 - lava_callback - ERROR - Error processing callback for node 69b34ecd6267e2e450f03af2: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:57780 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57636 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:57640 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49774 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59900 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37040 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49242 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49248 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55066 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60904 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:60916 - "GET / HTTP/1.0" 200 OK 2026-03-14 23:41:25,444 - lava_callback - INFO - Received callback for node 69b34f1f6267e2e450f03b06 INFO: 172.21.0.1:38990 - "POST /node/69b34f1f6267e2e450f03b06 HTTP/1.0" 202 Accepted 2026-03-14 23:41:25,450 - lava_callback - INFO - Starting async job submit for node 69b34f1f6267e2e450f03b06 2026-03-14 23:41:25,450 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 23:41:25,465 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b34f1f6267e2e450f03b06 HTTP/1.1" 200 None 2026-03-14 23:41:25,465 - lava_callback - DEBUG - Processing node 69b34f1f6267e2e450f03b06: baseline-arm64-clabbe 2026-03-14 23:41:25,466 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b34f1f6267e2e450f03b06 2026-03-14 23:41:25,466 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 23:41:25,479 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b34f1f6267e2e450f03b06 HTTP/1.1" 200 None 2026-03-14 23:41:25,480 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 23:41:25,494 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ada1488fc97e5ba07d4d8d HTTP/1.1" 200 None 2026-03-14 23:41:25,496 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 23:41:25,523 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b34f1f6267e2e450f03b06 HTTP/1.1" 200 None 2026-03-14 23:41:25,526 - lava_callback - ERROR - Error processing callback for node 69b34f1f6267e2e450f03b06: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:39006 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36360 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52272 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58952 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58956 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53028 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52234 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:52240 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58020 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51928 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58604 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51068 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51070 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54228 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55648 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:55660 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33944 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34888 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49220 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44130 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44138 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55572 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36266 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:36276 - "GET / HTTP/1.0" 200 OK 2026-03-14 23:44:25,548 - lava_callback - INFO - Received callback for node 69b34fcb6267e2e450f03b25 INFO: 172.21.0.1:38476 - "POST /node/69b34fcb6267e2e450f03b25 HTTP/1.0" 202 Accepted 2026-03-14 23:44:25,554 - lava_callback - INFO - Starting async job submit for node 69b34fcb6267e2e450f03b25 2026-03-14 23:44:25,554 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 23:44:25,578 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b34fcb6267e2e450f03b25 HTTP/1.1" 200 None 2026-03-14 23:44:25,579 - lava_callback - DEBUG - Processing node 69b34fcb6267e2e450f03b25: baseline-arm64-clabbe 2026-03-14 23:44:25,579 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b34fcb6267e2e450f03b25 2026-03-14 23:44:25,580 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 23:44:25,608 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b34fcb6267e2e450f03b25 HTTP/1.1" 200 None 2026-03-14 23:44:25,610 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 23:44:25,634 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ada1488fc97e5ba07d4d8d HTTP/1.1" 200 None 2026-03-14 23:44:25,635 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 23:44:25,656 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b34fcb6267e2e450f03b25 HTTP/1.1" 200 None 2026-03-14 23:44:25,657 - lava_callback - ERROR - Error processing callback for node 69b34fcb6267e2e450f03b25: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:38478 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35524 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52520 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44528 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44542 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36924 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42274 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:42276 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59812 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33166 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33016 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40682 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40688 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58566 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48038 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:48040 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54300 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59438 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58310 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45560 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45570 - "GET / HTTP/1.0" 200 OK 2026-03-14 23:47:05,676 - lava_callback - INFO - Received callback for node 69b350706267e2e450f03b35 INFO: 172.21.0.1:42170 - "POST /node/69b350706267e2e450f03b35 HTTP/1.0" 202 Accepted 2026-03-14 23:47:05,682 - lava_callback - INFO - Starting async job submit for node 69b350706267e2e450f03b35 2026-03-14 23:47:05,683 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 23:47:05,699 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b350706267e2e450f03b35 HTTP/1.1" 200 None 2026-03-14 23:47:05,700 - lava_callback - DEBUG - Processing node 69b350706267e2e450f03b35: baseline-arm64-clabbe 2026-03-14 23:47:05,700 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b350706267e2e450f03b35 2026-03-14 23:47:05,701 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 23:47:05,747 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b350706267e2e450f03b35 HTTP/1.1" 200 None 2026-03-14 23:47:05,748 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 23:47:05,762 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ada1488fc97e5ba07d4d8d HTTP/1.1" 200 None 2026-03-14 23:47:05,764 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 23:47:05,809 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b350706267e2e450f03b35 HTTP/1.1" 200 None 2026-03-14 23:47:05,811 - lava_callback - ERROR - Error processing callback for node 69b350706267e2e450f03b35: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:42174 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39162 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:39176 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38488 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38580 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47572 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58108 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58122 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37894 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35630 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:35640 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46588 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44030 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37800 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57006 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57012 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48618 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41938 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:41940 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42094 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60668 - "GET / HTTP/1.0" 200 OK 2026-03-14 23:49:45,775 - lava_callback - INFO - Received callback for node 69b351156267e2e450f03b51 INFO: 172.21.0.1:34542 - "POST /node/69b351156267e2e450f03b51 HTTP/1.0" 202 Accepted 2026-03-14 23:49:45,780 - lava_callback - INFO - Starting async job submit for node 69b351156267e2e450f03b51 2026-03-14 23:49:45,781 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 23:49:45,812 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b351156267e2e450f03b51 HTTP/1.1" 200 None 2026-03-14 23:49:45,812 - lava_callback - DEBUG - Processing node 69b351156267e2e450f03b51: baseline-arm64-clabbe 2026-03-14 23:49:45,813 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b351156267e2e450f03b51 2026-03-14 23:49:45,813 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 23:49:45,968 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b351156267e2e450f03b51 HTTP/1.1" 200 None 2026-03-14 23:49:45,970 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 23:49:45,983 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ada1488fc97e5ba07d4d8d HTTP/1.1" 200 None 2026-03-14 23:49:45,984 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 23:49:46,004 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b351156267e2e450f03b51 HTTP/1.1" 200 None 2026-03-14 23:49:46,013 - lava_callback - ERROR - Error processing callback for node 69b351156267e2e450f03b51: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:34554 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34392 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34396 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58278 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39372 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:39380 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58724 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52968 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58092 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50342 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50350 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45966 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42438 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:42454 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48040 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49572 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41424 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59510 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59526 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35150 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35098 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:35106 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57908 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40600 - "GET / HTTP/1.0" 200 OK 2026-03-14 23:52:45,950 - lava_callback - INFO - Received callback for node 69b351b96267e2e450f03b83 INFO: 172.21.0.1:43486 - "POST /node/69b351b96267e2e450f03b83 HTTP/1.0" 202 Accepted 2026-03-14 23:52:45,956 - lava_callback - INFO - Starting async job submit for node 69b351b96267e2e450f03b83 2026-03-14 23:52:45,957 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 23:52:45,979 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b351b96267e2e450f03b83 HTTP/1.1" 200 None 2026-03-14 23:52:45,980 - lava_callback - DEBUG - Processing node 69b351b96267e2e450f03b83: baseline-arm64-clabbe 2026-03-14 23:52:45,980 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b351b96267e2e450f03b83 2026-03-14 23:52:45,981 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 23:52:45,994 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b351b96267e2e450f03b83 HTTP/1.1" 200 None 2026-03-14 23:52:45,995 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 23:52:46,011 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ada1488fc97e5ba07d4d8d HTTP/1.1" 200 None 2026-03-14 23:52:46,012 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 23:52:46,032 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b351b96267e2e450f03b83 HTTP/1.1" 200 None 2026-03-14 23:52:46,041 - lava_callback - ERROR - Error processing callback for node 69b351b96267e2e450f03b83: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:43492 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56936 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56952 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55882 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39800 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:39804 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58748 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58988 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60204 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40958 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40974 - "GET / HTTP/1.0" 200 OK 2026-03-14 23:54:00,651 - lava_callback - INFO - Received callback for node 69b352056267e2e450f03b92 INFO: 172.21.0.1:38752 - "POST /node/69b352056267e2e450f03b92 HTTP/1.0" 202 Accepted 2026-03-14 23:54:00,657 - lava_callback - INFO - Starting async job submit for node 69b352056267e2e450f03b92 2026-03-14 23:54:00,658 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 23:54:00,673 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b352056267e2e450f03b92 HTTP/1.1" 200 None 2026-03-14 23:54:00,674 - lava_callback - DEBUG - Processing node 69b352056267e2e450f03b92: baseline-arm64-baylibre 2026-03-14 23:54:00,674 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b352056267e2e450f03b92 2026-03-14 23:54:00,674 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 23:54:00,690 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b352056267e2e450f03b92 HTTP/1.1" 200 None 2026-03-14 23:54:00,692 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 23:54:00,706 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ada1488fc97e5ba07d4d8d HTTP/1.1" 200 None 2026-03-14 23:54:00,707 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 23:54:00,731 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b352056267e2e450f03b92 HTTP/1.1" 200 None 2026-03-14 23:54:00,732 - lava_callback - ERROR - Error processing callback for node 69b352056267e2e450f03b92: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:38760 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44156 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:44168 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44852 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49882 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33198 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49330 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49338 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33404 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47336 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:47342 - "GET / HTTP/1.0" 200 OK 2026-03-14 23:55:26,114 - lava_callback - INFO - Received callback for node 69b3525d6267e2e450f03ba7 INFO: 172.21.0.1:57872 - "POST /node/69b3525d6267e2e450f03ba7 HTTP/1.0" 202 Accepted 2026-03-14 23:55:26,119 - lava_callback - INFO - Starting async job submit for node 69b3525d6267e2e450f03ba7 2026-03-14 23:55:26,120 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 23:55:26,134 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b3525d6267e2e450f03ba7 HTTP/1.1" 200 None 2026-03-14 23:55:26,135 - lava_callback - DEBUG - Processing node 69b3525d6267e2e450f03ba7: baseline-arm64-clabbe 2026-03-14 23:55:26,135 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b3525d6267e2e450f03ba7 2026-03-14 23:55:26,136 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 23:55:26,148 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b3525d6267e2e450f03ba7 HTTP/1.1" 200 None 2026-03-14 23:55:26,150 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 23:55:26,164 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ada1488fc97e5ba07d4d8d HTTP/1.1" 200 None 2026-03-14 23:55:26,166 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 23:55:26,196 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b3525d6267e2e450f03ba7 HTTP/1.1" 200 None 2026-03-14 23:55:26,220 - lava_callback - ERROR - Error processing callback for node 69b3525d6267e2e450f03ba7: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:57884 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60004 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57406 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59640 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59654 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41392 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60584 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:60594 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39832 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60142 - "GET / HTTP/1.0" 200 OK 2026-03-14 23:56:46,177 - lava_callback - INFO - Received callback for node 69b352b06267e2e450f03bac INFO: 172.21.0.1:51854 - "POST /node/69b352b06267e2e450f03bac HTTP/1.0" 202 Accepted 2026-03-14 23:56:46,183 - lava_callback - INFO - Starting async job submit for node 69b352b06267e2e450f03bac 2026-03-14 23:56:46,184 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 23:56:46,200 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b352b06267e2e450f03bac HTTP/1.1" 200 None 2026-03-14 23:56:46,201 - lava_callback - DEBUG - Processing node 69b352b06267e2e450f03bac: baseline-arm64-clabbe 2026-03-14 23:56:46,201 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b352b06267e2e450f03bac 2026-03-14 23:56:46,202 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 23:56:46,215 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b352b06267e2e450f03bac HTTP/1.1" 200 None 2026-03-14 23:56:46,216 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 23:56:46,230 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ada1488fc97e5ba07d4d8d HTTP/1.1" 200 None 2026-03-14 23:56:46,231 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 23:56:46,270 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b352b06267e2e450f03bac HTTP/1.1" 200 None 2026-03-14 23:56:46,276 - lava_callback - ERROR - Error processing callback for node 69b352b06267e2e450f03bac: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:51860 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55270 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55274 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60160 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35452 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:35458 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46950 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58244 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46028 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42288 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42296 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36432 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44078 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:44080 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57312 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57466 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45548 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35818 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35820 - "GET / HTTP/1.0" 200 OK 2026-03-14 23:59:06,129 - lava_callback - INFO - Received callback for node 69b353406267e2e450f03bc3 INFO: 172.21.0.1:41640 - "POST /node/69b353406267e2e450f03bc3 HTTP/1.0" 202 Accepted 2026-03-14 23:59:06,135 - lava_callback - INFO - Starting async job submit for node 69b353406267e2e450f03bc3 2026-03-14 23:59:06,136 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 23:59:06,158 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b353406267e2e450f03bc3 HTTP/1.1" 200 None 2026-03-14 23:59:06,159 - lava_callback - DEBUG - Processing node 69b353406267e2e450f03bc3: baseline-arm64-clabbe 2026-03-14 23:59:06,160 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b353406267e2e450f03bc3 2026-03-14 23:59:06,160 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 23:59:06,210 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b353406267e2e450f03bc3 HTTP/1.1" 200 None 2026-03-14 23:59:06,212 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 23:59:06,243 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ada1488fc97e5ba07d4d8d HTTP/1.1" 200 None 2026-03-14 23:59:06,245 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-14 23:59:06,288 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b353406267e2e450f03bc3 HTTP/1.1" 200 None 2026-03-14 23:59:06,297 - lava_callback - ERROR - Error processing callback for node 69b353406267e2e450f03bc3: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:41642 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33204 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:33210 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40038 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33888 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33420 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46082 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46090 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60592 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50814 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:50816 - "GET / HTTP/1.0" 200 OK 2026-03-15 00:00:26,290 - lava_callback - INFO - Received callback for node 69b353976267e2e450f03bd0 INFO: 172.21.0.1:37524 - "POST /node/69b353976267e2e450f03bd0 HTTP/1.0" 202 Accepted 2026-03-15 00:00:26,297 - lava_callback - INFO - Starting async job submit for node 69b353976267e2e450f03bd0 2026-03-15 00:00:26,298 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 00:00:26,349 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b353976267e2e450f03bd0 HTTP/1.1" 200 None 2026-03-15 00:00:26,350 - lava_callback - DEBUG - Processing node 69b353976267e2e450f03bd0: baseline-arm64-clabbe 2026-03-15 00:00:26,350 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b353976267e2e450f03bd0 2026-03-15 00:00:26,351 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 00:00:26,392 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b353976267e2e450f03bd0 HTTP/1.1" 200 None 2026-03-15 00:00:26,394 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 00:00:26,437 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ada1488fc97e5ba07d4d8d HTTP/1.1" 200 None 2026-03-15 00:00:26,439 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 00:00:26,483 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b353976267e2e450f03bd0 HTTP/1.1" 200 None 2026-03-15 00:00:26,485 - lava_callback - ERROR - Error processing callback for node 69b353976267e2e450f03bd0: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:37534 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60568 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52486 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45144 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45146 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33622 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41858 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:41874 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60628 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46172 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37056 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54168 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54170 - "GET / HTTP/1.0" 200 OK 2026-03-15 00:02:06,386 - lava_callback - INFO - Received callback for node 69b353eb6267e2e450f03be1 INFO: 172.21.0.1:33198 - "POST /node/69b353eb6267e2e450f03be1 HTTP/1.0" 202 Accepted 2026-03-15 00:02:06,392 - lava_callback - INFO - Starting async job submit for node 69b353eb6267e2e450f03be1 2026-03-15 00:02:06,393 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 00:02:06,434 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b353eb6267e2e450f03be1 HTTP/1.1" 200 None 2026-03-15 00:02:06,435 - lava_callback - DEBUG - Processing node 69b353eb6267e2e450f03be1: baseline-arm64-clabbe 2026-03-15 00:02:06,436 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b353eb6267e2e450f03be1 2026-03-15 00:02:06,436 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 00:02:06,452 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b353eb6267e2e450f03be1 HTTP/1.1" 200 None 2026-03-15 00:02:06,453 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 00:02:06,467 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ada1488fc97e5ba07d4d8d HTTP/1.1" 200 None 2026-03-15 00:02:06,468 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 INFO: 172.21.0.1:33210 - "GET / HTTP/1.0" 200 OK 2026-03-15 00:02:06,517 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b353eb6267e2e450f03be1 HTTP/1.1" 200 None 2026-03-15 00:02:06,518 - lava_callback - ERROR - Error processing callback for node 69b353eb6267e2e450f03be1: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:51884 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:51892 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43214 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38874 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48078 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48436 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48452 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53460 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53592 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:53594 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38092 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52228 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46956 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34168 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34170 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54566 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48432 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:48444 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33468 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39162 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34514 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58426 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58436 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48226 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37212 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:37228 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60806 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45362 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37306 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44200 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44204 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57510 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48582 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:48590 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43576 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:32998 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54760 - "GET / HTTP/1.0" 200 OK 2026-03-15 00:06:46,580 - lava_callback - INFO - Received callback for node 69b355126267e2e450f03c39 INFO: 172.21.0.1:54762 - "POST /node/69b355126267e2e450f03c39 HTTP/1.0" 202 Accepted 2026-03-15 00:06:46,586 - lava_callback - INFO - Starting async job submit for node 69b355126267e2e450f03c39 2026-03-15 00:06:46,586 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 00:06:46,608 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b355126267e2e450f03c39 HTTP/1.1" 200 None 2026-03-15 00:06:46,609 - lava_callback - DEBUG - Processing node 69b355126267e2e450f03c39: baseline-arm-clabbe 2026-03-15 00:06:46,609 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b355126267e2e450f03c39 2026-03-15 00:06:46,610 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 00:06:46,635 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b355126267e2e450f03c39 HTTP/1.1" 200 None 2026-03-15 00:06:46,636 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 00:06:46,663 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b2e72a6267e2e450f0211d HTTP/1.1" 200 None 2026-03-15 00:06:46,665 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 00:06:46,697 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b355126267e2e450f03c39 HTTP/1.1" 200 None 2026-03-15 00:06:46,703 - lava_callback - ERROR - Error processing callback for node 69b355126267e2e450f03c39: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:52166 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52180 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48076 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33824 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:33828 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40720 - "GET / HTTP/1.0" 200 OK 2026-03-15 00:07:26,512 - lava_callback - INFO - Received callback for node 69b3553a6267e2e450f03c42 INFO: 172.21.0.1:40736 - "POST /node/69b3553a6267e2e450f03c42 HTTP/1.0" 202 Accepted 2026-03-15 00:07:26,517 - lava_callback - INFO - Starting async job submit for node 69b3553a6267e2e450f03c42 2026-03-15 00:07:26,518 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 00:07:26,538 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b3553a6267e2e450f03c42 HTTP/1.1" 200 None 2026-03-15 00:07:26,539 - lava_callback - DEBUG - Processing node 69b3553a6267e2e450f03c42: baseline-arm-clabbe 2026-03-15 00:07:26,539 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b3553a6267e2e450f03c42 2026-03-15 00:07:26,539 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 00:07:26,556 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b3553a6267e2e450f03c42 HTTP/1.1" 200 None 2026-03-15 00:07:26,558 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 00:07:26,571 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b2e72a6267e2e450f0211d HTTP/1.1" 200 None 2026-03-15 00:07:26,573 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 00:07:26,593 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b3553a6267e2e450f03c42 HTTP/1.1" 200 None 2026-03-15 00:07:26,595 - lava_callback - ERROR - Error processing callback for node 69b3553a6267e2e450f03c42: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:58768 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56248 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50690 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50704 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47442 - "GET / HTTP/1.0" 200 OK 2026-03-15 00:08:06,586 - lava_callback - INFO - Received callback for node 69b355636267e2e450f03c50 INFO: 172.21.0.1:47452 - "POST /node/69b355636267e2e450f03c50 HTTP/1.0" 202 Accepted 2026-03-15 00:08:06,591 - lava_callback - INFO - Starting async job submit for node 69b355636267e2e450f03c50 2026-03-15 00:08:06,592 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 00:08:06,606 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b355636267e2e450f03c50 HTTP/1.1" 200 None 2026-03-15 00:08:06,607 - lava_callback - DEBUG - Processing node 69b355636267e2e450f03c50: baseline-arm-clabbe 2026-03-15 00:08:06,608 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b355636267e2e450f03c50 2026-03-15 00:08:06,608 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 00:08:06,621 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b355636267e2e450f03c50 HTTP/1.1" 200 None 2026-03-15 00:08:06,622 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 00:08:06,635 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b2e72a6267e2e450f0211d HTTP/1.1" 200 None 2026-03-15 00:08:06,637 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 00:08:06,668 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b355636267e2e450f03c50 HTTP/1.1" 200 None 2026-03-15 00:08:06,670 - lava_callback - ERROR - Error processing callback for node 69b355636267e2e450f03c50: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:37682 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:37698 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58172 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35166 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36244 - "GET / HTTP/1.0" 200 OK 2026-03-15 00:08:46,583 - lava_callback - INFO - Received callback for node 69b3558b6267e2e450f03c62 INFO: 172.21.0.1:36252 - "POST /node/69b3558b6267e2e450f03c62 HTTP/1.0" 202 Accepted 2026-03-15 00:08:46,588 - lava_callback - INFO - Starting async job submit for node 69b3558b6267e2e450f03c62 2026-03-15 00:08:46,589 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 00:08:46,603 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b3558b6267e2e450f03c62 HTTP/1.1" 200 None 2026-03-15 00:08:46,604 - lava_callback - DEBUG - Processing node 69b3558b6267e2e450f03c62: baseline-arm-clabbe 2026-03-15 00:08:46,604 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b3558b6267e2e450f03c62 2026-03-15 00:08:46,605 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 00:08:46,618 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b3558b6267e2e450f03c62 HTTP/1.1" 200 None 2026-03-15 00:08:46,620 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 00:08:46,633 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b2e72a6267e2e450f0211d HTTP/1.1" 200 None 2026-03-15 00:08:46,635 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 00:08:46,658 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b3558b6267e2e450f03c62 HTTP/1.1" 200 None 2026-03-15 00:08:46,659 - lava_callback - ERROR - Error processing callback for node 69b3558b6267e2e450f03c62: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:57250 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57254 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56814 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33718 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:33728 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56508 - "GET / HTTP/1.0" 200 OK 2026-03-15 00:09:26,624 - lava_callback - INFO - Received callback for node 69b355b36267e2e450f03c6c INFO: 172.21.0.1:56522 - "POST /node/69b355b36267e2e450f03c6c HTTP/1.0" 202 Accepted 2026-03-15 00:09:26,630 - lava_callback - INFO - Starting async job submit for node 69b355b36267e2e450f03c6c 2026-03-15 00:09:26,631 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 00:09:26,648 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b355b36267e2e450f03c6c HTTP/1.1" 200 None 2026-03-15 00:09:26,649 - lava_callback - DEBUG - Processing node 69b355b36267e2e450f03c6c: baseline-arm-clabbe 2026-03-15 00:09:26,649 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b355b36267e2e450f03c6c 2026-03-15 00:09:26,650 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 00:09:26,666 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b355b36267e2e450f03c6c HTTP/1.1" 200 None 2026-03-15 00:09:26,668 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 00:09:26,681 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b2e72a6267e2e450f0211d HTTP/1.1" 200 None 2026-03-15 00:09:26,683 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 00:09:26,703 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b355b36267e2e450f03c6c HTTP/1.1" 200 None 2026-03-15 00:09:26,704 - lava_callback - ERROR - Error processing callback for node 69b355b36267e2e450f03c6c: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:60960 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47098 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38082 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38096 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52388 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58214 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:58230 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34812 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33590 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56504 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39224 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39232 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44226 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53406 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:53416 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57134 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57868 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56048 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51700 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51716 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53862 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51388 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:51392 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51464 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34718 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59542 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54518 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54530 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51880 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43438 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:43454 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45450 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58162 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58000 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44094 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44098 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48610 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33062 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:33070 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42530 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60712 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45148 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46566 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46572 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50638 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45552 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:45564 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45948 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56776 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53142 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38152 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38168 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51756 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47330 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:47338 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36354 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48014 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58082 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34154 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34162 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47886 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34558 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:34572 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33686 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38946 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56656 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47416 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47418 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48774 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33386 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:33394 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60572 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58268 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36206 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39144 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39158 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58510 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43476 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:43478 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33070 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59452 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33378 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41220 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41224 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40684 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59868 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:59878 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47260 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58294 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54884 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35254 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35260 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57562 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60442 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:60444 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40562 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54866 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39026 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35404 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35414 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45756 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58822 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:58830 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54526 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50730 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35506 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57374 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57380 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45370 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56078 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:56086 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56440 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40826 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57742 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57840 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57852 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57596 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42048 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:42064 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40156 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36370 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56460 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51904 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51918 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47048 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37200 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:37208 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56604 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59696 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53526 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56036 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56048 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50650 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46428 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:46432 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47408 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47266 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53360 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45752 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45766 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35952 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46790 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:46804 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51788 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35450 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55736 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47564 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47578 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40928 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33572 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:33578 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42062 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33018 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40650 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52178 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52182 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40298 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50670 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:50678 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56082 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40404 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46486 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59020 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59032 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42458 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59836 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:59846 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40572 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36876 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56938 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59514 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59518 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41398 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54058 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:54070 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36850 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54736 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56696 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37122 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37126 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40246 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45846 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:45852 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56506 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41102 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41266 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52198 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52212 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42266 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54696 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:54712 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40262 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45364 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53680 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40170 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40178 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46696 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58520 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:58536 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58194 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59736 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50402 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59120 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59132 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57436 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41656 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:41666 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42456 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59112 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59072 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45978 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45984 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33212 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42716 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:42720 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57900 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46630 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59716 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51762 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51764 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45124 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57508 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:57516 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45756 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37458 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34890 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39032 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39036 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55600 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40610 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:40618 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46484 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60988 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59662 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:32932 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:32938 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37372 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36648 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:36658 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33236 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60930 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44980 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47656 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47666 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59512 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39916 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:39918 - "GET / HTTP/1.0" 200 OK 2026-03-15 00:40:23,494 - lava_callback - INFO - Received callback for node 69b35ce9974c91e64560e88a INFO: 172.21.0.1:38038 - "POST /node/69b35ce9974c91e64560e88a HTTP/1.0" 202 Accepted 2026-03-15 00:40:23,500 - lava_callback - INFO - Starting async job submit for node 69b35ce9974c91e64560e88a 2026-03-15 00:40:23,501 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 00:40:23,538 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b35ce9974c91e64560e88a HTTP/1.1" 200 None 2026-03-15 00:40:23,539 - lava_callback - DEBUG - Processing node 69b35ce9974c91e64560e88a: baseline-arm-baylibre 2026-03-15 00:40:23,539 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b35ce9974c91e64560e88a 2026-03-15 00:40:23,540 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 00:40:23,553 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b35ce9974c91e64560e88a HTTP/1.1" 200 None 2026-03-15 00:40:23,554 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 00:40:23,567 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b0b4fc9d19175818251fd6 HTTP/1.1" 200 None 2026-03-15 00:40:23,569 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 00:40:23,590 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b35ce9974c91e64560e88a HTTP/1.1" 200 None 2026-03-15 00:40:23,591 - lava_callback - ERROR - Error processing callback for node 69b35ce9974c91e64560e88a: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:38054 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59646 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53536 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47716 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47724 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45170 - "GET / HTTP/1.0" 200 OK 2026-03-15 00:41:08,067 - lava_callback - INFO - Received callback for node 69b35d13974c91e64560e8a6 INFO: 172.21.0.1:45184 - "POST /node/69b35d13974c91e64560e8a6 HTTP/1.0" 202 Accepted 2026-03-15 00:41:08,072 - lava_callback - INFO - Starting async job submit for node 69b35d13974c91e64560e8a6 2026-03-15 00:41:08,073 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 00:41:08,096 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b35d13974c91e64560e8a6 HTTP/1.1" 200 None 2026-03-15 00:41:08,097 - lava_callback - DEBUG - Processing node 69b35d13974c91e64560e8a6: baseline-arm-clabbe 2026-03-15 00:41:08,097 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b35d13974c91e64560e8a6 2026-03-15 00:41:08,098 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 00:41:08,121 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b35d13974c91e64560e8a6 HTTP/1.1" 200 None 2026-03-15 00:41:08,123 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 00:41:08,158 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b0b4fc9d19175818251fd6 HTTP/1.1" 200 None 2026-03-15 00:41:08,160 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 00:41:08,187 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b35d13974c91e64560e8a6 HTTP/1.1" 200 None 2026-03-15 00:41:08,189 - lava_callback - ERROR - Error processing callback for node 69b35d13974c91e64560e8a6: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:39576 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:39590 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43932 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60106 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37900 - "GET / HTTP/1.0" 200 OK 2026-03-15 00:41:48,050 - lava_callback - INFO - Received callback for node 69b35d38974c91e64560e8b5 INFO: 172.21.0.1:37906 - "POST /node/69b35d38974c91e64560e8b5 HTTP/1.0" 202 Accepted 2026-03-15 00:41:48,055 - lava_callback - INFO - Starting async job submit for node 69b35d38974c91e64560e8b5 2026-03-15 00:41:48,056 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 00:41:48,071 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b35d38974c91e64560e8b5 HTTP/1.1" 200 None 2026-03-15 00:41:48,072 - lava_callback - DEBUG - Processing node 69b35d38974c91e64560e8b5: baseline-arm-clabbe 2026-03-15 00:41:48,072 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b35d38974c91e64560e8b5 2026-03-15 00:41:48,072 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 00:41:48,087 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b35d38974c91e64560e8b5 HTTP/1.1" 200 None 2026-03-15 00:41:48,089 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 00:41:48,106 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b0b4fc9d19175818251fd6 HTTP/1.1" 200 None 2026-03-15 00:41:48,107 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 00:41:48,128 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b35d38974c91e64560e8b5 HTTP/1.1" 200 None 2026-03-15 00:41:48,130 - lava_callback - ERROR - Error processing callback for node 69b35d38974c91e64560e8b5: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:43580 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43596 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33788 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49690 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:49706 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37648 - "GET / HTTP/1.0" 200 OK 2026-03-15 00:42:28,214 - lava_callback - INFO - Received callback for node 69b35d5e974c91e64560e8c5 INFO: 172.21.0.1:37662 - "POST /node/69b35d5e974c91e64560e8c5 HTTP/1.0" 202 Accepted 2026-03-15 00:42:28,219 - lava_callback - INFO - Starting async job submit for node 69b35d5e974c91e64560e8c5 2026-03-15 00:42:28,221 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 00:42:28,248 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b35d5e974c91e64560e8c5 HTTP/1.1" 200 None 2026-03-15 00:42:28,249 - lava_callback - DEBUG - Processing node 69b35d5e974c91e64560e8c5: baseline-arm-clabbe 2026-03-15 00:42:28,250 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b35d5e974c91e64560e8c5 2026-03-15 00:42:28,250 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 00:42:28,282 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b35d5e974c91e64560e8c5 HTTP/1.1" 200 None 2026-03-15 00:42:28,284 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 00:42:28,328 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b0b4fc9d19175818251fd6 HTTP/1.1" 200 None 2026-03-15 00:42:28,329 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 00:42:28,350 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b35d5e974c91e64560e8c5 HTTP/1.1" 200 None 2026-03-15 00:42:28,355 - lava_callback - ERROR - Error processing callback for node 69b35d5e974c91e64560e8c5: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:42920 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45968 - "GET / HTTP/1.0" 200 OK 2026-03-15 00:42:48,110 - lava_callback - INFO - Received callback for node 69b35d84974c91e64560e8da INFO: 172.21.0.1:45976 - "POST /node/69b35d84974c91e64560e8da HTTP/1.0" 202 Accepted 2026-03-15 00:42:48,116 - lava_callback - INFO - Starting async job submit for node 69b35d84974c91e64560e8da 2026-03-15 00:42:48,117 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 00:42:48,131 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b35d84974c91e64560e8da HTTP/1.1" 200 None 2026-03-15 00:42:48,132 - lava_callback - DEBUG - Processing node 69b35d84974c91e64560e8da: baseline-arm-clabbe 2026-03-15 00:42:48,132 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b35d84974c91e64560e8da 2026-03-15 00:42:48,132 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 00:42:48,146 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b35d84974c91e64560e8da HTTP/1.1" 200 None 2026-03-15 00:42:48,147 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 00:42:48,165 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b0b4fc9d19175818251fd6 HTTP/1.1" 200 None 2026-03-15 00:42:48,167 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 00:42:48,224 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b35d84974c91e64560e8da HTTP/1.1" 200 None 2026-03-15 00:42:48,244 - lava_callback - ERROR - Error processing callback for node 69b35d84974c91e64560e8da: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:33554 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33570 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44922 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35238 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:35248 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40128 - "GET / HTTP/1.0" 200 OK 2026-03-15 00:43:28,149 - lava_callback - INFO - Received callback for node 69b35da9974c91e64560e8e2 INFO: 172.21.0.1:40134 - "POST /node/69b35da9974c91e64560e8e2 HTTP/1.0" 202 Accepted 2026-03-15 00:43:28,155 - lava_callback - INFO - Starting async job submit for node 69b35da9974c91e64560e8e2 2026-03-15 00:43:28,156 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 00:43:28,178 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b35da9974c91e64560e8e2 HTTP/1.1" 200 None 2026-03-15 00:43:28,179 - lava_callback - DEBUG - Processing node 69b35da9974c91e64560e8e2: baseline-arm-clabbe 2026-03-15 00:43:28,179 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b35da9974c91e64560e8e2 2026-03-15 00:43:28,180 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 00:43:28,193 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b35da9974c91e64560e8e2 HTTP/1.1" 200 None 2026-03-15 00:43:28,195 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 00:43:28,214 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b0b4fc9d19175818251fd6 HTTP/1.1" 200 None 2026-03-15 00:43:28,216 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 00:43:28,236 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b35da9974c91e64560e8e2 HTTP/1.1" 200 None 2026-03-15 00:43:28,241 - lava_callback - ERROR - Error processing callback for node 69b35da9974c91e64560e8e2: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:58734 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45922 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46624 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46634 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50642 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46990 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:47006 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57978 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54538 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38130 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46538 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46540 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39710 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53500 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:53516 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60446 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36010 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44962 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56070 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56086 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54068 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47464 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:47470 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58522 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50080 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35882 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51578 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51586 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48246 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33250 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:33266 - "GET / HTTP/1.0" 200 OK 2026-03-15 00:47:23,778 - lava_callback - INFO - Received callback for node 69b35e8d974c91e64560e8ff INFO: 172.21.0.1:53634 - "POST /node/69b35e8d974c91e64560e8ff HTTP/1.0" 202 Accepted 2026-03-15 00:47:23,784 - lava_callback - INFO - Starting async job submit for node 69b35e8d974c91e64560e8ff 2026-03-15 00:47:23,785 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 00:47:23,802 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b35e8d974c91e64560e8ff HTTP/1.1" 200 None 2026-03-15 00:47:23,803 - lava_callback - DEBUG - Processing node 69b35e8d974c91e64560e8ff: baseline-arm-baylibre 2026-03-15 00:47:23,803 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b35e8d974c91e64560e8ff 2026-03-15 00:47:23,804 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 00:47:23,828 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b35e8d974c91e64560e8ff HTTP/1.1" 200 None 2026-03-15 00:47:23,829 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 00:47:23,843 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ae11668ef4424e487b2ea2 HTTP/1.1" 200 None 2026-03-15 00:47:23,844 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 00:47:23,887 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b35e8d974c91e64560e8ff HTTP/1.1" 200 None 2026-03-15 00:47:23,894 - lava_callback - ERROR - Error processing callback for node 69b35e8d974c91e64560e8ff: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' 2026-03-15 00:47:24,458 - lava_callback - INFO - Received callback for node 69b35e94974c91e64560e924 INFO: 172.21.0.1:53648 - "POST /node/69b35e94974c91e64560e924 HTTP/1.0" 202 Accepted 2026-03-15 00:47:24,463 - lava_callback - INFO - Starting async job submit for node 69b35e94974c91e64560e924 2026-03-15 00:47:24,464 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 00:47:24,482 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b35e94974c91e64560e924 HTTP/1.1" 200 None 2026-03-15 00:47:24,483 - lava_callback - DEBUG - Processing node 69b35e94974c91e64560e924: baseline-arm-baylibre 2026-03-15 00:47:24,483 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b35e94974c91e64560e924 2026-03-15 00:47:24,484 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 00:47:24,499 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b35e94974c91e64560e924 HTTP/1.1" 200 None 2026-03-15 00:47:24,500 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 00:47:24,515 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b35934974c91e64560e49d HTTP/1.1" 200 None 2026-03-15 00:47:24,516 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 00:47:24,537 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b35e94974c91e64560e924 HTTP/1.1" 200 None 2026-03-15 00:47:24,541 - lava_callback - ERROR - Error processing callback for node 69b35e94974c91e64560e924: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:53664 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58162 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49598 - "GET / HTTP/1.0" 200 OK 2026-03-15 00:47:48,416 - lava_callback - INFO - Received callback for node 69b35ea3974c91e64560e943 INFO: 172.21.0.1:49614 - "POST /node/69b35ea3974c91e64560e943 HTTP/1.0" 202 Accepted 2026-03-15 00:47:48,423 - lava_callback - INFO - Starting async job submit for node 69b35ea3974c91e64560e943 2026-03-15 00:47:48,424 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 00:47:48,439 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b35ea3974c91e64560e943 HTTP/1.1" 200 None 2026-03-15 00:47:48,440 - lava_callback - DEBUG - Processing node 69b35ea3974c91e64560e943: baseline-arm-clabbe 2026-03-15 00:47:48,441 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b35ea3974c91e64560e943 2026-03-15 00:47:48,441 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 00:47:48,455 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b35ea3974c91e64560e943 HTTP/1.1" 200 None 2026-03-15 00:47:48,456 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 00:47:48,470 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b35934974c91e64560e49d HTTP/1.1" 200 None 2026-03-15 00:47:48,472 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 00:47:48,514 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b35ea3974c91e64560e943 HTTP/1.1" 200 None 2026-03-15 00:47:48,523 - lava_callback - ERROR - Error processing callback for node 69b35ea3974c91e64560e943: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' 2026-03-15 00:47:49,070 - lava_callback - INFO - Received callback for node 69b35ea8974c91e64560e950 INFO: 172.21.0.1:49626 - "POST /node/69b35ea8974c91e64560e950 HTTP/1.0" 202 Accepted 2026-03-15 00:47:49,075 - lava_callback - INFO - Starting async job submit for node 69b35ea8974c91e64560e950 2026-03-15 00:47:49,076 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 00:47:49,092 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b35ea8974c91e64560e950 HTTP/1.1" 200 None 2026-03-15 00:47:49,092 - lava_callback - DEBUG - Processing node 69b35ea8974c91e64560e950: baseline-arm-clabbe 2026-03-15 00:47:49,093 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b35ea8974c91e64560e950 2026-03-15 00:47:49,093 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 00:47:49,114 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b35ea8974c91e64560e950 HTTP/1.1" 200 None 2026-03-15 00:47:49,115 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 00:47:49,129 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b35934974c91e64560e49d HTTP/1.1" 200 None 2026-03-15 00:47:49,130 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 00:47:49,158 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b35ea8974c91e64560e950 HTTP/1.1" 200 None 2026-03-15 00:47:49,165 - lava_callback - ERROR - Error processing callback for node 69b35ea8974c91e64560e950: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' 2026-03-15 00:47:49,728 - lava_callback - INFO - Received callback for node 69b35ea9974c91e64560e953 INFO: 172.21.0.1:51602 - "POST /node/69b35ea9974c91e64560e953 HTTP/1.0" 202 Accepted 2026-03-15 00:47:49,733 - lava_callback - INFO - Starting async job submit for node 69b35ea9974c91e64560e953 2026-03-15 00:47:49,734 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 00:47:49,747 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b35ea9974c91e64560e953 HTTP/1.1" 200 None 2026-03-15 00:47:49,748 - lava_callback - DEBUG - Processing node 69b35ea9974c91e64560e953: baseline-arm-clabbe 2026-03-15 00:47:49,748 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b35ea9974c91e64560e953 2026-03-15 00:47:49,749 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 00:47:49,762 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b35ea9974c91e64560e953 HTTP/1.1" 200 None 2026-03-15 00:47:49,763 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 00:47:49,779 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b35934974c91e64560e49d HTTP/1.1" 200 None 2026-03-15 00:47:49,781 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 00:47:49,801 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b35ea9974c91e64560e953 HTTP/1.1" 200 None 2026-03-15 00:47:49,807 - lava_callback - ERROR - Error processing callback for node 69b35ea9974c91e64560e953: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' 2026-03-15 00:47:50,398 - lava_callback - INFO - Received callback for node 69b35eaa974c91e64560e956 INFO: 172.21.0.1:51604 - "POST /node/69b35eaa974c91e64560e956 HTTP/1.0" 202 Accepted 2026-03-15 00:47:50,403 - lava_callback - INFO - Starting async job submit for node 69b35eaa974c91e64560e956 2026-03-15 00:47:50,404 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 00:47:50,421 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b35eaa974c91e64560e956 HTTP/1.1" 200 None 2026-03-15 00:47:50,422 - lava_callback - DEBUG - Processing node 69b35eaa974c91e64560e956: baseline-arm-clabbe 2026-03-15 00:47:50,422 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b35eaa974c91e64560e956 2026-03-15 00:47:50,422 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 00:47:50,454 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b35eaa974c91e64560e956 HTTP/1.1" 200 None 2026-03-15 00:47:50,456 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 00:47:50,469 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b35934974c91e64560e49d HTTP/1.1" 200 None 2026-03-15 00:47:50,470 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 00:47:50,503 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b35eaa974c91e64560e956 HTTP/1.1" 200 None 2026-03-15 00:47:50,504 - lava_callback - ERROR - Error processing callback for node 69b35eaa974c91e64560e956: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' 2026-03-15 00:47:51,053 - lava_callback - INFO - Received callback for node 69b35ead974c91e64560e960 INFO: 172.21.0.1:51616 - "POST /node/69b35ead974c91e64560e960 HTTP/1.0" 202 Accepted 2026-03-15 00:47:51,059 - lava_callback - INFO - Starting async job submit for node 69b35ead974c91e64560e960 2026-03-15 00:47:51,060 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 00:47:51,076 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b35ead974c91e64560e960 HTTP/1.1" 200 None 2026-03-15 00:47:51,077 - lava_callback - DEBUG - Processing node 69b35ead974c91e64560e960: baseline-arm-clabbe 2026-03-15 00:47:51,077 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b35ead974c91e64560e960 2026-03-15 00:47:51,078 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 00:47:51,092 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b35ead974c91e64560e960 HTTP/1.1" 200 None 2026-03-15 00:47:51,094 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 00:47:51,107 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b35934974c91e64560e49d HTTP/1.1" 200 None 2026-03-15 00:47:51,108 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 00:47:51,129 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b35ead974c91e64560e960 HTTP/1.1" 200 None 2026-03-15 00:47:51,130 - lava_callback - ERROR - Error processing callback for node 69b35ead974c91e64560e960: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:51624 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51628 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60538 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53924 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:53938 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49780 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:32976 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:32860 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50068 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50078 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40428 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55626 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:55642 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54648 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54358 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34578 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51354 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51364 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34884 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49378 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:49388 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:32984 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41554 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47132 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52422 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52426 - "GET / HTTP/1.0" 200 OK 2026-03-15 00:51:03,853 - lava_callback - INFO - Received callback for node 69b35f6f974c91e64560ea95 INFO: 172.21.0.1:57760 - "POST /node/69b35f6f974c91e64560ea95 HTTP/1.0" 202 Accepted 2026-03-15 00:51:03,858 - lava_callback - INFO - Starting async job submit for node 69b35f6f974c91e64560ea95 2026-03-15 00:51:03,859 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 00:51:03,874 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b35f6f974c91e64560ea95 HTTP/1.1" 200 None 2026-03-15 00:51:03,875 - lava_callback - DEBUG - Processing node 69b35f6f974c91e64560ea95: baseline-arm-baylibre 2026-03-15 00:51:03,875 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b35f6f974c91e64560ea95 2026-03-15 00:51:03,875 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 00:51:03,894 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b35f6f974c91e64560ea95 HTTP/1.1" 200 None 2026-03-15 00:51:03,896 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 00:51:03,909 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ae11668ef4424e487b2ea2 HTTP/1.1" 200 None 2026-03-15 00:51:03,911 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 00:51:03,964 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b35f6f974c91e64560ea95 HTTP/1.1" 200 None 2026-03-15 00:51:03,966 - lava_callback - ERROR - Error processing callback for node 69b35f6f974c91e64560ea95: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:57768 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57978 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:57990 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38482 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49738 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39016 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36930 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36944 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36504 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43452 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:43456 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51338 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49896 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43564 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54860 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54862 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41522 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45450 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:45456 - "GET / HTTP/1.0" 200 OK 2026-03-15 00:53:24,035 - lava_callback - INFO - Received callback for node 69b36002974c91e64560eaf3 INFO: 172.21.0.1:40182 - "POST /node/69b36002974c91e64560eaf3 HTTP/1.0" 202 Accepted 2026-03-15 00:53:24,040 - lava_callback - INFO - Starting async job submit for node 69b36002974c91e64560eaf3 2026-03-15 00:53:24,041 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 00:53:24,055 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b36002974c91e64560eaf3 HTTP/1.1" 200 None 2026-03-15 00:53:24,056 - lava_callback - DEBUG - Processing node 69b36002974c91e64560eaf3: baseline-arm-baylibre 2026-03-15 00:53:24,057 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b36002974c91e64560eaf3 2026-03-15 00:53:24,057 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 00:53:24,095 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b36002974c91e64560eaf3 HTTP/1.1" 200 None 2026-03-15 00:53:24,097 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 00:53:24,110 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ae11668ef4424e487b2ea2 HTTP/1.1" 200 None 2026-03-15 00:53:24,112 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 00:53:24,142 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b36002974c91e64560eaf3 HTTP/1.1" 200 None 2026-03-15 00:53:24,144 - lava_callback - ERROR - Error processing callback for node 69b36002974c91e64560eaf3: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:40192 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60986 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36006 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35346 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35356 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49652 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54576 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:54588 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40350 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57766 - "GET / HTTP/1.0" 200 OK 2026-03-15 00:54:44,059 - lava_callback - INFO - Received callback for node 69b3604b974c91e64560eb16 INFO: 172.21.0.1:44702 - "POST /node/69b3604b974c91e64560eb16 HTTP/1.0" 202 Accepted 2026-03-15 00:54:44,064 - lava_callback - INFO - Starting async job submit for node 69b3604b974c91e64560eb16 2026-03-15 00:54:44,065 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 00:54:44,201 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b3604b974c91e64560eb16 HTTP/1.1" 200 None 2026-03-15 00:54:44,202 - lava_callback - DEBUG - Processing node 69b3604b974c91e64560eb16: baseline-arm-baylibre 2026-03-15 00:54:44,203 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b3604b974c91e64560eb16 2026-03-15 00:54:44,203 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 00:54:44,227 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b3604b974c91e64560eb16 HTTP/1.1" 200 None 2026-03-15 00:54:44,228 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 00:54:44,242 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ae11668ef4424e487b2ea2 HTTP/1.1" 200 None 2026-03-15 00:54:44,243 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 00:54:44,288 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b3604b974c91e64560eb16 HTTP/1.1" 200 None 2026-03-15 00:54:44,290 - lava_callback - ERROR - Error processing callback for node 69b3604b974c91e64560eb16: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:44708 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:32998 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33010 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41914 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34590 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:34598 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43740 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58048 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60714 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:32910 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:32926 - "GET / HTTP/1.0" 200 OK 2026-03-15 00:56:04,089 - lava_callback - INFO - Received callback for node 69b36097974c91e64560eb35 INFO: 172.21.0.1:40980 - "POST /node/69b36097974c91e64560eb35 HTTP/1.0" 202 Accepted 2026-03-15 00:56:04,095 - lava_callback - INFO - Starting async job submit for node 69b36097974c91e64560eb35 2026-03-15 00:56:04,095 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 00:56:04,134 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b36097974c91e64560eb35 HTTP/1.1" 200 None 2026-03-15 00:56:04,135 - lava_callback - DEBUG - Processing node 69b36097974c91e64560eb35: baseline-arm-baylibre 2026-03-15 00:56:04,135 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b36097974c91e64560eb35 2026-03-15 00:56:04,136 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 00:56:04,184 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b36097974c91e64560eb35 HTTP/1.1" 200 None 2026-03-15 00:56:04,185 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 00:56:04,199 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ae11668ef4424e487b2ea2 HTTP/1.1" 200 None 2026-03-15 00:56:04,200 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 00:56:04,247 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b36097974c91e64560eb35 HTTP/1.1" 200 None 2026-03-15 00:56:04,249 - lava_callback - ERROR - Error processing callback for node 69b36097974c91e64560eb35: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:40984 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42978 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:42986 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36354 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37458 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52314 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55850 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55862 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52584 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43606 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:43622 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58046 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39140 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42822 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43680 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43690 - "GET / HTTP/1.0" 200 OK 2026-03-15 00:58:04,200 - lava_callback - INFO - Received callback for node 69b36107974c91e64560eb7b INFO: 172.21.0.1:44658 - "POST /node/69b36107974c91e64560eb7b HTTP/1.0" 202 Accepted 2026-03-15 00:58:04,205 - lava_callback - INFO - Starting async job submit for node 69b36107974c91e64560eb7b 2026-03-15 00:58:04,206 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 00:58:04,221 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b36107974c91e64560eb7b HTTP/1.1" 200 None 2026-03-15 00:58:04,222 - lava_callback - DEBUG - Processing node 69b36107974c91e64560eb7b: baseline-arm-baylibre 2026-03-15 00:58:04,222 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b36107974c91e64560eb7b 2026-03-15 00:58:04,223 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 00:58:04,236 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b36107974c91e64560eb7b HTTP/1.1" 200 None 2026-03-15 00:58:04,237 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 00:58:04,253 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ae11668ef4424e487b2ea2 HTTP/1.1" 200 None 2026-03-15 00:58:04,255 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 00:58:04,276 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b36107974c91e64560eb7b HTTP/1.1" 200 None 2026-03-15 00:58:04,277 - lava_callback - ERROR - Error processing callback for node 69b36107974c91e64560eb7b: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:44660 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38782 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:38784 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51488 - "GET / HTTP/1.0" 200 OK 2026-03-15 00:58:28,889 - lava_callback - INFO - Received callback for node 69b3612e974c91e64560eb94 INFO: 172.21.0.1:51500 - "POST /node/69b3612e974c91e64560eb94 HTTP/1.0" 202 Accepted 2026-03-15 00:58:28,895 - lava_callback - INFO - Starting async job submit for node 69b3612e974c91e64560eb94 2026-03-15 00:58:28,896 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 00:58:28,910 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b3612e974c91e64560eb94 HTTP/1.1" 200 None 2026-03-15 00:58:28,911 - lava_callback - DEBUG - Processing node 69b3612e974c91e64560eb94: baseline-arm-clabbe 2026-03-15 00:58:28,911 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b3612e974c91e64560eb94 2026-03-15 00:58:28,912 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 00:58:28,928 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b3612e974c91e64560eb94 HTTP/1.1" 200 None 2026-03-15 00:58:28,930 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 00:58:28,943 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ae11668ef4424e487b2ea2 HTTP/1.1" 200 None 2026-03-15 00:58:28,945 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 00:58:28,973 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b3612e974c91e64560eb94 HTTP/1.1" 200 None 2026-03-15 00:58:28,974 - lava_callback - ERROR - Error processing callback for node 69b3612e974c91e64560eb94: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:45398 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57234 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44206 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44220 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40134 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57724 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:57730 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38582 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59648 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52754 - "GET / HTTP/1.0" 200 OK 2026-03-15 00:59:48,932 - lava_callback - INFO - Received callback for node 69b36179974c91e64560ebcc INFO: 172.21.0.1:52768 - "POST /node/69b36179974c91e64560ebcc HTTP/1.0" 202 Accepted 2026-03-15 00:59:48,938 - lava_callback - INFO - Starting async job submit for node 69b36179974c91e64560ebcc 2026-03-15 00:59:48,939 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 00:59:48,953 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b36179974c91e64560ebcc HTTP/1.1" 200 None 2026-03-15 00:59:48,954 - lava_callback - DEBUG - Processing node 69b36179974c91e64560ebcc: baseline-arm-clabbe 2026-03-15 00:59:48,954 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b36179974c91e64560ebcc 2026-03-15 00:59:48,955 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 00:59:48,974 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b36179974c91e64560ebcc HTTP/1.1" 200 None 2026-03-15 00:59:48,976 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 00:59:48,989 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ae11668ef4424e487b2ea2 HTTP/1.1" 200 None 2026-03-15 00:59:48,990 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 00:59:49,019 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b36179974c91e64560ebcc HTTP/1.1" 200 None 2026-03-15 00:59:49,021 - lava_callback - ERROR - Error processing callback for node 69b36179974c91e64560ebcc: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:51066 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51074 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45048 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60396 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:60404 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33512 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58326 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46660 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42634 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42636 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48122 - "GET / HTTP/1.0" 200 OK 2026-03-15 01:01:09,005 - lava_callback - INFO - Received callback for node 69b361c4974c91e64560ebff INFO: 172.21.0.1:48126 - "POST /node/69b361c4974c91e64560ebff HTTP/1.0" 202 Accepted 2026-03-15 01:01:09,011 - lava_callback - INFO - Starting async job submit for node 69b361c4974c91e64560ebff 2026-03-15 01:01:09,012 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 01:01:09,067 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b361c4974c91e64560ebff HTTP/1.1" 200 None 2026-03-15 01:01:09,068 - lava_callback - DEBUG - Processing node 69b361c4974c91e64560ebff: baseline-arm-clabbe 2026-03-15 01:01:09,068 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b361c4974c91e64560ebff 2026-03-15 01:01:09,069 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 01:01:09,083 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b361c4974c91e64560ebff HTTP/1.1" 200 None 2026-03-15 01:01:09,085 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 01:01:09,101 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ae11668ef4424e487b2ea2 HTTP/1.1" 200 None 2026-03-15 01:01:09,103 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 01:01:09,123 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b361c4974c91e64560ebff HTTP/1.1" 200 None 2026-03-15 01:01:09,125 - lava_callback - ERROR - Error processing callback for node 69b361c4974c91e64560ebff: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:45890 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:45902 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46632 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59440 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38678 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50812 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50822 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59254 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35528 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:35530 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57450 - "GET / HTTP/1.0" 200 OK 2026-03-15 01:02:29,066 - lava_callback - INFO - Received callback for node 69b3620f974c91e64560ec21 INFO: 172.21.0.1:57466 - "POST /node/69b3620f974c91e64560ec21 HTTP/1.0" 202 Accepted 2026-03-15 01:02:29,071 - lava_callback - INFO - Starting async job submit for node 69b3620f974c91e64560ec21 2026-03-15 01:02:29,072 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 01:02:29,087 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b3620f974c91e64560ec21 HTTP/1.1" 200 None 2026-03-15 01:02:29,088 - lava_callback - DEBUG - Processing node 69b3620f974c91e64560ec21: baseline-arm-clabbe 2026-03-15 01:02:29,088 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b3620f974c91e64560ec21 2026-03-15 01:02:29,089 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 01:02:29,124 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b3620f974c91e64560ec21 HTTP/1.1" 200 None 2026-03-15 01:02:29,125 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 01:02:29,139 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ae11668ef4424e487b2ea2 HTTP/1.1" 200 None 2026-03-15 01:02:29,140 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 01:02:29,164 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b3620f974c91e64560ec21 HTTP/1.1" 200 None 2026-03-15 01:02:29,170 - lava_callback - ERROR - Error processing callback for node 69b3620f974c91e64560ec21: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:58690 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48268 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40078 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40082 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43880 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42960 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:42966 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58406 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51040 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43340 - "GET / HTTP/1.0" 200 OK 2026-03-15 01:03:49,113 - lava_callback - INFO - Received callback for node 69b36262974c91e64560ec4b INFO: 172.21.0.1:43352 - "POST /node/69b36262974c91e64560ec4b HTTP/1.0" 202 Accepted 2026-03-15 01:03:49,118 - lava_callback - INFO - Starting async job submit for node 69b36262974c91e64560ec4b 2026-03-15 01:03:49,119 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 01:03:49,135 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b36262974c91e64560ec4b HTTP/1.1" 200 None 2026-03-15 01:03:49,135 - lava_callback - DEBUG - Processing node 69b36262974c91e64560ec4b: baseline-arm-clabbe 2026-03-15 01:03:49,136 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b36262974c91e64560ec4b 2026-03-15 01:03:49,136 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 01:03:49,176 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b36262974c91e64560ec4b HTTP/1.1" 200 None 2026-03-15 01:03:49,178 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 01:03:49,191 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ae11668ef4424e487b2ea2 HTTP/1.1" 200 None 2026-03-15 01:03:49,192 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 01:03:49,237 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b36262974c91e64560ec4b HTTP/1.1" 200 None 2026-03-15 01:03:49,239 - lava_callback - ERROR - Error processing callback for node 69b36262974c91e64560ec4b: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:47514 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47518 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49322 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47454 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:47458 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39554 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58112 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56890 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50006 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50016 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43154 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36248 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:36256 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40406 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58566 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54788 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46696 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46706 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51282 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54004 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:54014 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59304 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50354 - "GET / HTTP/1.0" 200 OK 2026-03-15 01:06:44,715 - lava_callback - INFO - Received callback for node 69b36311974c91e64560ec88 INFO: 172.21.0.1:60518 - "POST /node/69b36311974c91e64560ec88 HTTP/1.0" 202 Accepted 2026-03-15 01:06:44,721 - lava_callback - INFO - Starting async job submit for node 69b36311974c91e64560ec88 2026-03-15 01:06:44,721 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 01:06:44,737 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b36311974c91e64560ec88 HTTP/1.1" 200 None 2026-03-15 01:06:44,737 - lava_callback - DEBUG - Processing node 69b36311974c91e64560ec88: baseline-arm64-baylibre 2026-03-15 01:06:44,738 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b36311974c91e64560ec88 2026-03-15 01:06:44,738 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 01:06:44,794 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b36311974c91e64560ec88 HTTP/1.1" 200 None 2026-03-15 01:06:44,795 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 01:06:44,818 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b0b5149d19175818251feb HTTP/1.1" 200 None 2026-03-15 01:06:44,819 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 01:06:44,840 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b36311974c91e64560ec88 HTTP/1.1" 200 None 2026-03-15 01:06:44,846 - lava_callback - ERROR - Error processing callback for node 69b36311974c91e64560ec88: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:60534 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57730 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57734 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50872 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57958 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:57966 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49426 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45752 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36834 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38926 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38930 - "GET / HTTP/1.0" 200 OK 2026-03-15 01:08:04,800 - lava_callback - INFO - Received callback for node 69b3636a974c91e64560eca1 INFO: 172.21.0.1:46252 - "POST /node/69b3636a974c91e64560eca1 HTTP/1.0" 202 Accepted 2026-03-15 01:08:04,806 - lava_callback - INFO - Starting async job submit for node 69b3636a974c91e64560eca1 2026-03-15 01:08:04,807 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 01:08:04,821 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b3636a974c91e64560eca1 HTTP/1.1" 200 None 2026-03-15 01:08:04,822 - lava_callback - DEBUG - Processing node 69b3636a974c91e64560eca1: baseline-arm64-baylibre 2026-03-15 01:08:04,823 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b3636a974c91e64560eca1 2026-03-15 01:08:04,823 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 01:08:04,837 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b3636a974c91e64560eca1 HTTP/1.1" 200 None 2026-03-15 01:08:04,838 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 01:08:04,853 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b0b5149d19175818251feb HTTP/1.1" 200 None 2026-03-15 01:08:04,854 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 01:08:04,884 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b3636a974c91e64560eca1 HTTP/1.1" 200 None 2026-03-15 01:08:04,886 - lava_callback - ERROR - Error processing callback for node 69b3636a974c91e64560eca1: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:46260 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46888 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:46894 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36558 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52832 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60192 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41496 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41500 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56186 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55572 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:55574 - "GET / HTTP/1.0" 200 OK 2026-03-15 01:09:24,991 - lava_callback - INFO - Received callback for node 69b363c1974c91e64560ed4f INFO: 172.21.0.1:35860 - "POST /node/69b363c1974c91e64560ed4f HTTP/1.0" 202 Accepted 2026-03-15 01:09:24,997 - lava_callback - INFO - Starting async job submit for node 69b363c1974c91e64560ed4f 2026-03-15 01:09:24,998 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 01:09:25,013 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b363c1974c91e64560ed4f HTTP/1.1" 200 None 2026-03-15 01:09:25,014 - lava_callback - DEBUG - Processing node 69b363c1974c91e64560ed4f: baseline-arm64-baylibre 2026-03-15 01:09:25,014 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b363c1974c91e64560ed4f 2026-03-15 01:09:25,015 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 01:09:25,028 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b363c1974c91e64560ed4f HTTP/1.1" 200 None 2026-03-15 01:09:25,030 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 01:09:25,043 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b3594d974c91e64560e4b2 HTTP/1.1" 200 None 2026-03-15 01:09:25,044 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 01:09:25,066 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b363c1974c91e64560ed4f HTTP/1.1" 200 None 2026-03-15 01:09:25,073 - lava_callback - ERROR - Error processing callback for node 69b363c1974c91e64560ed4f: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' 2026-03-15 01:09:25,653 - lava_callback - INFO - Received callback for node 69b363c2974c91e64560ed52 INFO: 172.21.0.1:35862 - "POST /node/69b363c2974c91e64560ed52 HTTP/1.0" 202 Accepted 2026-03-15 01:09:25,660 - lava_callback - INFO - Starting async job submit for node 69b363c2974c91e64560ed52 2026-03-15 01:09:25,661 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 01:09:25,676 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b363c2974c91e64560ed52 HTTP/1.1" 200 None 2026-03-15 01:09:25,676 - lava_callback - DEBUG - Processing node 69b363c2974c91e64560ed52: baseline-arm64-baylibre 2026-03-15 01:09:25,677 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b363c2974c91e64560ed52 2026-03-15 01:09:25,677 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 01:09:25,691 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b363c2974c91e64560ed52 HTTP/1.1" 200 None 2026-03-15 01:09:25,692 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 01:09:25,705 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b3594d974c91e64560e4b2 HTTP/1.1" 200 None 2026-03-15 01:09:25,707 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 01:09:25,727 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b363c2974c91e64560ed52 HTTP/1.1" 200 None 2026-03-15 01:09:25,732 - lava_callback - ERROR - Error processing callback for node 69b363c2974c91e64560ed52: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:35864 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49900 - "GET / HTTP/1.0" 200 OK 2026-03-15 01:09:44,836 - lava_callback - INFO - Received callback for node 69b363c4974c91e64560ed55 INFO: 172.21.0.1:45348 - "POST /node/69b363c4974c91e64560ed55 HTTP/1.0" 202 Accepted 2026-03-15 01:09:44,841 - lava_callback - INFO - Starting async job submit for node 69b363c4974c91e64560ed55 2026-03-15 01:09:44,842 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 01:09:44,857 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b363c4974c91e64560ed55 HTTP/1.1" 200 None 2026-03-15 01:09:44,858 - lava_callback - DEBUG - Processing node 69b363c4974c91e64560ed55: baseline-arm64-baylibre 2026-03-15 01:09:44,858 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b363c4974c91e64560ed55 2026-03-15 01:09:44,859 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 01:09:44,871 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b363c4974c91e64560ed55 HTTP/1.1" 200 None 2026-03-15 01:09:44,873 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 01:09:44,886 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b3594d974c91e64560e4b2 HTTP/1.1" 200 None 2026-03-15 01:09:44,888 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 01:09:44,914 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b363c4974c91e64560ed55 HTTP/1.1" 200 None 2026-03-15 01:09:44,919 - lava_callback - ERROR - Error processing callback for node 69b363c4974c91e64560ed55: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:45356 - "GET / HTTP/1.0" 200 OK 2026-03-15 01:09:49,393 - lava_callback - INFO - Received callback for node 69b363d5974c91e64560ed76 INFO: 172.21.0.1:45372 - "POST /node/69b363d5974c91e64560ed76 HTTP/1.0" 202 Accepted 2026-03-15 01:09:49,399 - lava_callback - INFO - Starting async job submit for node 69b363d5974c91e64560ed76 2026-03-15 01:09:49,400 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 01:09:49,414 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b363d5974c91e64560ed76 HTTP/1.1" 200 None 2026-03-15 01:09:49,415 - lava_callback - DEBUG - Processing node 69b363d5974c91e64560ed76: baseline-arm64-clabbe 2026-03-15 01:09:49,415 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b363d5974c91e64560ed76 2026-03-15 01:09:49,416 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 01:09:49,431 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b363d5974c91e64560ed76 HTTP/1.1" 200 None 2026-03-15 01:09:49,433 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 01:09:49,445 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b3594d974c91e64560e4b2 HTTP/1.1" 200 None 2026-03-15 01:09:49,447 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 01:09:49,468 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b363d5974c91e64560ed76 HTTP/1.1" 200 None 2026-03-15 01:09:49,473 - lava_callback - ERROR - Error processing callback for node 69b363d5974c91e64560ed76: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' 2026-03-15 01:09:50,053 - lava_callback - INFO - Received callback for node 69b363d7974c91e64560ed7d INFO: 172.21.0.1:54110 - "POST /node/69b363d7974c91e64560ed7d HTTP/1.0" 202 Accepted 2026-03-15 01:09:50,059 - lava_callback - INFO - Starting async job submit for node 69b363d7974c91e64560ed7d 2026-03-15 01:09:50,059 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 01:09:50,074 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b363d7974c91e64560ed7d HTTP/1.1" 200 None 2026-03-15 01:09:50,075 - lava_callback - DEBUG - Processing node 69b363d7974c91e64560ed7d: baseline-arm64-clabbe 2026-03-15 01:09:50,075 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b363d7974c91e64560ed7d 2026-03-15 01:09:50,076 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 01:09:50,098 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b363d7974c91e64560ed7d HTTP/1.1" 200 None 2026-03-15 01:09:50,100 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 01:09:50,113 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b3594d974c91e64560e4b2 HTTP/1.1" 200 None 2026-03-15 01:09:50,115 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 01:09:50,137 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b363d7974c91e64560ed7d HTTP/1.1" 200 None 2026-03-15 01:09:50,139 - lava_callback - ERROR - Error processing callback for node 69b363d7974c91e64560ed7d: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' 2026-03-15 01:09:50,713 - lava_callback - INFO - Received callback for node 69b363d8974c91e64560ed80 INFO: 172.21.0.1:54116 - "POST /node/69b363d8974c91e64560ed80 HTTP/1.0" 202 Accepted 2026-03-15 01:09:50,719 - lava_callback - INFO - Starting async job submit for node 69b363d8974c91e64560ed80 2026-03-15 01:09:50,720 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 01:09:50,739 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b363d8974c91e64560ed80 HTTP/1.1" 200 None 2026-03-15 01:09:50,740 - lava_callback - DEBUG - Processing node 69b363d8974c91e64560ed80: baseline-arm64-clabbe 2026-03-15 01:09:50,740 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b363d8974c91e64560ed80 2026-03-15 01:09:50,741 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 01:09:50,754 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b363d8974c91e64560ed80 HTTP/1.1" 200 None 2026-03-15 01:09:50,755 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 01:09:50,769 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b3594d974c91e64560e4b2 HTTP/1.1" 200 None 2026-03-15 01:09:50,771 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 01:09:50,792 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b363d8974c91e64560ed80 HTTP/1.1" 200 None 2026-03-15 01:09:50,799 - lava_callback - ERROR - Error processing callback for node 69b363d8974c91e64560ed80: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' 2026-03-15 01:09:51,372 - lava_callback - INFO - Received callback for node 69b363d8974c91e64560ed83 INFO: 172.21.0.1:54132 - "POST /node/69b363d8974c91e64560ed83 HTTP/1.0" 202 Accepted 2026-03-15 01:09:51,378 - lava_callback - INFO - Starting async job submit for node 69b363d8974c91e64560ed83 2026-03-15 01:09:51,379 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 01:09:51,401 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b363d8974c91e64560ed83 HTTP/1.1" 200 None 2026-03-15 01:09:51,402 - lava_callback - DEBUG - Processing node 69b363d8974c91e64560ed83: baseline-arm64-clabbe 2026-03-15 01:09:51,402 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b363d8974c91e64560ed83 2026-03-15 01:09:51,403 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 01:09:51,418 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b363d8974c91e64560ed83 HTTP/1.1" 200 None 2026-03-15 01:09:51,420 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 01:09:51,433 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b3594d974c91e64560e4b2 HTTP/1.1" 200 None 2026-03-15 01:09:51,435 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 01:09:51,455 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b363d8974c91e64560ed83 HTTP/1.1" 200 None 2026-03-15 01:09:51,456 - lava_callback - ERROR - Error processing callback for node 69b363d8974c91e64560ed83: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:54146 - "GET / HTTP/1.0" 200 OK 2026-03-15 01:09:52,043 - lava_callback - INFO - Received callback for node 69b363db974c91e64560edb4 INFO: 172.21.0.1:54156 - "POST /node/69b363db974c91e64560edb4 HTTP/1.0" 202 Accepted 2026-03-15 01:09:52,049 - lava_callback - INFO - Starting async job submit for node 69b363db974c91e64560edb4 2026-03-15 01:09:52,050 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 01:09:52,076 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b363db974c91e64560edb4 HTTP/1.1" 200 None 2026-03-15 01:09:52,077 - lava_callback - DEBUG - Processing node 69b363db974c91e64560edb4: baseline-arm64-clabbe 2026-03-15 01:09:52,077 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b363db974c91e64560edb4 2026-03-15 01:09:52,078 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 01:09:52,091 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b363db974c91e64560edb4 HTTP/1.1" 200 None 2026-03-15 01:09:52,093 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 01:09:52,106 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b3594d974c91e64560e4b2 HTTP/1.1" 200 None 2026-03-15 01:09:52,108 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 01:09:52,128 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b363db974c91e64560edb4 HTTP/1.1" 200 None 2026-03-15 01:09:52,137 - lava_callback - ERROR - Error processing callback for node 69b363db974c91e64560edb4: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' 2026-03-15 01:09:52,721 - lava_callback - INFO - Received callback for node 69b363da974c91e64560edaf INFO: 172.21.0.1:54164 - "POST /node/69b363da974c91e64560edaf HTTP/1.0" 202 Accepted 2026-03-15 01:09:52,727 - lava_callback - INFO - Starting async job submit for node 69b363da974c91e64560edaf 2026-03-15 01:09:52,728 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 01:09:52,746 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b363da974c91e64560edaf HTTP/1.1" 200 None 2026-03-15 01:09:52,747 - lava_callback - DEBUG - Processing node 69b363da974c91e64560edaf: baseline-arm64-clabbe 2026-03-15 01:09:52,747 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b363da974c91e64560edaf 2026-03-15 01:09:52,748 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 01:09:52,764 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b363da974c91e64560edaf HTTP/1.1" 200 None 2026-03-15 01:09:52,765 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 01:09:52,778 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b3594d974c91e64560e4b2 HTTP/1.1" 200 None 2026-03-15 01:09:52,780 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 01:09:52,800 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b363da974c91e64560edaf HTTP/1.1" 200 None 2026-03-15 01:09:52,802 - lava_callback - ERROR - Error processing callback for node 69b363da974c91e64560edaf: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:54174 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46982 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41142 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:41152 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39008 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51580 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53222 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36388 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36396 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38328 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53610 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:53618 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44390 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45994 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37040 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49884 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49888 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40520 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49498 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:49510 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34332 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58946 - "GET / HTTP/1.0" 200 OK 2026-03-15 01:12:45,106 - lava_callback - INFO - Received callback for node 69b36478974c91e64560eebd INFO: 172.21.0.1:33300 - "POST /node/69b36478974c91e64560eebd HTTP/1.0" 202 Accepted 2026-03-15 01:12:45,111 - lava_callback - INFO - Starting async job submit for node 69b36478974c91e64560eebd 2026-03-15 01:12:45,112 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 01:12:45,127 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b36478974c91e64560eebd HTTP/1.1" 200 None 2026-03-15 01:12:45,128 - lava_callback - DEBUG - Processing node 69b36478974c91e64560eebd: baseline-arm64-baylibre 2026-03-15 01:12:45,128 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b36478974c91e64560eebd 2026-03-15 01:12:45,129 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 01:12:45,142 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b36478974c91e64560eebd HTTP/1.1" 200 None 2026-03-15 01:12:45,143 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 01:12:45,157 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b0b5149d19175818251feb HTTP/1.1" 200 None 2026-03-15 01:12:45,158 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 01:12:45,178 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b36478974c91e64560eebd HTTP/1.1" 200 None 2026-03-15 01:12:45,180 - lava_callback - ERROR - Error processing callback for node 69b36478974c91e64560eebd: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:33316 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34870 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34872 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49838 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38652 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:38666 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57186 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53002 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58118 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42242 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42254 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35340 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48710 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:48722 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42544 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53700 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56346 - "GET / HTTP/1.0" 200 OK 2026-03-15 01:14:49,687 - lava_callback - INFO - Received callback for node 69b36505974c91e64560ef06 INFO: 172.21.0.1:56358 - "POST /node/69b36505974c91e64560ef06 HTTP/1.0" 202 Accepted 2026-03-15 01:14:49,692 - lava_callback - INFO - Starting async job submit for node 69b36505974c91e64560ef06 2026-03-15 01:14:49,693 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 01:14:49,707 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b36505974c91e64560ef06 HTTP/1.1" 200 None 2026-03-15 01:14:49,708 - lava_callback - DEBUG - Processing node 69b36505974c91e64560ef06: baseline-arm64-clabbe 2026-03-15 01:14:49,708 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b36505974c91e64560ef06 2026-03-15 01:14:49,709 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 01:14:49,722 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b36505974c91e64560ef06 HTTP/1.1" 200 None 2026-03-15 01:14:49,723 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 01:14:49,744 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b0b5149d19175818251feb HTTP/1.1" 200 None 2026-03-15 01:14:49,746 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 01:14:49,766 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b36505974c91e64560ef06 HTTP/1.1" 200 None 2026-03-15 01:14:49,767 - lava_callback - ERROR - Error processing callback for node 69b36505974c91e64560ef06: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:40486 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40502 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34632 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48362 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:48378 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53804 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49566 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43024 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40426 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40440 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:32854 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45006 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:45014 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37850 - "GET / HTTP/1.0" 200 OK 2026-03-15 01:16:29,766 - lava_callback - INFO - Received callback for node 69b36560974c91e64560ef42 INFO: 172.21.0.1:48716 - "POST /node/69b36560974c91e64560ef42 HTTP/1.0" 202 Accepted 2026-03-15 01:16:29,771 - lava_callback - INFO - Starting async job submit for node 69b36560974c91e64560ef42 2026-03-15 01:16:29,772 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 01:16:29,818 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b36560974c91e64560ef42 HTTP/1.1" 200 None 2026-03-15 01:16:29,819 - lava_callback - DEBUG - Processing node 69b36560974c91e64560ef42: baseline-arm64-clabbe 2026-03-15 01:16:29,819 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b36560974c91e64560ef42 2026-03-15 01:16:29,820 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 01:16:29,833 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b36560974c91e64560ef42 HTTP/1.1" 200 None 2026-03-15 01:16:29,834 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 01:16:29,850 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b0b5149d19175818251feb HTTP/1.1" 200 None 2026-03-15 01:16:29,851 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 01:16:29,872 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b36560974c91e64560ef42 HTTP/1.1" 200 None 2026-03-15 01:16:29,880 - lava_callback - ERROR - Error processing callback for node 69b36560974c91e64560ef42: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:48722 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43202 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46378 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46382 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54634 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43670 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:43680 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51040 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54342 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37472 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41316 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41330 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35188 - "GET / HTTP/1.0" 200 OK 2026-03-15 01:18:09,805 - lava_callback - INFO - Received callback for node 69b365bb974c91e64560ef86 INFO: 172.21.0.1:50586 - "POST /node/69b365bb974c91e64560ef86 HTTP/1.0" 202 Accepted 2026-03-15 01:18:09,811 - lava_callback - INFO - Starting async job submit for node 69b365bb974c91e64560ef86 2026-03-15 01:18:09,812 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 01:18:09,826 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b365bb974c91e64560ef86 HTTP/1.1" 200 None 2026-03-15 01:18:09,827 - lava_callback - DEBUG - Processing node 69b365bb974c91e64560ef86: baseline-arm64-clabbe 2026-03-15 01:18:09,827 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b365bb974c91e64560ef86 2026-03-15 01:18:09,828 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 01:18:09,843 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b365bb974c91e64560ef86 HTTP/1.1" 200 None 2026-03-15 01:18:09,844 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 01:18:09,861 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b0b5149d19175818251feb HTTP/1.1" 200 None 2026-03-15 01:18:09,863 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 01:18:09,885 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b365bb974c91e64560ef86 HTTP/1.1" 200 None 2026-03-15 01:18:09,887 - lava_callback - ERROR - Error processing callback for node 69b365bb974c91e64560ef86: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:50594 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:50602 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45474 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54148 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46772 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59876 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59888 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54172 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53554 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:53560 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34338 - "GET / HTTP/1.0" 200 OK 2026-03-15 01:19:29,859 - lava_callback - INFO - Received callback for node 69b36617974c91e64560efd5 INFO: 172.21.0.1:48574 - "POST /node/69b36617974c91e64560efd5 HTTP/1.0" 202 Accepted 2026-03-15 01:19:29,864 - lava_callback - INFO - Starting async job submit for node 69b36617974c91e64560efd5 2026-03-15 01:19:29,865 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 01:19:29,882 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b36617974c91e64560efd5 HTTP/1.1" 200 None 2026-03-15 01:19:29,883 - lava_callback - DEBUG - Processing node 69b36617974c91e64560efd5: baseline-arm64-clabbe 2026-03-15 01:19:29,883 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b36617974c91e64560efd5 2026-03-15 01:19:29,884 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 01:19:29,911 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b36617974c91e64560efd5 HTTP/1.1" 200 None 2026-03-15 01:19:29,913 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 01:19:29,926 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b0b5149d19175818251feb HTTP/1.1" 200 None 2026-03-15 01:19:29,928 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 01:19:29,955 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b36617974c91e64560efd5 HTTP/1.1" 200 None 2026-03-15 01:19:29,967 - lava_callback - ERROR - Error processing callback for node 69b36617974c91e64560efd5: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:48576 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36206 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51848 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51858 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34182 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:32862 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:32878 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49860 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50006 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58488 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42570 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42578 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47370 - "GET / HTTP/1.0" 200 OK 2026-03-15 01:21:09,942 - lava_callback - INFO - Received callback for node 69b36671974c91e64560f011 INFO: 172.21.0.1:42312 - "POST /node/69b36671974c91e64560f011 HTTP/1.0" 202 Accepted 2026-03-15 01:21:09,948 - lava_callback - INFO - Starting async job submit for node 69b36671974c91e64560f011 2026-03-15 01:21:09,949 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 01:21:09,963 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b36671974c91e64560f011 HTTP/1.1" 200 None 2026-03-15 01:21:09,964 - lava_callback - DEBUG - Processing node 69b36671974c91e64560f011: baseline-arm64-clabbe 2026-03-15 01:21:09,964 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b36671974c91e64560f011 2026-03-15 01:21:09,965 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 01:21:09,977 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b36671974c91e64560f011 HTTP/1.1" 200 None 2026-03-15 01:21:09,979 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 01:21:09,992 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b0b5149d19175818251feb HTTP/1.1" 200 None 2026-03-15 01:21:09,994 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 01:21:10,014 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b36671974c91e64560f011 HTTP/1.1" 200 None 2026-03-15 01:21:10,016 - lava_callback - ERROR - Error processing callback for node 69b36671974c91e64560f011: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:42314 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:42318 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35188 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40358 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50404 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57864 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57876 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60508 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54180 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:54192 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39312 - "GET / HTTP/1.0" 200 OK 2026-03-15 01:22:30,031 - lava_callback - INFO - Received callback for node 69b366cc974c91e64560f04d INFO: 172.21.0.1:49886 - "POST /node/69b366cc974c91e64560f04d HTTP/1.0" 202 Accepted 2026-03-15 01:22:30,036 - lava_callback - INFO - Starting async job submit for node 69b366cc974c91e64560f04d 2026-03-15 01:22:30,037 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 01:22:30,055 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b366cc974c91e64560f04d HTTP/1.1" 200 None 2026-03-15 01:22:30,056 - lava_callback - DEBUG - Processing node 69b366cc974c91e64560f04d: baseline-arm64-clabbe 2026-03-15 01:22:30,056 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b366cc974c91e64560f04d 2026-03-15 01:22:30,057 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 01:22:30,071 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b366cc974c91e64560f04d HTTP/1.1" 200 None 2026-03-15 01:22:30,072 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 01:22:30,086 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b0b5149d19175818251feb HTTP/1.1" 200 None 2026-03-15 01:22:30,088 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 01:22:30,116 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b366cc974c91e64560f04d HTTP/1.1" 200 None 2026-03-15 01:22:30,118 - lava_callback - ERROR - Error processing callback for node 69b366cc974c91e64560f04d: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:49892 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56670 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46808 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46822 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42804 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47962 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:47966 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35650 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44248 - "GET / HTTP/1.0" 200 OK 2026-03-15 01:23:46,077 - lava_callback - INFO - Received callback for node 69b36715974c91e64560f069 INFO: 172.21.0.1:43598 - "POST /node/69b36715974c91e64560f069 HTTP/1.0" 202 Accepted 2026-03-15 01:23:46,083 - lava_callback - INFO - Starting async job submit for node 69b36715974c91e64560f069 2026-03-15 01:23:46,084 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 01:23:46,099 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b36715974c91e64560f069 HTTP/1.1" 200 None 2026-03-15 01:23:46,100 - lava_callback - DEBUG - Processing node 69b36715974c91e64560f069: baseline-arm-baylibre 2026-03-15 01:23:46,100 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b36715974c91e64560f069 2026-03-15 01:23:46,101 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 01:23:46,114 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b36715974c91e64560f069 HTTP/1.1" 200 None 2026-03-15 01:23:46,115 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 01:23:46,129 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ab6e34efa461f55e59cdb7 HTTP/1.1" 200 None 2026-03-15 01:23:46,131 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 01:23:46,152 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b36715974c91e64560f069 HTTP/1.1" 200 None 2026-03-15 01:23:46,154 - lava_callback - ERROR - Error processing callback for node 69b36715974c91e64560f069: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:43612 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56376 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56386 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44064 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52632 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:52638 - "GET / HTTP/1.0" 200 OK 2026-03-15 01:24:25,647 - lava_callback - INFO - Received callback for node 69b3673f974c91e64560f083 INFO: 172.21.0.1:46856 - "POST /node/69b3673f974c91e64560f083 HTTP/1.0" 202 Accepted 2026-03-15 01:24:25,653 - lava_callback - INFO - Starting async job submit for node 69b3673f974c91e64560f083 2026-03-15 01:24:25,654 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 01:24:25,668 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b3673f974c91e64560f083 HTTP/1.1" 200 None 2026-03-15 01:24:25,669 - lava_callback - DEBUG - Processing node 69b3673f974c91e64560f083: baseline-arm-baylibre 2026-03-15 01:24:25,669 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b3673f974c91e64560f083 2026-03-15 01:24:25,669 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 01:24:25,684 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b3673f974c91e64560f083 HTTP/1.1" 200 None 2026-03-15 01:24:25,686 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 01:24:25,706 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ab6e34efa461f55e59cdb7 HTTP/1.1" 200 None 2026-03-15 01:24:25,708 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 01:24:25,728 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b3673f974c91e64560f083 HTTP/1.1" 200 None 2026-03-15 01:24:25,734 - lava_callback - ERROR - Error processing callback for node 69b3673f974c91e64560f083: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:46862 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47622 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46928 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57318 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57322 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46136 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51296 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:51298 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47804 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59164 - "GET / HTTP/1.0" 200 OK 2026-03-15 01:25:45,832 - lava_callback - INFO - Received callback for node 69b36794974c91e64560f09b INFO: 172.21.0.1:54934 - "POST /node/69b36794974c91e64560f09b HTTP/1.0" 202 Accepted 2026-03-15 01:25:45,838 - lava_callback - INFO - Starting async job submit for node 69b36794974c91e64560f09b 2026-03-15 01:25:45,838 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 01:25:45,853 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b36794974c91e64560f09b HTTP/1.1" 200 None 2026-03-15 01:25:45,854 - lava_callback - DEBUG - Processing node 69b36794974c91e64560f09b: baseline-arm-baylibre 2026-03-15 01:25:45,854 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b36794974c91e64560f09b 2026-03-15 01:25:45,855 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 01:25:45,868 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b36794974c91e64560f09b HTTP/1.1" 200 None 2026-03-15 01:25:45,870 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 01:25:45,883 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ab6e34efa461f55e59cdb7 HTTP/1.1" 200 None 2026-03-15 01:25:45,885 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 01:25:45,907 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b36794974c91e64560f09b HTTP/1.1" 200 None 2026-03-15 01:25:45,908 - lava_callback - ERROR - Error processing callback for node 69b36794974c91e64560f09b: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:54940 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41220 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41222 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40124 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47270 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:47276 - "GET / HTTP/1.0" 200 OK 2026-03-15 01:26:25,766 - lava_callback - INFO - Received callback for node 69b367c0974c91e64560f0b0 INFO: 172.21.0.1:35674 - "POST /node/69b367c0974c91e64560f0b0 HTTP/1.0" 202 Accepted 2026-03-15 01:26:25,771 - lava_callback - INFO - Starting async job submit for node 69b367c0974c91e64560f0b0 2026-03-15 01:26:25,772 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 01:26:25,787 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b367c0974c91e64560f0b0 HTTP/1.1" 200 None 2026-03-15 01:26:25,788 - lava_callback - DEBUG - Processing node 69b367c0974c91e64560f0b0: baseline-arm-baylibre 2026-03-15 01:26:25,788 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b367c0974c91e64560f0b0 2026-03-15 01:26:25,789 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 01:26:25,802 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b367c0974c91e64560f0b0 HTTP/1.1" 200 None 2026-03-15 01:26:25,804 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 01:26:25,817 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ab6e34efa461f55e59cdb7 HTTP/1.1" 200 None 2026-03-15 01:26:25,819 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 01:26:25,840 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b367c0974c91e64560f0b0 HTTP/1.1" 200 None 2026-03-15 01:26:25,841 - lava_callback - ERROR - Error processing callback for node 69b367c0974c91e64560f0b0: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:35686 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60028 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38238 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35172 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35188 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:32998 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53060 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:53066 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43596 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38104 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49568 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38702 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38704 - "GET / HTTP/1.0" 200 OK 2026-03-15 01:28:05,917 - lava_callback - INFO - Received callback for node 69b3681a974c91e64560f0cc INFO: 172.21.0.1:52858 - "POST /node/69b3681a974c91e64560f0cc HTTP/1.0" 202 Accepted 2026-03-15 01:28:05,922 - lava_callback - INFO - Starting async job submit for node 69b3681a974c91e64560f0cc 2026-03-15 01:28:05,923 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 01:28:05,940 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b3681a974c91e64560f0cc HTTP/1.1" 200 None 2026-03-15 01:28:05,941 - lava_callback - DEBUG - Processing node 69b3681a974c91e64560f0cc: baseline-arm-baylibre 2026-03-15 01:28:05,941 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b3681a974c91e64560f0cc 2026-03-15 01:28:05,942 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 01:28:05,954 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b3681a974c91e64560f0cc HTTP/1.1" 200 None 2026-03-15 01:28:05,956 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 01:28:05,973 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ab6e34efa461f55e59cdb7 HTTP/1.1" 200 None 2026-03-15 01:28:05,974 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 01:28:05,995 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b3681a974c91e64560f0cc HTTP/1.1" 200 None 2026-03-15 01:28:06,005 - lava_callback - ERROR - Error processing callback for node 69b3681a974c91e64560f0cc: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:52872 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57076 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:57090 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49182 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44402 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55406 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40926 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40936 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46072 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34878 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:34884 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33402 - "GET / HTTP/1.0" 200 OK 2026-03-15 01:29:30,284 - lava_callback - INFO - Received callback for node 69b36876974c91e64560f0e8 INFO: 172.21.0.1:33836 - "POST /node/69b36876974c91e64560f0e8 HTTP/1.0" 202 Accepted 2026-03-15 01:29:30,290 - lava_callback - INFO - Starting async job submit for node 69b36876974c91e64560f0e8 2026-03-15 01:29:30,291 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 01:29:30,307 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b36876974c91e64560f0e8 HTTP/1.1" 200 None 2026-03-15 01:29:30,308 - lava_callback - DEBUG - Processing node 69b36876974c91e64560f0e8: baseline-arm-clabbe 2026-03-15 01:29:30,308 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b36876974c91e64560f0e8 2026-03-15 01:29:30,309 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 01:29:30,325 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b36876974c91e64560f0e8 HTTP/1.1" 200 None 2026-03-15 01:29:30,327 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 01:29:30,341 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ab6e34efa461f55e59cdb7 HTTP/1.1" 200 None 2026-03-15 01:29:30,342 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 01:29:30,409 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b36876974c91e64560f0e8 HTTP/1.1" 200 None 2026-03-15 01:29:30,411 - lava_callback - ERROR - Error processing callback for node 69b36876974c91e64560f0e8: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:33848 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59390 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53560 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53570 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44634 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42138 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:42150 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55000 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56012 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48028 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48768 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48770 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43608 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59762 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:59770 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:32922 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55982 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44166 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56816 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56826 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39514 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38930 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:38942 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56260 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37510 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40548 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33956 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33958 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47454 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55850 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:55856 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33094 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57148 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42284 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:32798 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:32804 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48328 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60604 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:60606 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48152 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45498 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59766 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36890 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36900 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46208 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52366 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:52372 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45144 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43212 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36122 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56940 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56944 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39642 - "GET / HTTP/1.0" 200 OK 2026-03-15 01:36:10,575 - lava_callback - INFO - Received callback for node 69b369ff974c91e64560f1cf INFO: 172.21.0.1:40088 - "POST /node/69b369ff974c91e64560f1cf HTTP/1.0" 202 Accepted 2026-03-15 01:36:10,580 - lava_callback - INFO - Starting async job submit for node 69b369ff974c91e64560f1cf 2026-03-15 01:36:10,581 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 01:36:10,596 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b369ff974c91e64560f1cf HTTP/1.1" 200 None 2026-03-15 01:36:10,597 - lava_callback - DEBUG - Processing node 69b369ff974c91e64560f1cf: baseline-arm-clabbe 2026-03-15 01:36:10,597 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b369ff974c91e64560f1cf 2026-03-15 01:36:10,597 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 01:36:10,610 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b369ff974c91e64560f1cf HTTP/1.1" 200 None 2026-03-15 01:36:10,612 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 01:36:10,625 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ab6e34efa461f55e59cdb7 HTTP/1.1" 200 None 2026-03-15 01:36:10,627 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 01:36:10,647 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b369ff974c91e64560f1cf HTTP/1.1" 200 None 2026-03-15 01:36:10,648 - lava_callback - ERROR - Error processing callback for node 69b369ff974c91e64560f1cf: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:40094 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:40106 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56536 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47274 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59342 - "GET / HTTP/1.0" 200 OK 2026-03-15 01:36:50,588 - lava_callback - INFO - Received callback for node 69b36a2b974c91e64560f1e2 INFO: 172.21.0.1:56074 - "POST /node/69b36a2b974c91e64560f1e2 HTTP/1.0" 202 Accepted 2026-03-15 01:36:50,593 - lava_callback - INFO - Starting async job submit for node 69b36a2b974c91e64560f1e2 2026-03-15 01:36:50,594 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 01:36:50,634 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b36a2b974c91e64560f1e2 HTTP/1.1" 200 None 2026-03-15 01:36:50,635 - lava_callback - DEBUG - Processing node 69b36a2b974c91e64560f1e2: baseline-arm-clabbe 2026-03-15 01:36:50,635 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b36a2b974c91e64560f1e2 2026-03-15 01:36:50,635 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 01:36:50,658 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b36a2b974c91e64560f1e2 HTTP/1.1" 200 None 2026-03-15 01:36:50,659 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 01:36:50,683 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ab6e34efa461f55e59cdb7 HTTP/1.1" 200 None 2026-03-15 01:36:50,684 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 01:36:50,705 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b36a2b974c91e64560f1e2 HTTP/1.1" 200 None 2026-03-15 01:36:50,710 - lava_callback - ERROR - Error processing callback for node 69b36a2b974c91e64560f1e2: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:56088 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56098 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38384 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60240 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:60250 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43646 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40148 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42618 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35388 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35402 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36508 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49694 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:49710 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54682 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34426 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55518 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60718 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60724 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60698 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59784 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:59800 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35706 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56776 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39504 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35396 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35412 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59632 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54504 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:54514 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45128 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33284 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56982 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59374 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59390 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33650 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56150 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:56158 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58046 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59694 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54140 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44724 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44736 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39208 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50236 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:50242 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43202 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47380 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47772 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38922 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38926 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36374 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47694 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:47704 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53360 - "GET / HTTP/1.0" 200 OK 2026-03-15 01:43:26,986 - lava_callback - INFO - Received callback for node 69b36bbc974c91e64560f2cb INFO: 172.21.0.1:53366 - "POST /node/69b36bbc974c91e64560f2cb HTTP/1.0" 202 Accepted 2026-03-15 01:43:26,992 - lava_callback - INFO - Starting async job submit for node 69b36bbc974c91e64560f2cb 2026-03-15 01:43:26,993 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 01:43:27,047 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b36bbc974c91e64560f2cb HTTP/1.1" 200 None 2026-03-15 01:43:27,048 - lava_callback - DEBUG - Processing node 69b36bbc974c91e64560f2cb: baseline-arm64-baylibre 2026-03-15 01:43:27,048 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b36bbc974c91e64560f2cb 2026-03-15 01:43:27,049 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 01:43:27,063 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b36bbc974c91e64560f2cb HTTP/1.1" 200 None 2026-03-15 01:43:27,064 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 01:43:27,086 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ae11758ef4424e487b2eb1 HTTP/1.1" 200 None 2026-03-15 01:43:27,087 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 01:43:27,121 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b36bbc974c91e64560f2cb HTTP/1.1" 200 None 2026-03-15 01:43:27,122 - lava_callback - ERROR - Error processing callback for node 69b36bbc974c91e64560f2cb: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:39968 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40060 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37966 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37976 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41874 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54214 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:54220 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49362 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57844 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40332 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60488 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60494 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56646 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34548 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:34562 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51842 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40830 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48986 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45658 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45668 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53986 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33490 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:33494 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44170 - "GET / HTTP/1.0" 200 OK 2026-03-15 01:46:26,954 - lava_callback - INFO - Received callback for node 69b36c6f974c91e64560f33f INFO: 172.21.0.1:44186 - "POST /node/69b36c6f974c91e64560f33f HTTP/1.0" 202 Accepted 2026-03-15 01:46:26,959 - lava_callback - INFO - Starting async job submit for node 69b36c6f974c91e64560f33f 2026-03-15 01:46:26,960 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 01:46:26,996 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b36c6f974c91e64560f33f HTTP/1.1" 200 None 2026-03-15 01:46:26,997 - lava_callback - DEBUG - Processing node 69b36c6f974c91e64560f33f: baseline-arm64-baylibre 2026-03-15 01:46:26,997 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b36c6f974c91e64560f33f 2026-03-15 01:46:26,998 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 01:46:27,025 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b36c6f974c91e64560f33f HTTP/1.1" 200 None 2026-03-15 01:46:27,026 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 01:46:27,180 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ae11758ef4424e487b2eb1 HTTP/1.1" 200 None 2026-03-15 01:46:27,182 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 01:46:27,228 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b36c6f974c91e64560f33f HTTP/1.1" 200 None 2026-03-15 01:46:27,234 - lava_callback - ERROR - Error processing callback for node 69b36c6f974c91e64560f33f: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:53142 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51458 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51770 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51786 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59544 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42040 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:42048 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35496 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38646 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59008 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49994 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50000 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48470 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48134 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:48142 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42336 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40126 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53548 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48908 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48924 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41646 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50376 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:50380 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35948 - "GET / HTTP/1.0" 200 OK 2026-03-15 01:49:27,104 - lava_callback - INFO - Received callback for node 69b36d23974c91e64560f3a9 INFO: 172.21.0.1:35956 - "POST /node/69b36d23974c91e64560f3a9 HTTP/1.0" 202 Accepted 2026-03-15 01:49:27,113 - lava_callback - INFO - Starting async job submit for node 69b36d23974c91e64560f3a9 2026-03-15 01:49:27,114 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 01:49:27,151 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b36d23974c91e64560f3a9 HTTP/1.1" 200 None 2026-03-15 01:49:27,152 - lava_callback - DEBUG - Processing node 69b36d23974c91e64560f3a9: baseline-arm64-baylibre 2026-03-15 01:49:27,152 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b36d23974c91e64560f3a9 2026-03-15 01:49:27,153 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 01:49:27,188 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b36d23974c91e64560f3a9 HTTP/1.1" 200 None 2026-03-15 01:49:27,189 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 01:49:27,202 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ae11758ef4424e487b2eb1 HTTP/1.1" 200 None 2026-03-15 01:49:27,204 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 01:49:27,256 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b36d23974c91e64560f3a9 HTTP/1.1" 200 None 2026-03-15 01:49:27,258 - lava_callback - ERROR - Error processing callback for node 69b36d23974c91e64560f3a9: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:56918 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43290 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52128 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52138 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60612 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54636 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:54638 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33978 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57096 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46174 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43728 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43738 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57876 - "GET / HTTP/1.0" 200 OK 2026-03-15 01:51:07,156 - lava_callback - INFO - Received callback for node 69b36d7b974c91e64560f3e0 INFO: 172.21.0.1:57882 - "POST /node/69b36d7b974c91e64560f3e0 HTTP/1.0" 202 Accepted 2026-03-15 01:51:07,162 - lava_callback - INFO - Starting async job submit for node 69b36d7b974c91e64560f3e0 2026-03-15 01:51:07,162 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 01:51:07,208 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b36d7b974c91e64560f3e0 HTTP/1.1" 200 None 2026-03-15 01:51:07,209 - lava_callback - DEBUG - Processing node 69b36d7b974c91e64560f3e0: baseline-arm64-baylibre 2026-03-15 01:51:07,209 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b36d7b974c91e64560f3e0 2026-03-15 01:51:07,209 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 01:51:07,223 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b36d7b974c91e64560f3e0 HTTP/1.1" 200 None 2026-03-15 01:51:07,225 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 01:51:07,239 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ae11758ef4424e487b2eb1 HTTP/1.1" 200 None 2026-03-15 01:51:07,240 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 01:51:07,262 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b36d7b974c91e64560f3e0 HTTP/1.1" 200 None 2026-03-15 01:51:07,268 - lava_callback - ERROR - Error processing callback for node 69b36d7b974c91e64560f3e0: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:33862 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:33870 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51570 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47466 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34570 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37098 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37102 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33094 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33052 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:33060 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52244 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39384 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40872 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37054 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37064 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46892 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49348 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:49354 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59898 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39508 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46206 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37812 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37822 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53992 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33082 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:33092 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34760 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53566 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59314 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47590 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47592 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38156 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46276 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:46292 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35544 - "GET / HTTP/1.0" 200 OK 2026-03-15 01:55:27,661 - lava_callback - INFO - Received callback for node 69b36e8b974c91e64560f480 INFO: 172.21.0.1:35550 - "POST /node/69b36e8b974c91e64560f480 HTTP/1.0" 202 Accepted 2026-03-15 01:55:27,667 - lava_callback - INFO - Starting async job submit for node 69b36e8b974c91e64560f480 2026-03-15 01:55:27,668 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 01:55:27,690 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b36e8b974c91e64560f480 HTTP/1.1" 200 None 2026-03-15 01:55:27,691 - lava_callback - DEBUG - Processing node 69b36e8b974c91e64560f480: baseline-arm64-baylibre 2026-03-15 01:55:27,692 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b36e8b974c91e64560f480 2026-03-15 01:55:27,692 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 01:55:27,709 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b36e8b974c91e64560f480 HTTP/1.1" 200 None 2026-03-15 01:55:27,711 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 01:55:27,724 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ae11758ef4424e487b2eb1 HTTP/1.1" 200 None 2026-03-15 01:55:27,725 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 01:55:27,746 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b36e8b974c91e64560f480 HTTP/1.1" 200 None 2026-03-15 01:55:27,753 - lava_callback - ERROR - Error processing callback for node 69b36e8b974c91e64560f480: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:43364 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36022 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35594 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35596 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46790 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45512 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:45514 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41766 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40380 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53234 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58938 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58954 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45358 - "GET / HTTP/1.0" 200 OK 2026-03-15 01:57:07,458 - lava_callback - INFO - Received callback for node 69b36ee6974c91e64560f4b8 INFO: 172.21.0.1:45368 - "POST /node/69b36ee6974c91e64560f4b8 HTTP/1.0" 202 Accepted 2026-03-15 01:57:07,464 - lava_callback - INFO - Starting async job submit for node 69b36ee6974c91e64560f4b8 2026-03-15 01:57:07,465 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 01:57:07,491 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b36ee6974c91e64560f4b8 HTTP/1.1" 200 None 2026-03-15 01:57:07,492 - lava_callback - DEBUG - Processing node 69b36ee6974c91e64560f4b8: baseline-arm64-baylibre 2026-03-15 01:57:07,492 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b36ee6974c91e64560f4b8 2026-03-15 01:57:07,493 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 01:57:07,520 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b36ee6974c91e64560f4b8 HTTP/1.1" 200 None 2026-03-15 01:57:07,522 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 01:57:07,535 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ae11758ef4424e487b2eb1 HTTP/1.1" 200 None 2026-03-15 01:57:07,537 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 01:57:07,559 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b36ee6974c91e64560f4b8 HTTP/1.1" 200 None 2026-03-15 01:57:07,560 - lava_callback - ERROR - Error processing callback for node 69b36ee6974c91e64560f4b8: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:60356 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:60358 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48516 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52486 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34314 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37866 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37876 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51406 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60726 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:60740 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56936 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55970 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55702 - "GET / HTTP/1.0" 200 OK 2026-03-15 01:58:51,628 - lava_callback - INFO - Received callback for node 69b36f4a974c91e64560f4e8 INFO: 172.21.0.1:52188 - "POST /node/69b36f4a974c91e64560f4e8 HTTP/1.0" 202 Accepted 2026-03-15 01:58:51,634 - lava_callback - INFO - Starting async job submit for node 69b36f4a974c91e64560f4e8 2026-03-15 01:58:51,634 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 01:58:51,649 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b36f4a974c91e64560f4e8 HTTP/1.1" 200 None 2026-03-15 01:58:51,650 - lava_callback - DEBUG - Processing node 69b36f4a974c91e64560f4e8: baseline-arm64-clabbe 2026-03-15 01:58:51,650 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b36f4a974c91e64560f4e8 2026-03-15 01:58:51,651 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 01:58:51,664 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b36f4a974c91e64560f4e8 HTTP/1.1" 200 None 2026-03-15 01:58:51,666 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 01:58:51,679 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ae11758ef4424e487b2eb1 HTTP/1.1" 200 None 2026-03-15 01:58:51,680 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 01:58:51,702 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b36f4a974c91e64560f4e8 HTTP/1.1" 200 None 2026-03-15 01:58:51,703 - lava_callback - ERROR - Error processing callback for node 69b36f4a974c91e64560f4e8: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:52198 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52214 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49008 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54220 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:54226 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54512 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34970 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:32936 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60480 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60496 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36490 - "GET / HTTP/1.0" 200 OK 2026-03-15 02:00:11,833 - lava_callback - INFO - Received callback for node 69b36fa5974c91e64560f516 INFO: 172.21.0.1:35402 - "POST /node/69b36fa5974c91e64560f516 HTTP/1.0" 202 Accepted 2026-03-15 02:00:11,838 - lava_callback - INFO - Starting async job submit for node 69b36fa5974c91e64560f516 2026-03-15 02:00:11,839 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 02:00:11,854 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b36fa5974c91e64560f516 HTTP/1.1" 200 None 2026-03-15 02:00:11,855 - lava_callback - DEBUG - Processing node 69b36fa5974c91e64560f516: baseline-arm64-clabbe 2026-03-15 02:00:11,855 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b36fa5974c91e64560f516 2026-03-15 02:00:11,856 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 02:00:11,869 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b36fa5974c91e64560f516 HTTP/1.1" 200 None 2026-03-15 02:00:11,871 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 02:00:11,886 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ae11758ef4424e487b2eb1 HTTP/1.1" 200 None 2026-03-15 02:00:11,888 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 02:00:11,908 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b36fa5974c91e64560f516 HTTP/1.1" 200 None 2026-03-15 02:00:11,914 - lava_callback - ERROR - Error processing callback for node 69b36fa5974c91e64560f516: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:35414 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:35418 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58358 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39704 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60344 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33320 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33328 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33102 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48532 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:48546 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51026 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53266 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51908 - "GET / HTTP/1.0" 200 OK 2026-03-15 02:01:51,744 - lava_callback - INFO - Received callback for node 69b37003974c91e64560f545 INFO: 172.21.0.1:46854 - "POST /node/69b37003974c91e64560f545 HTTP/1.0" 202 Accepted 2026-03-15 02:01:51,750 - lava_callback - INFO - Starting async job submit for node 69b37003974c91e64560f545 2026-03-15 02:01:51,750 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 02:01:51,765 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b37003974c91e64560f545 HTTP/1.1" 200 None 2026-03-15 02:01:51,766 - lava_callback - DEBUG - Processing node 69b37003974c91e64560f545: baseline-arm64-clabbe 2026-03-15 02:01:51,766 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b37003974c91e64560f545 2026-03-15 02:01:51,767 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 02:01:51,788 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b37003974c91e64560f545 HTTP/1.1" 200 None 2026-03-15 02:01:51,790 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 02:01:51,809 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ae11758ef4424e487b2eb1 HTTP/1.1" 200 None 2026-03-15 02:01:51,811 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 02:01:51,833 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b37003974c91e64560f545 HTTP/1.1" 200 None 2026-03-15 02:01:51,834 - lava_callback - ERROR - Error processing callback for node 69b37003974c91e64560f545: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:46856 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46868 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36682 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51992 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:52006 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39314 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59068 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36670 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50562 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50576 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59060 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34558 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:34564 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38328 - "GET / HTTP/1.0" 200 OK 2026-03-15 02:03:31,970 - lava_callback - INFO - Received callback for node 69b3705f974c91e64560f55b INFO: 172.21.0.1:59676 - "POST /node/69b3705f974c91e64560f55b HTTP/1.0" 202 Accepted 2026-03-15 02:03:31,975 - lava_callback - INFO - Starting async job submit for node 69b3705f974c91e64560f55b 2026-03-15 02:03:31,976 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 02:03:31,993 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b3705f974c91e64560f55b HTTP/1.1" 200 None 2026-03-15 02:03:31,994 - lava_callback - DEBUG - Processing node 69b3705f974c91e64560f55b: baseline-arm64-clabbe 2026-03-15 02:03:31,994 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b3705f974c91e64560f55b 2026-03-15 02:03:31,995 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 02:03:32,008 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b3705f974c91e64560f55b HTTP/1.1" 200 None 2026-03-15 02:03:32,010 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 02:03:32,025 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ae11758ef4424e487b2eb1 HTTP/1.1" 200 None 2026-03-15 02:03:32,027 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 02:03:32,070 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b3705f974c91e64560f55b HTTP/1.1" 200 None 2026-03-15 02:03:32,081 - lava_callback - ERROR - Error processing callback for node 69b3705f974c91e64560f55b: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:59686 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35864 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57240 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57244 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40144 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57006 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:57008 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48570 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54798 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38648 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51308 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51324 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51570 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45356 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:45366 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47680 - "GET / HTTP/1.0" 200 OK 2026-03-15 02:05:31,930 - lava_callback - INFO - Received callback for node 69b370e8974c91e64560f593 INFO: 172.21.0.1:47576 - "POST /node/69b370e8974c91e64560f593 HTTP/1.0" 202 Accepted 2026-03-15 02:05:31,936 - lava_callback - INFO - Starting async job submit for node 69b370e8974c91e64560f593 2026-03-15 02:05:31,937 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 02:05:31,961 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b370e8974c91e64560f593 HTTP/1.1" 200 None 2026-03-15 02:05:31,961 - lava_callback - DEBUG - Processing node 69b370e8974c91e64560f593: baseline-arm64-clabbe 2026-03-15 02:05:31,962 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b370e8974c91e64560f593 2026-03-15 02:05:31,962 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 02:05:31,976 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b370e8974c91e64560f593 HTTP/1.1" 200 None 2026-03-15 02:05:31,977 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 02:05:31,990 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ae11758ef4424e487b2eb1 HTTP/1.1" 200 None 2026-03-15 02:05:31,992 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 02:05:32,015 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b370e8974c91e64560f593 HTTP/1.1" 200 None 2026-03-15 02:05:32,025 - lava_callback - ERROR - Error processing callback for node 69b370e8974c91e64560f593: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:47580 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58534 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54240 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54244 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51106 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46740 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:46750 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47976 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44516 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55408 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37834 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37850 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38998 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42486 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:42498 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39802 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47456 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57110 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45846 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45856 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54042 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39922 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:39924 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42772 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58840 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35190 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36982 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36984 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58450 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34914 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:34924 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53010 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52426 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34558 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59586 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59602 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43126 - "GET / HTTP/1.0" 200 OK 2026-03-15 02:10:12,102 - lava_callback - INFO - Received callback for node 69b371f6974c91e64560f5d5 INFO: 172.21.0.1:36178 - "POST /node/69b371f6974c91e64560f5d5 HTTP/1.0" 202 Accepted 2026-03-15 02:10:12,107 - lava_callback - INFO - Starting async job submit for node 69b371f6974c91e64560f5d5 2026-03-15 02:10:12,108 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 02:10:12,144 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b371f6974c91e64560f5d5 HTTP/1.1" 200 None 2026-03-15 02:10:12,145 - lava_callback - DEBUG - Processing node 69b371f6974c91e64560f5d5: baseline-arm64-clabbe 2026-03-15 02:10:12,145 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b371f6974c91e64560f5d5 2026-03-15 02:10:12,146 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 02:10:12,159 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b371f6974c91e64560f5d5 HTTP/1.1" 200 None 2026-03-15 02:10:12,160 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 02:10:12,183 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ae11758ef4424e487b2eb1 HTTP/1.1" 200 None 2026-03-15 02:10:12,185 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 02:10:12,207 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b371f6974c91e64560f5d5 HTTP/1.1" 200 None 2026-03-15 02:10:12,212 - lava_callback - ERROR - Error processing callback for node 69b371f6974c91e64560f5d5: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:36194 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:36210 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41952 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49050 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47418 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43664 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43672 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47090 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39176 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:39180 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47242 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48316 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39370 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60318 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60320 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45540 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59082 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:59094 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52892 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35538 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44470 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52838 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52850 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49334 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34424 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:34428 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50404 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50508 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34102 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40460 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40468 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57566 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43708 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:43720 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53470 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53656 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34720 - "GET / HTTP/1.0" 200 OK 2026-03-15 02:14:48,596 - lava_callback - INFO - Received callback for node 69b37303974c91e64560f61f INFO: 172.21.0.1:34734 - "POST /node/69b37303974c91e64560f61f HTTP/1.0" 202 Accepted 2026-03-15 02:14:48,601 - lava_callback - INFO - Starting async job submit for node 69b37303974c91e64560f61f 2026-03-15 02:14:48,602 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 02:14:48,625 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b37303974c91e64560f61f HTTP/1.1" 200 None 2026-03-15 02:14:48,626 - lava_callback - DEBUG - Processing node 69b37303974c91e64560f61f: baseline-arm64-baylibre 2026-03-15 02:14:48,626 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b37303974c91e64560f61f 2026-03-15 02:14:48,627 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 02:14:48,660 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b37303974c91e64560f61f HTTP/1.1" 200 None 2026-03-15 02:14:48,662 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 02:14:48,699 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ab6e44efa461f55e59cdc8 HTTP/1.1" 200 None 2026-03-15 02:14:48,700 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 02:14:48,731 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b37303974c91e64560f61f HTTP/1.1" 200 None 2026-03-15 02:14:48,733 - lava_callback - ERROR - Error processing callback for node 69b37303974c91e64560f61f: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:37870 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37886 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35782 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43112 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:43116 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48822 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60480 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60830 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54792 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54808 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58404 - "GET / HTTP/1.0" 200 OK 2026-03-15 02:16:08,496 - lava_callback - INFO - Received callback for node 69b3735e974c91e64560f635 INFO: 172.21.0.1:58420 - "POST /node/69b3735e974c91e64560f635 HTTP/1.0" 202 Accepted 2026-03-15 02:16:08,502 - lava_callback - INFO - Starting async job submit for node 69b3735e974c91e64560f635 2026-03-15 02:16:08,503 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 02:16:08,517 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b3735e974c91e64560f635 HTTP/1.1" 200 None 2026-03-15 02:16:08,518 - lava_callback - DEBUG - Processing node 69b3735e974c91e64560f635: baseline-arm64-baylibre 2026-03-15 02:16:08,518 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b3735e974c91e64560f635 2026-03-15 02:16:08,519 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 02:16:08,533 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b3735e974c91e64560f635 HTTP/1.1" 200 None 2026-03-15 02:16:08,534 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 02:16:08,569 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ab6e44efa461f55e59cdc8 HTTP/1.1" 200 None 2026-03-15 02:16:08,571 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 02:16:08,627 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b3735e974c91e64560f635 HTTP/1.1" 200 None 2026-03-15 02:16:08,633 - lava_callback - ERROR - Error processing callback for node 69b3735e974c91e64560f635: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:56868 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:56882 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53270 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37982 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55370 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56468 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56480 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35496 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43550 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:43552 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35756 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51810 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52246 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54330 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54334 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54306 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40526 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:40532 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57358 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54354 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58398 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53976 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53986 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47944 - "GET / HTTP/1.0" 200 OK 2026-03-15 02:19:08,759 - lava_callback - INFO - Received callback for node 69b37416974c91e64560f669 INFO: 172.21.0.1:47960 - "POST /node/69b37416974c91e64560f669 HTTP/1.0" 202 Accepted 2026-03-15 02:19:08,765 - lava_callback - INFO - Starting async job submit for node 69b37416974c91e64560f669 2026-03-15 02:19:08,765 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 02:19:08,797 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b37416974c91e64560f669 HTTP/1.1" 200 None 2026-03-15 02:19:08,798 - lava_callback - DEBUG - Processing node 69b37416974c91e64560f669: baseline-arm64-baylibre 2026-03-15 02:19:08,798 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b37416974c91e64560f669 2026-03-15 02:19:08,799 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 02:19:08,822 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b37416974c91e64560f669 HTTP/1.1" 200 None 2026-03-15 02:19:08,824 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 02:19:08,838 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ab6e44efa461f55e59cdc8 HTTP/1.1" 200 None 2026-03-15 02:19:08,840 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 02:19:08,861 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b37416974c91e64560f669 HTTP/1.1" 200 None 2026-03-15 02:19:08,867 - lava_callback - ERROR - Error processing callback for node 69b37416974c91e64560f669: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:56462 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:56468 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57022 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60258 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49626 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34148 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34156 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49834 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56928 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:56934 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43000 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55950 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36270 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42954 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42960 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59152 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39986 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:39990 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49390 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55928 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43766 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58804 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58818 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33246 - "GET / HTTP/1.0" 200 OK 2026-03-15 02:22:09,018 - lava_callback - INFO - Received callback for node 69b374c8974c91e64560f6a1 INFO: 172.21.0.1:33254 - "POST /node/69b374c8974c91e64560f6a1 HTTP/1.0" 202 Accepted 2026-03-15 02:22:09,024 - lava_callback - INFO - Starting async job submit for node 69b374c8974c91e64560f6a1 2026-03-15 02:22:09,025 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 02:22:09,040 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b374c8974c91e64560f6a1 HTTP/1.1" 200 None 2026-03-15 02:22:09,041 - lava_callback - DEBUG - Processing node 69b374c8974c91e64560f6a1: baseline-arm64-baylibre 2026-03-15 02:22:09,041 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b374c8974c91e64560f6a1 2026-03-15 02:22:09,042 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 02:22:09,055 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b374c8974c91e64560f6a1 HTTP/1.1" 200 None 2026-03-15 02:22:09,056 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 02:22:09,070 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ab6e44efa461f55e59cdc8 HTTP/1.1" 200 None 2026-03-15 02:22:09,071 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 02:22:09,102 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b374c8974c91e64560f6a1 HTTP/1.1" 200 None 2026-03-15 02:22:09,103 - lava_callback - ERROR - Error processing callback for node 69b374c8974c91e64560f6a1: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:37312 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:37318 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59598 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52406 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45866 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33990 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33992 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41618 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35776 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:35786 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40272 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56206 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50800 - "GET / HTTP/1.0" 200 OK 2026-03-15 02:23:48,930 - lava_callback - INFO - Received callback for node 69b37523974c91e64560f6b0 INFO: 172.21.0.1:50804 - "POST /node/69b37523974c91e64560f6b0 HTTP/1.0" 202 Accepted 2026-03-15 02:23:48,936 - lava_callback - INFO - Starting async job submit for node 69b37523974c91e64560f6b0 2026-03-15 02:23:48,936 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 02:23:48,951 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b37523974c91e64560f6b0 HTTP/1.1" 200 None 2026-03-15 02:23:48,952 - lava_callback - DEBUG - Processing node 69b37523974c91e64560f6b0: baseline-arm64-baylibre 2026-03-15 02:23:48,952 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b37523974c91e64560f6b0 2026-03-15 02:23:48,952 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 02:23:48,987 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b37523974c91e64560f6b0 HTTP/1.1" 200 None 2026-03-15 02:23:48,988 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 02:23:49,001 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ab6e44efa461f55e59cdc8 HTTP/1.1" 200 None 2026-03-15 02:23:49,003 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 02:23:49,024 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b37523974c91e64560f6b0 HTTP/1.1" 200 None 2026-03-15 02:23:49,031 - lava_callback - ERROR - Error processing callback for node 69b37523974c91e64560f6b0: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:54330 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54334 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57422 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:32782 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:32794 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:32836 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55766 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53892 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39270 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39276 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53934 - "GET / HTTP/1.0" 200 OK 2026-03-15 02:25:08,966 - lava_callback - INFO - Received callback for node 69b3757d974c91e64560f6c1 INFO: 172.21.0.1:53940 - "POST /node/69b3757d974c91e64560f6c1 HTTP/1.0" 202 Accepted 2026-03-15 02:25:08,971 - lava_callback - INFO - Starting async job submit for node 69b3757d974c91e64560f6c1 2026-03-15 02:25:08,972 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 02:25:08,986 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b3757d974c91e64560f6c1 HTTP/1.1" 200 None 2026-03-15 02:25:08,987 - lava_callback - DEBUG - Processing node 69b3757d974c91e64560f6c1: baseline-arm64-baylibre 2026-03-15 02:25:08,988 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b3757d974c91e64560f6c1 2026-03-15 02:25:08,988 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 02:25:09,009 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b3757d974c91e64560f6c1 HTTP/1.1" 200 None 2026-03-15 02:25:09,010 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 02:25:09,033 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ab6e44efa461f55e59cdc8 HTTP/1.1" 200 None 2026-03-15 02:25:09,035 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 02:25:09,059 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b3757d974c91e64560f6c1 HTTP/1.1" 200 None 2026-03-15 02:25:09,060 - lava_callback - ERROR - Error processing callback for node 69b3757d974c91e64560f6c1: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:48192 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:48208 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35096 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55372 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57232 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41314 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41326 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41310 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39708 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:39724 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39748 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44834 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55084 - "GET / HTTP/1.0" 200 OK 2026-03-15 02:26:52,843 - lava_callback - INFO - Received callback for node 69b375de974c91e64560f6d7 INFO: 172.21.0.1:33352 - "POST /node/69b375de974c91e64560f6d7 HTTP/1.0" 202 Accepted 2026-03-15 02:26:52,849 - lava_callback - INFO - Starting async job submit for node 69b375de974c91e64560f6d7 2026-03-15 02:26:52,850 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 02:26:52,870 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b375de974c91e64560f6d7 HTTP/1.1" 200 None 2026-03-15 02:26:52,871 - lava_callback - DEBUG - Processing node 69b375de974c91e64560f6d7: baseline-arm64-clabbe 2026-03-15 02:26:52,871 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b375de974c91e64560f6d7 2026-03-15 02:26:52,872 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 02:26:52,886 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b375de974c91e64560f6d7 HTTP/1.1" 200 None 2026-03-15 02:26:52,887 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 02:26:52,912 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ab6e44efa461f55e59cdc8 HTTP/1.1" 200 None 2026-03-15 02:26:52,914 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 02:26:52,943 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b375de974c91e64560f6d7 HTTP/1.1" 200 None 2026-03-15 02:26:52,944 - lava_callback - ERROR - Error processing callback for node 69b375de974c91e64560f6d7: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:33358 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33372 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52182 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56532 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:56548 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46130 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55912 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43298 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54982 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54988 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39142 - "GET / HTTP/1.0" 200 OK 2026-03-15 02:28:12,898 - lava_callback - INFO - Received callback for node 69b37638974c91e64560f6ed INFO: 172.21.0.1:49542 - "POST /node/69b37638974c91e64560f6ed HTTP/1.0" 202 Accepted 2026-03-15 02:28:12,904 - lava_callback - INFO - Starting async job submit for node 69b37638974c91e64560f6ed 2026-03-15 02:28:12,905 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 02:28:12,933 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b37638974c91e64560f6ed HTTP/1.1" 200 None 2026-03-15 02:28:12,934 - lava_callback - DEBUG - Processing node 69b37638974c91e64560f6ed: baseline-arm64-clabbe 2026-03-15 02:28:12,934 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b37638974c91e64560f6ed 2026-03-15 02:28:12,935 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 02:28:12,949 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b37638974c91e64560f6ed HTTP/1.1" 200 None 2026-03-15 02:28:12,950 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 02:28:12,964 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ab6e44efa461f55e59cdc8 HTTP/1.1" 200 None 2026-03-15 02:28:12,965 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 02:28:12,986 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b37638974c91e64560f6ed HTTP/1.1" 200 None 2026-03-15 02:28:12,993 - lava_callback - ERROR - Error processing callback for node 69b37638974c91e64560f6ed: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:49556 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:49572 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44778 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47884 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44446 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56892 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56908 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41476 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58798 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:58812 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46622 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60970 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50718 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56198 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56210 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47742 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36972 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:36986 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49944 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36120 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:32966 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57024 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57030 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54420 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58176 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:58190 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49542 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41632 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47372 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35530 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35536 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48178 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39872 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:39880 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45622 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47312 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44922 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36496 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36498 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59452 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37088 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:37104 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59046 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34844 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51280 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58658 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58662 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37966 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45020 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:45022 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37682 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51396 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:32886 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49196 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49210 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42834 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37494 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:37500 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37140 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35854 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50654 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44158 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44162 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53248 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55622 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:55630 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50064 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52404 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42056 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56802 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56806 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44356 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57000 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:57002 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40182 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48128 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58326 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49458 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49460 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46302 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39288 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:39302 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41842 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56654 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57048 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52836 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52844 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34344 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37572 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:37578 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39716 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47346 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33750 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56438 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56454 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53216 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35668 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:35682 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40210 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:32904 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47450 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36974 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36990 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36608 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34630 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:34636 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45804 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60300 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33094 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59418 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59426 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56884 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35750 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:35766 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37218 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44646 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52270 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39708 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39714 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56328 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47686 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:47692 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36380 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50708 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51082 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45546 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45554 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46970 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37420 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:37432 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58726 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40998 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43304 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55684 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55696 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55310 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44588 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:44590 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52308 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48734 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45550 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36704 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36708 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51452 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38166 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:38172 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37054 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59224 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60018 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59624 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59632 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34794 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34520 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:34524 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34238 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50470 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60522 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44494 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44508 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53000 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48476 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:48480 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60420 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38972 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41654 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42436 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42446 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33792 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47372 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:47374 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34620 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47718 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48844 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48460 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48470 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53150 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44162 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:44178 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51258 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39730 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34662 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33722 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33736 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54736 - "GET / HTTP/1.0" 200 OK 2026-03-15 02:51:13,915 - lava_callback - INFO - Received callback for node 69b37b9f974c91e64560f799 INFO: 172.21.0.1:48822 - "POST /node/69b37b9f974c91e64560f799 HTTP/1.0" 202 Accepted 2026-03-15 02:51:13,921 - lava_callback - INFO - Starting async job submit for node 69b37b9f974c91e64560f799 2026-03-15 02:51:13,921 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 02:51:13,954 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b37b9f974c91e64560f799 HTTP/1.1" 200 None 2026-03-15 02:51:13,954 - lava_callback - DEBUG - Processing node 69b37b9f974c91e64560f799: baseline-arm-clabbe 2026-03-15 02:51:13,955 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b37b9f974c91e64560f799 2026-03-15 02:51:13,955 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 02:51:13,973 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b37b9f974c91e64560f799 HTTP/1.1" 200 None 2026-03-15 02:51:13,974 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 02:51:14,003 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b276654bce73bcf0233d14 HTTP/1.1" 200 None 2026-03-15 02:51:14,004 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 02:51:14,029 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b37b9f974c91e64560f799 HTTP/1.1" 200 None 2026-03-15 02:51:14,037 - lava_callback - ERROR - Error processing callback for node 69b37b9f974c91e64560f799: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:48828 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:48844 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42164 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42566 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34658 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49936 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49944 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41066 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56172 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:56186 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40934 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47144 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:32978 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37596 - "GET / HTTP/1.0" 200 OK 2026-03-15 02:52:53,998 - lava_callback - INFO - Received callback for node 69b37bf1974c91e64560f7ac INFO: 172.21.0.1:37608 - "POST /node/69b37bf1974c91e64560f7ac HTTP/1.0" 202 Accepted 2026-03-15 02:52:54,005 - lava_callback - INFO - Starting async job submit for node 69b37bf1974c91e64560f7ac 2026-03-15 02:52:54,005 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 02:52:54,023 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b37bf1974c91e64560f7ac HTTP/1.1" 200 None 2026-03-15 02:52:54,023 - lava_callback - DEBUG - Processing node 69b37bf1974c91e64560f7ac: baseline-arm-clabbe 2026-03-15 02:52:54,024 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b37bf1974c91e64560f7ac 2026-03-15 02:52:54,024 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 02:52:54,060 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b37bf1974c91e64560f7ac HTTP/1.1" 200 None 2026-03-15 02:52:54,062 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 02:52:54,083 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b276654bce73bcf0233d14 HTTP/1.1" 200 None 2026-03-15 02:52:54,085 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 02:52:54,106 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b37bf1974c91e64560f7ac HTTP/1.1" 200 None 2026-03-15 02:52:54,107 - lava_callback - ERROR - Error processing callback for node 69b37bf1974c91e64560f7ac: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:37622 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33786 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50958 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:50960 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60830 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33798 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33256 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60136 - "GET / HTTP/1.0" 200 OK 2026-03-15 02:53:53,982 - lava_callback - INFO - Received callback for node 69b37c2d974c91e64560f7c0 INFO: 172.21.0.1:60146 - "POST /node/69b37c2d974c91e64560f7c0 HTTP/1.0" 202 Accepted 2026-03-15 02:53:53,987 - lava_callback - INFO - Starting async job submit for node 69b37c2d974c91e64560f7c0 2026-03-15 02:53:53,988 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 02:53:54,006 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b37c2d974c91e64560f7c0 HTTP/1.1" 200 None 2026-03-15 02:53:54,007 - lava_callback - DEBUG - Processing node 69b37c2d974c91e64560f7c0: baseline-arm-clabbe 2026-03-15 02:53:54,007 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b37c2d974c91e64560f7c0 2026-03-15 02:53:54,008 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 02:53:54,021 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b37c2d974c91e64560f7c0 HTTP/1.1" 200 None 2026-03-15 02:53:54,022 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 02:53:54,036 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b276654bce73bcf0233d14 HTTP/1.1" 200 None 2026-03-15 02:53:54,037 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 02:53:54,058 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b37c2d974c91e64560f7c0 HTTP/1.1" 200 None 2026-03-15 02:53:54,059 - lava_callback - ERROR - Error processing callback for node 69b37c2d974c91e64560f7c0: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:60148 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38408 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40734 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:40744 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46604 - "GET / HTTP/1.0" 200 OK 2026-03-15 02:54:34,024 - lava_callback - INFO - Received callback for node 69b37c56974c91e64560f7d1 INFO: 172.21.0.1:59236 - "POST /node/69b37c56974c91e64560f7d1 HTTP/1.0" 202 Accepted 2026-03-15 02:54:34,029 - lava_callback - INFO - Starting async job submit for node 69b37c56974c91e64560f7d1 2026-03-15 02:54:34,030 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 02:54:34,052 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b37c56974c91e64560f7d1 HTTP/1.1" 200 None 2026-03-15 02:54:34,052 - lava_callback - DEBUG - Processing node 69b37c56974c91e64560f7d1: baseline-arm-clabbe 2026-03-15 02:54:34,053 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b37c56974c91e64560f7d1 2026-03-15 02:54:34,053 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 02:54:34,071 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b37c56974c91e64560f7d1 HTTP/1.1" 200 None 2026-03-15 02:54:34,072 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 02:54:34,086 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b276654bce73bcf0233d14 HTTP/1.1" 200 None 2026-03-15 02:54:34,088 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 02:54:34,108 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b37c56974c91e64560f7d1 HTTP/1.1" 200 None 2026-03-15 02:54:34,110 - lava_callback - ERROR - Error processing callback for node 69b37c56974c91e64560f7d1: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:59240 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37286 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40410 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40426 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49960 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58520 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:58524 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51690 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50328 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54490 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43516 - "GET / HTTP/1.0" 200 OK 2026-03-15 02:55:54,097 - lava_callback - INFO - Received callback for node 69b37ca6974c91e64560f7e4 INFO: 172.21.0.1:43520 - "POST /node/69b37ca6974c91e64560f7e4 HTTP/1.0" 202 Accepted 2026-03-15 02:55:54,103 - lava_callback - INFO - Starting async job submit for node 69b37ca6974c91e64560f7e4 2026-03-15 02:55:54,104 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 02:55:54,118 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b37ca6974c91e64560f7e4 HTTP/1.1" 200 None 2026-03-15 02:55:54,119 - lava_callback - DEBUG - Processing node 69b37ca6974c91e64560f7e4: baseline-arm-clabbe 2026-03-15 02:55:54,119 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b37ca6974c91e64560f7e4 2026-03-15 02:55:54,119 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 02:55:54,133 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b37ca6974c91e64560f7e4 HTTP/1.1" 200 None 2026-03-15 02:55:54,134 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 02:55:54,147 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b276654bce73bcf0233d14 HTTP/1.1" 200 None 2026-03-15 02:55:54,149 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 02:55:54,182 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b37ca6974c91e64560f7e4 HTTP/1.1" 200 None 2026-03-15 02:55:54,184 - lava_callback - ERROR - Error processing callback for node 69b37ca6974c91e64560f7e4: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:43530 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57034 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47698 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:47706 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49734 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56468 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39972 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41172 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41184 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51674 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41140 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:41156 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56232 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50552 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45276 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40066 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40068 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50816 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39436 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:39440 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50294 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47986 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45572 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34752 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34758 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37430 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42598 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:42612 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58346 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56086 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59370 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34950 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34954 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56788 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48510 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:48516 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58652 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47014 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47072 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58592 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58604 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42510 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36726 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:36732 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51636 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49256 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44756 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33264 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33272 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51210 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58814 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:58822 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44620 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40902 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57578 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56268 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56270 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48802 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45304 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:45320 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36720 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:32918 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45492 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47110 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47116 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45892 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36500 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:36516 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60546 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54146 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52116 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37996 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38002 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36646 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38616 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:38622 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41100 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51708 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37796 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:32886 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:32888 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47990 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33244 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:33248 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33786 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44922 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54742 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44044 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44054 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46542 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42746 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:42762 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33854 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39242 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44112 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51586 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51596 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49416 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39870 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:39878 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50272 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49694 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46308 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37742 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37748 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36720 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47148 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:47164 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45062 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35768 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37216 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45048 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45054 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55592 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49126 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:49134 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44158 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56238 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53612 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34080 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34082 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50550 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38488 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:38494 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42508 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34358 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40862 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53670 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53672 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57490 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44510 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:44522 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37744 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56234 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50582 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60690 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60706 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43506 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58474 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:58476 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41432 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36282 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56408 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49860 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49874 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56814 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45988 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:45994 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55460 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57220 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42146 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37690 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37692 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49894 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33044 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:33060 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40324 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38406 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58060 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44362 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44372 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43164 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44170 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:44174 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54106 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46890 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56574 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60602 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60606 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33532 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57820 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:57830 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53600 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52050 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50354 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52832 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52836 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58302 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43682 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:43686 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43770 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58580 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46658 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52610 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52624 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49776 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51746 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:51756 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59540 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46184 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60116 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55034 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55046 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52884 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43674 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:43680 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43298 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40648 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33982 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34810 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34818 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52734 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60116 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:60132 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57222 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52852 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47870 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35180 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35184 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:32774 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43624 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:43640 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59210 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34324 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39060 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46448 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46452 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47644 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44374 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:44390 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36106 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58952 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35432 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43468 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43484 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36748 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56286 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:56300 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59278 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59234 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41298 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60272 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60278 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46112 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40472 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:40480 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39050 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41682 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51778 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48596 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48606 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56956 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40244 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:40256 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50330 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51310 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39394 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56698 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56704 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45614 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51506 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:51512 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46618 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51442 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33452 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56536 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56540 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55376 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59110 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:59124 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56328 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54416 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56006 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41220 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41230 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36166 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53732 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:53746 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50796 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45938 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36316 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41956 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41962 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51214 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34464 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:34474 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33644 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54874 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39214 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52628 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52644 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43458 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59776 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:59788 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40716 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59492 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38764 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34022 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34030 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42588 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46468 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:46470 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42950 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:32828 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54708 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43996 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44008 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49268 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:32886 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:32900 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38068 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49222 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41650 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41694 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41702 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40300 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43868 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:43876 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35888 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37194 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37456 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34540 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34552 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40976 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55288 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:55298 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44566 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37912 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56080 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39036 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39040 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38002 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60480 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:60492 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58340 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35506 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35488 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47638 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47646 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45642 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42132 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:42142 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49482 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35516 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57038 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57388 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57396 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53266 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50986 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:51002 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42428 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42198 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47964 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43882 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43892 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59202 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41888 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:41896 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50998 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36090 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59470 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48852 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48854 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36006 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53724 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:53728 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46046 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33242 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43936 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39568 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39582 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60838 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51894 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:51896 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36500 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50834 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56062 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52684 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52692 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50996 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46042 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:46046 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54940 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42282 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60476 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51444 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51450 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57696 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41370 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:41372 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58354 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52116 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51024 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42242 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42258 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36782 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60370 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:60378 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58850 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35550 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33652 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43786 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43796 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42318 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59874 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:59888 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49138 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54114 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40044 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38216 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38228 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43180 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40206 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:40222 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46260 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41174 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49280 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53880 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53884 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46112 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41696 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:41708 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51856 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44168 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42938 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53292 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53306 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52604 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42738 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:42746 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58020 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36758 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50938 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59544 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59548 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59162 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55888 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:55894 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43116 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54954 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33850 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50252 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50256 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54552 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60106 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:60122 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52730 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48582 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55244 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33068 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33080 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42778 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41500 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:41510 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53130 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51070 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36068 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35198 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35206 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48858 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35176 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:35180 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42332 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37814 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55768 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58850 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58866 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57850 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49876 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:49878 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41158 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57500 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40402 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33786 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33794 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58862 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44276 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:44284 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52628 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51310 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49554 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44730 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44734 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60434 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45024 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:45040 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39242 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54960 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45532 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33704 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33718 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59624 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54856 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:54862 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36404 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53628 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33080 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45744 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45754 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51264 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56240 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:56242 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47276 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35450 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60018 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44268 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44282 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52258 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51778 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:51790 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35070 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43998 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57894 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53594 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53610 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37276 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47414 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:47422 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51996 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38194 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54876 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34380 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34386 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36376 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37856 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:37872 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35698 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38270 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54910 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39038 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39044 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55376 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55240 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:55246 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42644 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44426 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45700 - "GET / HTTP/1.0" 200 OK 2026-03-15 04:01:54,385 - lava_callback - INFO - Received callback for node 69b38c2f974c91e64560f95a INFO: 172.21.0.1:47160 - "POST /node/69b38c2f974c91e64560f95a HTTP/1.0" 202 Accepted 2026-03-15 04:01:54,390 - lava_callback - INFO - Starting async job submit for node 69b38c2f974c91e64560f95a 2026-03-15 04:01:54,391 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 04:01:54,411 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b38c2f974c91e64560f95a HTTP/1.1" 200 None 2026-03-15 04:01:54,412 - lava_callback - DEBUG - Processing node 69b38c2f974c91e64560f95a: baseline-arm64-baylibre 2026-03-15 04:01:54,412 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b38c2f974c91e64560f95a 2026-03-15 04:01:54,413 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 04:01:54,426 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b38c2f974c91e64560f95a HTTP/1.1" 200 None 2026-03-15 04:01:54,428 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 04:01:54,465 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b276764bce73bcf0233d23 HTTP/1.1" 200 None 2026-03-15 04:01:54,467 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 INFO: 172.21.0.1:47172 - "GET / HTTP/1.0" 200 OK 2026-03-15 04:01:54,495 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b38c2f974c91e64560f95a HTTP/1.1" 200 None 2026-03-15 04:01:54,498 - lava_callback - ERROR - Error processing callback for node 69b38c2f974c91e64560f95a: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:47178 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56264 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56504 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:56506 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33658 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59794 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44118 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44358 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44368 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56818 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42070 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:42074 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52240 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54058 - "GET / HTTP/1.0" 200 OK 2026-03-15 04:03:37,140 - lava_callback - INFO - Received callback for node 69b38c88974c91e64560f982 INFO: 172.21.0.1:54060 - "POST /node/69b38c88974c91e64560f982 HTTP/1.0" 202 Accepted 2026-03-15 04:03:37,145 - lava_callback - INFO - Starting async job submit for node 69b38c88974c91e64560f982 2026-03-15 04:03:37,146 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 04:03:37,164 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b38c88974c91e64560f982 HTTP/1.1" 200 None 2026-03-15 04:03:37,165 - lava_callback - DEBUG - Processing node 69b38c88974c91e64560f982: baseline-arm64-clabbe 2026-03-15 04:03:37,165 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b38c88974c91e64560f982 2026-03-15 04:03:37,166 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 04:03:37,179 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b38c88974c91e64560f982 HTTP/1.1" 200 None 2026-03-15 04:03:37,181 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 04:03:37,204 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b276764bce73bcf0233d23 HTTP/1.1" 200 None 2026-03-15 04:03:37,206 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 04:03:37,236 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b38c88974c91e64560f982 HTTP/1.1" 200 None 2026-03-15 04:03:37,237 - lava_callback - ERROR - Error processing callback for node 69b38c88974c91e64560f982: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:42780 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34690 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34704 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49660 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60356 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:60372 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43904 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60888 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47984 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51804 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51816 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40784 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45480 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:45490 - "GET / HTTP/1.0" 200 OK 2026-03-15 04:05:17,138 - lava_callback - INFO - Received callback for node 69b38ce7974c91e64560f99f INFO: 172.21.0.1:45494 - "POST /node/69b38ce7974c91e64560f99f HTTP/1.0" 202 Accepted 2026-03-15 04:05:17,143 - lava_callback - INFO - Starting async job submit for node 69b38ce7974c91e64560f99f 2026-03-15 04:05:17,144 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 04:05:17,188 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b38ce7974c91e64560f99f HTTP/1.1" 200 None 2026-03-15 04:05:17,189 - lava_callback - DEBUG - Processing node 69b38ce7974c91e64560f99f: baseline-arm64-clabbe 2026-03-15 04:05:17,189 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b38ce7974c91e64560f99f 2026-03-15 04:05:17,190 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 04:05:17,204 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b38ce7974c91e64560f99f HTTP/1.1" 200 None 2026-03-15 04:05:17,205 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 04:05:17,228 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b276764bce73bcf0233d23 HTTP/1.1" 200 None 2026-03-15 04:05:17,229 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 04:05:17,250 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b38ce7974c91e64560f99f HTTP/1.1" 200 None 2026-03-15 04:05:17,251 - lava_callback - ERROR - Error processing callback for node 69b38ce7974c91e64560f99f: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:49328 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38362 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52502 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52242 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52258 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55452 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51490 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:51502 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43540 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55278 - "GET / HTTP/1.0" 200 OK 2026-03-15 04:06:37,219 - lava_callback - INFO - Received callback for node 69b38d3a974c91e64560f9c5 INFO: 172.21.0.1:55294 - "POST /node/69b38d3a974c91e64560f9c5 HTTP/1.0" 202 Accepted 2026-03-15 04:06:37,224 - lava_callback - INFO - Starting async job submit for node 69b38d3a974c91e64560f9c5 2026-03-15 04:06:37,225 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 04:06:37,240 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b38d3a974c91e64560f9c5 HTTP/1.1" 200 None 2026-03-15 04:06:37,240 - lava_callback - DEBUG - Processing node 69b38d3a974c91e64560f9c5: baseline-arm64-clabbe 2026-03-15 04:06:37,241 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b38d3a974c91e64560f9c5 2026-03-15 04:06:37,241 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 04:06:37,266 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b38d3a974c91e64560f9c5 HTTP/1.1" 200 None 2026-03-15 04:06:37,267 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 04:06:37,280 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b276764bce73bcf0233d23 HTTP/1.1" 200 None 2026-03-15 04:06:37,282 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 04:06:37,311 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b38d3a974c91e64560f9c5 HTTP/1.1" 200 None 2026-03-15 04:06:37,316 - lava_callback - ERROR - Error processing callback for node 69b38d3a974c91e64560f9c5: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:38578 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42334 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42336 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56022 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56074 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:56078 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36590 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37242 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57170 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46612 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46622 - "GET / HTTP/1.0" 200 OK 2026-03-15 04:07:57,232 - lava_callback - INFO - Received callback for node 69b38d8d974c91e64560f9ed INFO: 172.21.0.1:46624 - "POST /node/69b38d8d974c91e64560f9ed HTTP/1.0" 202 Accepted 2026-03-15 04:07:57,238 - lava_callback - INFO - Starting async job submit for node 69b38d8d974c91e64560f9ed 2026-03-15 04:07:57,239 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 04:07:57,253 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b38d8d974c91e64560f9ed HTTP/1.1" 200 None 2026-03-15 04:07:57,254 - lava_callback - DEBUG - Processing node 69b38d8d974c91e64560f9ed: baseline-arm64-clabbe 2026-03-15 04:07:57,254 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b38d8d974c91e64560f9ed 2026-03-15 04:07:57,255 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 04:07:57,278 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b38d8d974c91e64560f9ed HTTP/1.1" 200 None 2026-03-15 04:07:57,280 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 04:07:57,302 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b276764bce73bcf0233d23 HTTP/1.1" 200 None 2026-03-15 04:07:57,304 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 04:07:57,325 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b38d8d974c91e64560f9ed HTTP/1.1" 200 None 2026-03-15 04:07:57,326 - lava_callback - ERROR - Error processing callback for node 69b38d8d974c91e64560f9ed: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:41884 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46316 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:46332 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56654 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57724 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33662 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39076 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39080 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39420 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54474 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:54480 - "GET / HTTP/1.0" 200 OK 2026-03-15 04:09:17,304 - lava_callback - INFO - Received callback for node 69b38de1974c91e64560f9fb INFO: 172.21.0.1:54490 - "POST /node/69b38de1974c91e64560f9fb HTTP/1.0" 202 Accepted 2026-03-15 04:09:17,310 - lava_callback - INFO - Starting async job submit for node 69b38de1974c91e64560f9fb 2026-03-15 04:09:17,311 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 04:09:17,326 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b38de1974c91e64560f9fb HTTP/1.1" 200 None 2026-03-15 04:09:17,326 - lava_callback - DEBUG - Processing node 69b38de1974c91e64560f9fb: baseline-arm64-clabbe 2026-03-15 04:09:17,327 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b38de1974c91e64560f9fb 2026-03-15 04:09:17,327 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 04:09:17,344 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b38de1974c91e64560f9fb HTTP/1.1" 200 None 2026-03-15 04:09:17,346 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 04:09:17,360 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b276764bce73bcf0233d23 HTTP/1.1" 200 None 2026-03-15 04:09:17,362 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 04:09:17,388 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b38de1974c91e64560f9fb HTTP/1.1" 200 None 2026-03-15 04:09:17,390 - lava_callback - ERROR - Error processing callback for node 69b38de1974c91e64560f9fb: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:55378 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34564 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48420 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36502 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36506 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35452 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42872 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:42880 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56728 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51070 - "GET / HTTP/1.0" 200 OK 2026-03-15 04:10:37,410 - lava_callback - INFO - Received callback for node 69b38e36974c91e64560fa0e INFO: 172.21.0.1:51086 - "POST /node/69b38e36974c91e64560fa0e HTTP/1.0" 202 Accepted 2026-03-15 04:10:37,416 - lava_callback - INFO - Starting async job submit for node 69b38e36974c91e64560fa0e 2026-03-15 04:10:37,416 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 04:10:37,464 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b38e36974c91e64560fa0e HTTP/1.1" 200 None 2026-03-15 04:10:37,465 - lava_callback - DEBUG - Processing node 69b38e36974c91e64560fa0e: baseline-arm64-clabbe 2026-03-15 04:10:37,465 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b38e36974c91e64560fa0e 2026-03-15 04:10:37,466 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 04:10:37,488 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b38e36974c91e64560fa0e HTTP/1.1" 200 None 2026-03-15 04:10:37,489 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 04:10:37,503 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b276764bce73bcf0233d23 HTTP/1.1" 200 None 2026-03-15 04:10:37,504 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 04:10:37,542 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b38e36974c91e64560fa0e HTTP/1.1" 200 None 2026-03-15 04:10:37,544 - lava_callback - ERROR - Error processing callback for node 69b38e36974c91e64560fa0e: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:47480 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55544 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55548 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50590 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39626 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:39638 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54434 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54418 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58154 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55642 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55656 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47754 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36826 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:36834 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38306 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47766 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55060 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54264 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54268 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53156 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36600 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:36606 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46758 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53810 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49024 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51222 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51232 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43118 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45110 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:45114 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34806 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47712 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36600 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35954 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35968 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52906 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53306 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:53310 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47008 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48928 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51454 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36210 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36212 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41102 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43270 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:43284 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34100 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36516 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47876 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55298 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55304 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42184 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55838 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:55848 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55730 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46572 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46610 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46084 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46100 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50530 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52556 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:52562 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44676 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54366 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33696 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44252 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44260 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60136 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46356 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:46364 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35134 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50050 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34756 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45302 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45318 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54774 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44684 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:44686 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40096 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37860 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45928 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34968 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34970 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41034 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36650 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:36658 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45836 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52322 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45114 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55208 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55210 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40220 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56658 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:56660 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57158 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55508 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40896 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56650 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56664 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47092 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37820 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:37828 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50308 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57978 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39476 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33332 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33346 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52666 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47868 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:47870 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53526 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40516 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57168 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35874 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35886 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59728 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56380 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:56382 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58850 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41300 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42882 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:32868 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:32880 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33026 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60972 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:60978 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38658 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34854 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47764 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36876 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36888 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55604 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52416 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:52428 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52504 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53618 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53634 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40130 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40454 - "GET /favicon.ico HTTP/1.0" 404 Not Found INFO: 172.21.0.1:40466 - "GET /robots.txt HTTP/1.0" 404 Not Found INFO: 172.21.0.1:40470 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40474 - "GET /sitemap.xml HTTP/1.0" 404 Not Found INFO: 172.21.0.1:40482 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55502 - "GET /config.json HTTP/1.0" 404 Not Found INFO: 172.21.0.1:55508 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55238 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:55244 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38950 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47196 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50830 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59888 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59898 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47554 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42446 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:42450 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38544 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40388 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48546 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38276 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38290 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50374 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39656 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:39668 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50460 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37360 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35872 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59506 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59522 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51340 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36444 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:36450 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38490 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51212 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45334 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44150 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44156 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47228 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55592 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:55608 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57530 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60778 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52406 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43592 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43598 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51414 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35546 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:35554 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35256 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40918 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47184 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42604 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42612 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58370 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33030 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:33040 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53574 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49084 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47170 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40220 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40232 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52086 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59476 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:59482 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55672 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46160 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49140 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36754 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36760 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60238 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37792 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:37808 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43164 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47642 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58002 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40092 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40104 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40446 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39006 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:39010 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37152 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58070 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34056 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52894 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52910 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51742 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58462 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:58472 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38546 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36150 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55666 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53704 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53714 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43102 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35380 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:35392 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45312 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34534 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60346 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50294 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50300 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40246 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57666 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:57682 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55926 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59550 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58158 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58498 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58504 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43364 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49726 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:49742 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39422 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59180 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43128 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55244 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55250 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58254 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42818 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:42822 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56278 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55272 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50392 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52652 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52666 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40112 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58518 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:58530 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38582 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60412 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33260 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56030 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56042 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42082 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45902 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:45918 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49036 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44880 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43386 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41382 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41396 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49606 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41098 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:41102 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38948 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39638 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34866 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54250 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54256 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39176 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54268 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:54270 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39540 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52918 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58844 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43902 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43908 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55060 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46012 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:46024 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54394 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40962 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55894 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34150 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34164 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47046 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42124 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:42132 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35598 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42424 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42978 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45716 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45720 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34046 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45904 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:45912 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41784 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37660 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49112 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56764 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56770 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60738 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51236 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:51244 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42198 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43268 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37200 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59714 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59722 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45244 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39858 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:39868 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59896 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60812 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46830 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43132 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43138 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59620 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57480 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:57488 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51018 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58990 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48690 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60602 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60608 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51154 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46268 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:46274 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37998 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55226 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43946 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55916 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55920 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34798 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57340 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:57350 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38882 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44420 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37448 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44026 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44042 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33052 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51564 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:51574 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58196 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50306 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51500 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34638 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34652 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57088 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39774 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:39776 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53922 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56038 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54374 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38702 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38706 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49460 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44842 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:44844 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44518 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35792 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43258 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:32932 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:32936 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60032 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56952 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:56966 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56640 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:32862 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55254 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33132 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33146 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43700 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44920 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:44930 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49734 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41444 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36614 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45176 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45192 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39308 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45628 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:45630 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58822 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39856 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52504 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43376 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43384 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44082 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59774 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:59790 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39484 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40938 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49994 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41170 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41180 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58644 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58490 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:58502 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42552 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35498 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39318 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47668 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47672 - "GET / HTTP/1.0" 200 OK 2026-03-15 05:02:57,710 - lava_callback - INFO - Received callback for node 69b39a7e974c91e64560faef INFO: 172.21.0.1:47684 - "POST /node/69b39a7e974c91e64560faef HTTP/1.0" 202 Accepted 2026-03-15 05:02:57,715 - lava_callback - INFO - Starting async job submit for node 69b39a7e974c91e64560faef 2026-03-15 05:02:57,716 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 05:02:57,740 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b39a7e974c91e64560faef HTTP/1.1" 200 None 2026-03-15 05:02:57,741 - lava_callback - DEBUG - Processing node 69b39a7e974c91e64560faef: baseline-arm64-baylibre 2026-03-15 05:02:57,741 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b39a7e974c91e64560faef 2026-03-15 05:02:57,742 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 05:02:57,755 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b39a7e974c91e64560faef HTTP/1.1" 200 None 2026-03-15 05:02:57,756 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 05:02:57,769 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b2e73e6267e2e450f02132 HTTP/1.1" 200 None 2026-03-15 05:02:57,771 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 05:02:57,804 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b39a7e974c91e64560faef HTTP/1.1" 200 None 2026-03-15 05:02:57,806 - lava_callback - ERROR - Error processing callback for node 69b39a7e974c91e64560faef: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:38138 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35874 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:35882 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33152 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39596 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41230 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40318 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40322 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44140 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47988 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:47992 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49064 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59982 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45100 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40142 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40150 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36232 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59328 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:59332 - "GET / HTTP/1.0" 200 OK 2026-03-15 05:05:19,848 - lava_callback - INFO - Received callback for node 69b39aff974c91e64560fb08 INFO: 172.21.0.1:56228 - "POST /node/69b39aff974c91e64560fb08 HTTP/1.0" 202 Accepted 2026-03-15 05:05:19,853 - lava_callback - INFO - Starting async job submit for node 69b39aff974c91e64560fb08 2026-03-15 05:05:19,854 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 05:05:19,871 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b39aff974c91e64560fb08 HTTP/1.1" 200 None 2026-03-15 05:05:19,872 - lava_callback - DEBUG - Processing node 69b39aff974c91e64560fb08: baseline-arm64-clabbe 2026-03-15 05:05:19,872 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b39aff974c91e64560fb08 2026-03-15 05:05:19,873 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 05:05:19,896 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b39aff974c91e64560fb08 HTTP/1.1" 200 None 2026-03-15 05:05:19,897 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 05:05:19,921 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b2e73e6267e2e450f02132 HTTP/1.1" 200 None 2026-03-15 05:05:19,923 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 05:05:19,943 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b39aff974c91e64560fb08 HTTP/1.1" 200 None 2026-03-15 05:05:19,945 - lava_callback - ERROR - Error processing callback for node 69b39aff974c91e64560fb08: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:56236 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58662 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34408 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33534 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33548 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38492 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39190 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:39204 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38648 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42662 - "GET / HTTP/1.0" 200 OK 2026-03-15 05:06:39,868 - lava_callback - INFO - Received callback for node 69b39b51974c91e64560fb1c INFO: 172.21.0.1:39896 - "POST /node/69b39b51974c91e64560fb1c HTTP/1.0" 202 Accepted 2026-03-15 05:06:39,874 - lava_callback - INFO - Starting async job submit for node 69b39b51974c91e64560fb1c 2026-03-15 05:06:39,875 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 05:06:39,889 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b39b51974c91e64560fb1c HTTP/1.1" 200 None 2026-03-15 05:06:39,890 - lava_callback - DEBUG - Processing node 69b39b51974c91e64560fb1c: baseline-arm64-clabbe 2026-03-15 05:06:39,890 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b39b51974c91e64560fb1c 2026-03-15 05:06:39,891 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 05:06:39,904 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b39b51974c91e64560fb1c HTTP/1.1" 200 None 2026-03-15 05:06:39,905 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 05:06:39,930 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b2e73e6267e2e450f02132 HTTP/1.1" 200 None 2026-03-15 05:06:39,932 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 05:06:39,953 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b39b51974c91e64560fb1c HTTP/1.1" 200 None 2026-03-15 05:06:39,958 - lava_callback - ERROR - Error processing callback for node 69b39b51974c91e64560fb1c: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:39910 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40826 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40830 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46806 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34952 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:34962 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40548 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33278 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44624 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52432 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52438 - "GET / HTTP/1.0" 200 OK 2026-03-15 05:07:59,958 - lava_callback - INFO - Received callback for node 69b39ba3974c91e64560fb2c INFO: 172.21.0.1:51642 - "POST /node/69b39ba3974c91e64560fb2c HTTP/1.0" 202 Accepted 2026-03-15 05:07:59,963 - lava_callback - INFO - Starting async job submit for node 69b39ba3974c91e64560fb2c 2026-03-15 05:07:59,964 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 05:07:59,979 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b39ba3974c91e64560fb2c HTTP/1.1" 200 None 2026-03-15 05:07:59,980 - lava_callback - DEBUG - Processing node 69b39ba3974c91e64560fb2c: baseline-arm64-clabbe 2026-03-15 05:07:59,980 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b39ba3974c91e64560fb2c 2026-03-15 05:07:59,981 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 05:07:59,994 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b39ba3974c91e64560fb2c HTTP/1.1" 200 None 2026-03-15 05:07:59,995 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 05:08:00,009 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b2e73e6267e2e450f02132 HTTP/1.1" 200 None 2026-03-15 05:08:00,010 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 05:08:00,036 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b39ba3974c91e64560fb2c HTTP/1.1" 200 None 2026-03-15 05:08:00,037 - lava_callback - ERROR - Error processing callback for node 69b39ba3974c91e64560fb2c: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:51658 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47342 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:47358 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36990 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44416 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37044 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50654 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50656 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39406 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46492 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:46506 - "GET / HTTP/1.0" 200 OK 2026-03-15 05:09:20,023 - lava_callback - INFO - Received callback for node 69b39bf3974c91e64560fb44 INFO: 172.21.0.1:38788 - "POST /node/69b39bf3974c91e64560fb44 HTTP/1.0" 202 Accepted 2026-03-15 05:09:20,028 - lava_callback - INFO - Starting async job submit for node 69b39bf3974c91e64560fb44 2026-03-15 05:09:20,029 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 05:09:20,054 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b39bf3974c91e64560fb44 HTTP/1.1" 200 None 2026-03-15 05:09:20,055 - lava_callback - DEBUG - Processing node 69b39bf3974c91e64560fb44: baseline-arm64-clabbe 2026-03-15 05:09:20,055 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b39bf3974c91e64560fb44 2026-03-15 05:09:20,055 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 05:09:20,069 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b39bf3974c91e64560fb44 HTTP/1.1" 200 None 2026-03-15 05:09:20,070 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 05:09:20,084 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b2e73e6267e2e450f02132 HTTP/1.1" 200 None 2026-03-15 05:09:20,085 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 05:09:20,110 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b39bf3974c91e64560fb44 HTTP/1.1" 200 None 2026-03-15 05:09:20,124 - lava_callback - ERROR - Error processing callback for node 69b39bf3974c91e64560fb44: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:38796 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52188 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53742 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54564 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54580 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34444 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34944 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:34958 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55170 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43532 - "GET / HTTP/1.0" 200 OK 2026-03-15 05:10:40,088 - lava_callback - INFO - Received callback for node 69b39c46974c91e64560fb5a INFO: 172.21.0.1:45562 - "POST /node/69b39c46974c91e64560fb5a HTTP/1.0" 202 Accepted 2026-03-15 05:10:40,094 - lava_callback - INFO - Starting async job submit for node 69b39c46974c91e64560fb5a 2026-03-15 05:10:40,095 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 05:10:40,109 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b39c46974c91e64560fb5a HTTP/1.1" 200 None 2026-03-15 05:10:40,110 - lava_callback - DEBUG - Processing node 69b39c46974c91e64560fb5a: baseline-arm64-clabbe 2026-03-15 05:10:40,110 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b39c46974c91e64560fb5a 2026-03-15 05:10:40,111 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 05:10:40,124 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b39c46974c91e64560fb5a HTTP/1.1" 200 None 2026-03-15 05:10:40,125 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 05:10:40,138 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b2e73e6267e2e450f02132 HTTP/1.1" 200 None 2026-03-15 05:10:40,140 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 05:10:40,160 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b39c46974c91e64560fb5a HTTP/1.1" 200 None 2026-03-15 05:10:40,161 - lava_callback - ERROR - Error processing callback for node 69b39c46974c91e64560fb5a: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:45574 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51302 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51312 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50026 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40934 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:40944 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38272 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60706 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57582 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33956 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33958 - "GET / HTTP/1.0" 200 OK 2026-03-15 05:12:00,160 - lava_callback - INFO - Received callback for node 69b39c9b974c91e64560fb6f INFO: 172.21.0.1:59084 - "POST /node/69b39c9b974c91e64560fb6f HTTP/1.0" 202 Accepted 2026-03-15 05:12:00,166 - lava_callback - INFO - Starting async job submit for node 69b39c9b974c91e64560fb6f 2026-03-15 05:12:00,167 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 05:12:00,186 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b39c9b974c91e64560fb6f HTTP/1.1" 200 None 2026-03-15 05:12:00,187 - lava_callback - DEBUG - Processing node 69b39c9b974c91e64560fb6f: baseline-arm64-clabbe 2026-03-15 05:12:00,187 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b39c9b974c91e64560fb6f 2026-03-15 05:12:00,188 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 05:12:00,201 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b39c9b974c91e64560fb6f HTTP/1.1" 200 None 2026-03-15 05:12:00,203 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 05:12:00,216 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b2e73e6267e2e450f02132 HTTP/1.1" 200 None 2026-03-15 05:12:00,217 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 05:12:00,243 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b39c9b974c91e64560fb6f HTTP/1.1" 200 None 2026-03-15 05:12:00,245 - lava_callback - ERROR - Error processing callback for node 69b39c9b974c91e64560fb6f: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:59092 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43674 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:43684 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48678 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56042 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60986 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34830 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34838 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49644 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48792 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:48796 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47754 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52328 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47166 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48484 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48486 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44948 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48398 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:48410 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34662 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40246 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35824 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52796 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52806 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51326 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49266 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:49276 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53994 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41522 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52208 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38090 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38096 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48492 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58284 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:58294 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46972 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43408 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50922 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57020 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57030 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44544 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48212 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:48222 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51482 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37398 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40414 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46402 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46404 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55202 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43858 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:43870 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52114 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59482 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33026 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59064 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59072 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52722 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47194 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:47208 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35632 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53412 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48220 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49512 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49518 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56002 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51524 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:51532 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39984 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48658 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55004 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42728 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42732 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38110 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58434 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:58448 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34534 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35260 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43664 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48022 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48024 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34850 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53860 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:53868 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46866 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34350 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52952 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52126 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52128 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38190 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43114 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:43116 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51684 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38178 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33722 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49286 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49300 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46302 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35868 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:35882 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45188 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42976 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34192 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51162 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51176 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44022 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38356 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:38370 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56182 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55328 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40848 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60560 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60570 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46180 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37798 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:37812 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44418 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35502 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57422 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37470 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37486 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52028 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41830 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:41836 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36406 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35556 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60698 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47634 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47644 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47882 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56394 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:56410 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37904 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56914 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37254 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59516 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59522 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43606 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40876 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:40890 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56574 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55096 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49028 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59790 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59806 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59772 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58002 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:58016 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56408 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35290 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53444 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45178 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45190 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35058 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42686 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:42688 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33266 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51150 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52102 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37400 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37414 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45852 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53614 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:53624 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54460 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47502 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49322 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42822 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42838 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44796 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39604 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:39620 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37742 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54268 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39974 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39932 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39944 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51048 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49328 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:49330 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53326 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34482 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55096 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34596 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34612 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47464 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46836 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:46852 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38538 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41576 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36588 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57370 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57386 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53260 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48232 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:48244 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39548 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38536 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56586 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56130 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56136 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43260 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36308 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:36320 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57804 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37224 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55344 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39604 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39608 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38068 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45168 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:45170 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35250 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37986 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56374 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38288 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38298 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44624 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48626 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:48628 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42754 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55784 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57778 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51452 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51462 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55302 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41764 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:41772 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42052 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43006 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35896 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57764 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57780 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58668 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34170 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:34176 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57404 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43230 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53922 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43436 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43452 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34220 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47814 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:47828 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43684 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46204 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33988 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45994 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46004 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58612 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42998 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:43002 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58420 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55820 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60548 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46882 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46894 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42286 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48954 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:48958 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53266 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50526 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51108 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60490 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60500 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34966 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58948 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:58950 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34788 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52770 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53404 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53434 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53436 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37468 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57986 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:58002 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43160 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37304 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36632 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59830 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59840 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46832 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44990 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:44998 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60776 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35248 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39912 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56738 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56742 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49468 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60306 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:60308 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60154 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48522 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48698 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38804 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38806 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46190 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55536 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:55540 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60072 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34706 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33684 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38862 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38864 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44022 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44470 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:44474 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37708 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33576 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46996 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34120 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34132 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48086 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48518 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:48524 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36930 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36268 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58824 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39230 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39232 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52070 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33108 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:33116 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48192 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55576 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44120 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37984 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37994 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60910 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55228 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:55240 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42938 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37562 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52512 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59234 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59244 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47436 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39462 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:39476 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57402 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38250 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39136 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45018 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45028 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56676 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36186 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:36188 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37396 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35782 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39884 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52868 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52882 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55284 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53562 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:53572 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48220 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58108 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48598 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57240 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57252 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47412 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43762 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:43772 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38834 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44912 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39778 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38208 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38224 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48444 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47660 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:47666 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40544 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:32872 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35966 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41484 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41486 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43060 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50384 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:50396 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40532 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36770 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52454 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38794 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38800 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38402 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39642 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:39650 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47658 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59536 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48438 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44982 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44994 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45406 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56138 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:56148 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54322 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48118 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52882 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48720 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48728 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39822 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42348 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:42350 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53222 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56724 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60200 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42124 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42132 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40026 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34466 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:34468 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42416 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53230 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35982 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46746 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46752 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47040 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51828 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:51838 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49894 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39274 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53806 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42686 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42692 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42786 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55978 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:55980 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49916 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39058 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59862 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49222 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49238 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35334 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49380 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:49396 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58356 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35920 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36652 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58886 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58890 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40956 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53422 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:53426 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50576 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46176 - "GET / HTTP/1.0" 200 OK 2026-03-15 06:07:42,703 - lava_callback - INFO - Received callback for node 69b3a9a0974c91e64560fc21 INFO: 172.21.0.1:42144 - "POST /node/69b3a9a0974c91e64560fc21 HTTP/1.0" 202 Accepted 2026-03-15 06:07:42,708 - lava_callback - INFO - Starting async job submit for node 69b3a9a0974c91e64560fc21 2026-03-15 06:07:42,709 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 06:07:42,724 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b3a9a0974c91e64560fc21 HTTP/1.1" 200 None 2026-03-15 06:07:42,725 - lava_callback - DEBUG - Processing node 69b3a9a0974c91e64560fc21: baseline-arm-clabbe 2026-03-15 06:07:42,725 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b3a9a0974c91e64560fc21 2026-03-15 06:07:42,726 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 06:07:42,739 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b3a9a0974c91e64560fc21 HTTP/1.1" 200 None 2026-03-15 06:07:42,741 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 06:07:42,754 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b2e72a6267e2e450f0211d HTTP/1.1" 200 None 2026-03-15 06:07:42,756 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 06:07:42,777 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b3a9a0974c91e64560fc21 HTTP/1.1" 200 None 2026-03-15 06:07:42,784 - lava_callback - ERROR - Error processing callback for node 69b3a9a0974c91e64560fc21: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:42160 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54050 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54064 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39258 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41534 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:41544 - "GET / HTTP/1.0" 200 OK 2026-03-15 06:08:22,680 - lava_callback - INFO - Received callback for node 69b3a9c5974c91e64560fc2b INFO: 172.21.0.1:33320 - "POST /node/69b3a9c5974c91e64560fc2b HTTP/1.0" 202 Accepted 2026-03-15 06:08:22,685 - lava_callback - INFO - Starting async job submit for node 69b3a9c5974c91e64560fc2b 2026-03-15 06:08:22,686 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 06:08:22,700 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b3a9c5974c91e64560fc2b HTTP/1.1" 200 None 2026-03-15 06:08:22,701 - lava_callback - DEBUG - Processing node 69b3a9c5974c91e64560fc2b: baseline-arm-clabbe 2026-03-15 06:08:22,701 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b3a9c5974c91e64560fc2b 2026-03-15 06:08:22,702 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 06:08:22,715 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b3a9c5974c91e64560fc2b HTTP/1.1" 200 None 2026-03-15 06:08:22,717 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 06:08:22,730 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b2e72a6267e2e450f0211d HTTP/1.1" 200 None 2026-03-15 06:08:22,732 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 06:08:22,758 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b3a9c5974c91e64560fc2b HTTP/1.1" 200 None 2026-03-15 06:08:22,764 - lava_callback - ERROR - Error processing callback for node 69b3a9c5974c91e64560fc2b: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:33322 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33910 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52302 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58202 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58206 - "GET / HTTP/1.0" 200 OK 2026-03-15 06:09:02,769 - lava_callback - INFO - Received callback for node 69b3a9f4974c91e64560fc3c INFO: 172.21.0.1:58846 - "POST /node/69b3a9f4974c91e64560fc3c HTTP/1.0" 202 Accepted 2026-03-15 06:09:02,775 - lava_callback - INFO - Starting async job submit for node 69b3a9f4974c91e64560fc3c 2026-03-15 06:09:02,776 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 06:09:02,791 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b3a9f4974c91e64560fc3c HTTP/1.1" 200 None 2026-03-15 06:09:02,791 - lava_callback - DEBUG - Processing node 69b3a9f4974c91e64560fc3c: baseline-arm-clabbe 2026-03-15 06:09:02,792 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b3a9f4974c91e64560fc3c 2026-03-15 06:09:02,792 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 06:09:02,806 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b3a9f4974c91e64560fc3c HTTP/1.1" 200 None 2026-03-15 06:09:02,808 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 06:09:02,821 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b2e72a6267e2e450f0211d HTTP/1.1" 200 None 2026-03-15 06:09:02,823 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 06:09:02,843 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b3a9f4974c91e64560fc3c HTTP/1.1" 200 None 2026-03-15 06:09:02,847 - lava_callback - ERROR - Error processing callback for node 69b3a9f4974c91e64560fc3c: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:58852 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51894 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:51908 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46678 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35678 - "GET / HTTP/1.0" 200 OK 2026-03-15 06:09:42,755 - lava_callback - INFO - Received callback for node 69b3aa1a974c91e64560fc43 INFO: 172.21.0.1:52624 - "POST /node/69b3aa1a974c91e64560fc43 HTTP/1.0" 202 Accepted 2026-03-15 06:09:42,761 - lava_callback - INFO - Starting async job submit for node 69b3aa1a974c91e64560fc43 2026-03-15 06:09:42,762 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 06:09:42,776 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b3aa1a974c91e64560fc43 HTTP/1.1" 200 None 2026-03-15 06:09:42,777 - lava_callback - DEBUG - Processing node 69b3aa1a974c91e64560fc43: baseline-arm-clabbe 2026-03-15 06:09:42,777 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b3aa1a974c91e64560fc43 2026-03-15 06:09:42,778 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 06:09:42,798 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b3aa1a974c91e64560fc43 HTTP/1.1" 200 None 2026-03-15 06:09:42,800 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 06:09:42,814 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b2e72a6267e2e450f0211d HTTP/1.1" 200 None 2026-03-15 06:09:42,816 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 06:09:42,836 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b3aa1a974c91e64560fc43 HTTP/1.1" 200 None 2026-03-15 06:09:42,838 - lava_callback - ERROR - Error processing callback for node 69b3aa1a974c91e64560fc43: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:52640 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35576 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35590 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36458 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57540 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:57548 - "GET / HTTP/1.0" 200 OK 2026-03-15 06:10:22,821 - lava_callback - INFO - Received callback for node 69b3aa3f974c91e64560fc4e INFO: 172.21.0.1:36862 - "POST /node/69b3aa3f974c91e64560fc4e HTTP/1.0" 202 Accepted 2026-03-15 06:10:22,829 - lava_callback - INFO - Starting async job submit for node 69b3aa3f974c91e64560fc4e 2026-03-15 06:10:22,831 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 06:10:22,845 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b3aa3f974c91e64560fc4e HTTP/1.1" 200 None 2026-03-15 06:10:22,846 - lava_callback - DEBUG - Processing node 69b3aa3f974c91e64560fc4e: baseline-arm-clabbe 2026-03-15 06:10:22,847 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b3aa3f974c91e64560fc4e 2026-03-15 06:10:22,847 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 06:10:22,860 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b3aa3f974c91e64560fc4e HTTP/1.1" 200 None 2026-03-15 06:10:22,862 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 06:10:22,875 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b2e72a6267e2e450f0211d HTTP/1.1" 200 None 2026-03-15 06:10:22,876 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 06:10:22,900 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b3aa3f974c91e64560fc4e HTTP/1.1" 200 None 2026-03-15 06:10:22,901 - lava_callback - ERROR - Error processing callback for node 69b3aa3f974c91e64560fc4e: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:36872 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53528 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34786 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36282 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36292 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57790 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51636 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:51646 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40230 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:32980 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37410 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39440 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39456 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58554 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38984 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:38996 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54458 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53520 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50154 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51872 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51886 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46726 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45344 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:45356 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55424 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57308 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47766 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52952 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52966 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60744 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54590 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:54596 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48452 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44460 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57890 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43336 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43340 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57310 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60214 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:60220 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49020 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45260 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59946 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42714 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42716 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47038 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42954 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:42964 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55100 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42384 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52934 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41092 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41094 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51062 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34866 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:34874 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42202 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54400 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50294 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47682 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47696 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44712 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42480 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:42488 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40788 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35660 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56118 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49706 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49722 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34656 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37554 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:37568 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44228 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58566 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34302 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53136 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53142 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58480 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38986 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:38996 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46572 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57006 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40378 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49578 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49584 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39830 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45316 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:45322 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46624 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57070 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41258 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50690 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50698 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52808 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54196 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:54212 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55890 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50000 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47120 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50372 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50384 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37880 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50686 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:50688 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38702 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54262 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35318 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45292 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45294 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55990 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56904 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:56910 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50204 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46408 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38002 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52932 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52936 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44136 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53860 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:53866 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33978 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33966 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39508 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47430 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47446 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39082 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42522 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:42532 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42052 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58148 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37662 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57358 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57364 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57594 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43188 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:43196 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37482 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51962 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44126 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51996 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52002 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38314 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60692 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:60702 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56324 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33856 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45532 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37226 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37236 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43474 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49096 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:49110 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33654 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36262 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33020 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56952 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56960 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58882 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34612 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:34620 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55156 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33474 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33178 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60570 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60574 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56670 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54762 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:54774 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38084 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49694 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52084 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36000 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36010 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45910 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54018 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:54026 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49190 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57070 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53182 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51780 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51784 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52082 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53554 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:53568 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44486 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55564 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46606 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54158 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54172 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54084 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57406 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:57422 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51176 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51120 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39900 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40302 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40310 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47328 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58968 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:58982 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50488 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41212 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33686 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58590 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58594 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43220 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46572 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:46588 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54908 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45390 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49830 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34216 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34222 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36056 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50854 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:50870 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38168 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53678 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47662 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33322 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33326 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41674 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47270 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:47286 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44796 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53860 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44506 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60958 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60960 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38650 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43462 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:43464 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44824 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42390 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40460 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43070 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43086 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40372 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51924 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:51938 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56672 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58864 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35370 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46358 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46366 - "GET / HTTP/1.0" 200 OK 2026-03-15 06:41:03,130 - lava_callback - INFO - Received callback for node 69b3b172974c91e64560fc60 INFO: 172.21.0.1:53026 - "POST /node/69b3b172974c91e64560fc60 HTTP/1.0" 202 Accepted 2026-03-15 06:41:03,135 - lava_callback - INFO - Starting async job submit for node 69b3b172974c91e64560fc60 2026-03-15 06:41:03,136 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 06:41:03,154 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b3b172974c91e64560fc60 HTTP/1.1" 200 None 2026-03-15 06:41:03,155 - lava_callback - DEBUG - Processing node 69b3b172974c91e64560fc60: baseline-arm-baylibre 2026-03-15 06:41:03,155 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b3b172974c91e64560fc60 2026-03-15 06:41:03,156 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 06:41:03,170 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b3b172974c91e64560fc60 HTTP/1.1" 200 None 2026-03-15 06:41:03,171 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 06:41:03,184 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b0b4fc9d19175818251fd6 HTTP/1.1" 200 None 2026-03-15 06:41:03,185 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 06:41:03,214 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b3b172974c91e64560fc60 HTTP/1.1" 200 None 2026-03-15 06:41:03,215 - lava_callback - ERROR - Error processing callback for node 69b3b172974c91e64560fc60: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:53028 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35166 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:35172 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41174 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41340 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42334 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45244 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45248 - "GET / HTTP/1.0" 200 OK 2026-03-15 06:42:04,326 - lava_callback - INFO - Received callback for node 69b3b1b4974c91e64560fc70 INFO: 172.21.0.1:46390 - "POST /node/69b3b1b4974c91e64560fc70 HTTP/1.0" 202 Accepted 2026-03-15 06:42:04,333 - lava_callback - INFO - Starting async job submit for node 69b3b1b4974c91e64560fc70 2026-03-15 06:42:04,334 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 06:42:04,348 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b3b1b4974c91e64560fc70 HTTP/1.1" 200 None 2026-03-15 06:42:04,349 - lava_callback - DEBUG - Processing node 69b3b1b4974c91e64560fc70: baseline-arm-clabbe 2026-03-15 06:42:04,349 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b3b1b4974c91e64560fc70 2026-03-15 06:42:04,350 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 06:42:04,363 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b3b1b4974c91e64560fc70 HTTP/1.1" 200 None 2026-03-15 06:42:04,365 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 06:42:04,378 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b0b4fc9d19175818251fd6 HTTP/1.1" 200 None 2026-03-15 06:42:04,380 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 06:42:04,400 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b3b1b4974c91e64560fc70 HTTP/1.1" 200 None 2026-03-15 06:42:04,406 - lava_callback - ERROR - Error processing callback for node 69b3b1b4974c91e64560fc70: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:46394 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38826 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:38842 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49230 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38900 - "GET / HTTP/1.0" 200 OK 2026-03-15 06:42:44,274 - lava_callback - INFO - Received callback for node 69b3b1d9974c91e64560fc7b INFO: 172.21.0.1:46974 - "POST /node/69b3b1d9974c91e64560fc7b HTTP/1.0" 202 Accepted 2026-03-15 06:42:44,280 - lava_callback - INFO - Starting async job submit for node 69b3b1d9974c91e64560fc7b 2026-03-15 06:42:44,281 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 06:42:44,309 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b3b1d9974c91e64560fc7b HTTP/1.1" 200 None 2026-03-15 06:42:44,310 - lava_callback - DEBUG - Processing node 69b3b1d9974c91e64560fc7b: baseline-arm-clabbe 2026-03-15 06:42:44,310 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b3b1d9974c91e64560fc7b 2026-03-15 06:42:44,310 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 06:42:44,332 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b3b1d9974c91e64560fc7b HTTP/1.1" 200 None 2026-03-15 06:42:44,334 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 06:42:44,353 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b0b4fc9d19175818251fd6 HTTP/1.1" 200 None 2026-03-15 06:42:44,354 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 06:42:44,402 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b3b1d9974c91e64560fc7b HTTP/1.1" 200 None 2026-03-15 06:42:44,404 - lava_callback - ERROR - Error processing callback for node 69b3b1d9974c91e64560fc7b: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:46982 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50550 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50566 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60500 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38282 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:38288 - "GET / HTTP/1.0" 200 OK 2026-03-15 06:43:23,205 - lava_callback - INFO - Received callback for node 69b3b1f9974c91e64560fc88 INFO: 172.21.0.1:48254 - "POST /node/69b3b1f9974c91e64560fc88 HTTP/1.0" 202 Accepted 2026-03-15 06:43:23,210 - lava_callback - INFO - Starting async job submit for node 69b3b1f9974c91e64560fc88 2026-03-15 06:43:23,211 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 06:43:23,226 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b3b1f9974c91e64560fc88 HTTP/1.1" 200 None 2026-03-15 06:43:23,227 - lava_callback - DEBUG - Processing node 69b3b1f9974c91e64560fc88: baseline-arm-baylibre 2026-03-15 06:43:23,227 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b3b1f9974c91e64560fc88 2026-03-15 06:43:23,228 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 06:43:23,241 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b3b1f9974c91e64560fc88 HTTP/1.1" 200 None 2026-03-15 06:43:23,243 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 06:43:23,256 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b0b4fc9d19175818251fd6 HTTP/1.1" 200 None 2026-03-15 06:43:23,258 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 06:43:23,278 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b3b1f9974c91e64560fc88 HTTP/1.1" 200 None 2026-03-15 06:43:23,279 - lava_callback - ERROR - Error processing callback for node 69b3b1f9974c91e64560fc88: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:48266 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41510 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47524 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45124 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45126 - "GET / HTTP/1.0" 200 OK 2026-03-15 06:44:04,352 - lava_callback - INFO - Received callback for node 69b3b222974c91e64560fc93 INFO: 172.21.0.1:55370 - "POST /node/69b3b222974c91e64560fc93 HTTP/1.0" 202 Accepted 2026-03-15 06:44:04,358 - lava_callback - INFO - Starting async job submit for node 69b3b222974c91e64560fc93 2026-03-15 06:44:04,359 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 06:44:04,377 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b3b222974c91e64560fc93 HTTP/1.1" 200 None 2026-03-15 06:44:04,378 - lava_callback - DEBUG - Processing node 69b3b222974c91e64560fc93: baseline-arm-clabbe 2026-03-15 06:44:04,378 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b3b222974c91e64560fc93 2026-03-15 06:44:04,379 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 06:44:04,397 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b3b222974c91e64560fc93 HTTP/1.1" 200 None 2026-03-15 06:44:04,399 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 06:44:04,420 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b0b4fc9d19175818251fd6 HTTP/1.1" 200 None 2026-03-15 06:44:04,422 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 06:44:04,442 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b3b222974c91e64560fc93 HTTP/1.1" 200 None 2026-03-15 06:44:04,448 - lava_callback - ERROR - Error processing callback for node 69b3b222974c91e64560fc93: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:55380 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51322 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:51330 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58348 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41456 - "GET / HTTP/1.0" 200 OK 2026-03-15 06:44:44,358 - lava_callback - INFO - Received callback for node 69b3b247974c91e64560fca3 INFO: 172.21.0.1:47574 - "POST /node/69b3b247974c91e64560fca3 HTTP/1.0" 202 Accepted 2026-03-15 06:44:44,364 - lava_callback - INFO - Starting async job submit for node 69b3b247974c91e64560fca3 2026-03-15 06:44:44,365 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 06:44:44,381 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b3b247974c91e64560fca3 HTTP/1.1" 200 None 2026-03-15 06:44:44,382 - lava_callback - DEBUG - Processing node 69b3b247974c91e64560fca3: baseline-arm-clabbe 2026-03-15 06:44:44,383 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b3b247974c91e64560fca3 2026-03-15 06:44:44,383 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 06:44:44,397 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b3b247974c91e64560fca3 HTTP/1.1" 200 None 2026-03-15 06:44:44,398 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 06:44:44,411 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b0b4fc9d19175818251fd6 HTTP/1.1" 200 None 2026-03-15 06:44:44,413 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 06:44:44,434 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b3b247974c91e64560fca3 HTTP/1.1" 200 None 2026-03-15 06:44:44,445 - lava_callback - ERROR - Error processing callback for node 69b3b247974c91e64560fca3: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:47578 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50874 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50878 - "GET / HTTP/1.0" 200 OK 2026-03-15 06:45:04,463 - lava_callback - INFO - Received callback for node 69b3b26c974c91e64560fcac INFO: 172.21.0.1:54054 - "POST /node/69b3b26c974c91e64560fcac HTTP/1.0" 202 Accepted 2026-03-15 06:45:04,469 - lava_callback - INFO - Starting async job submit for node 69b3b26c974c91e64560fcac 2026-03-15 06:45:04,469 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 06:45:04,488 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b3b26c974c91e64560fcac HTTP/1.1" 200 None 2026-03-15 06:45:04,489 - lava_callback - DEBUG - Processing node 69b3b26c974c91e64560fcac: baseline-arm-clabbe 2026-03-15 06:45:04,490 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b3b26c974c91e64560fcac 2026-03-15 06:45:04,490 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 06:45:04,504 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b3b26c974c91e64560fcac HTTP/1.1" 200 None 2026-03-15 06:45:04,505 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 06:45:04,518 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b0b4fc9d19175818251fd6 HTTP/1.1" 200 None 2026-03-15 06:45:04,520 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 06:45:04,540 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b3b26c974c91e64560fcac HTTP/1.1" 200 None 2026-03-15 06:45:04,550 - lava_callback - ERROR - Error processing callback for node 69b3b26c974c91e64560fcac: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:54068 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54300 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:54302 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47218 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52338 - "GET / HTTP/1.0" 200 OK 2026-03-15 06:45:44,395 - lava_callback - INFO - Received callback for node 69b3b28f974c91e64560fcb7 INFO: 172.21.0.1:36604 - "POST /node/69b3b28f974c91e64560fcb7 HTTP/1.0" 202 Accepted 2026-03-15 06:45:44,401 - lava_callback - INFO - Starting async job submit for node 69b3b28f974c91e64560fcb7 2026-03-15 06:45:44,401 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 06:45:44,416 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b3b28f974c91e64560fcb7 HTTP/1.1" 200 None 2026-03-15 06:45:44,417 - lava_callback - DEBUG - Processing node 69b3b28f974c91e64560fcb7: baseline-arm-clabbe 2026-03-15 06:45:44,417 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b3b28f974c91e64560fcb7 2026-03-15 06:45:44,418 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 06:45:44,431 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b3b28f974c91e64560fcb7 HTTP/1.1" 200 None 2026-03-15 06:45:44,432 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 06:45:44,446 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b0b4fc9d19175818251fd6 HTTP/1.1" 200 None 2026-03-15 06:45:44,447 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 06:45:44,468 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b3b28f974c91e64560fcb7 HTTP/1.1" 200 None 2026-03-15 06:45:44,469 - lava_callback - ERROR - Error processing callback for node 69b3b28f974c91e64560fcb7: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:36606 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35830 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35838 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:32988 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41126 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:41142 - "GET / HTTP/1.0" 200 OK 2026-03-15 06:46:24,481 - lava_callback - INFO - Received callback for node 69b3b2b4974c91e64560fcc2 INFO: 172.21.0.1:46856 - "POST /node/69b3b2b4974c91e64560fcc2 HTTP/1.0" 202 Accepted 2026-03-15 06:46:24,486 - lava_callback - INFO - Starting async job submit for node 69b3b2b4974c91e64560fcc2 2026-03-15 06:46:24,487 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 06:46:24,501 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b3b2b4974c91e64560fcc2 HTTP/1.1" 200 None 2026-03-15 06:46:24,502 - lava_callback - DEBUG - Processing node 69b3b2b4974c91e64560fcc2: baseline-arm-clabbe 2026-03-15 06:46:24,502 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b3b2b4974c91e64560fcc2 2026-03-15 06:46:24,503 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 06:46:24,516 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b3b2b4974c91e64560fcc2 HTTP/1.1" 200 None 2026-03-15 06:46:24,518 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 06:46:24,534 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b0b4fc9d19175818251fd6 HTTP/1.1" 200 None 2026-03-15 06:46:24,536 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 06:46:24,561 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b3b2b4974c91e64560fcc2 HTTP/1.1" 200 None 2026-03-15 06:46:24,563 - lava_callback - ERROR - Error processing callback for node 69b3b2b4974c91e64560fcc2: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:46858 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33016 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38926 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35502 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35514 - "GET / HTTP/1.0" 200 OK 2026-03-15 06:47:04,448 - lava_callback - INFO - Received callback for node 69b3b2d8974c91e64560fccd INFO: 172.21.0.1:53824 - "POST /node/69b3b2d8974c91e64560fccd HTTP/1.0" 202 Accepted 2026-03-15 06:47:04,453 - lava_callback - INFO - Starting async job submit for node 69b3b2d8974c91e64560fccd 2026-03-15 06:47:04,454 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 06:47:04,480 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b3b2d8974c91e64560fccd HTTP/1.1" 200 None 2026-03-15 06:47:04,481 - lava_callback - DEBUG - Processing node 69b3b2d8974c91e64560fccd: baseline-arm-clabbe 2026-03-15 06:47:04,481 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b3b2d8974c91e64560fccd 2026-03-15 06:47:04,481 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 06:47:04,496 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b3b2d8974c91e64560fccd HTTP/1.1" 200 None 2026-03-15 06:47:04,497 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 06:47:04,521 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b0b4fc9d19175818251fd6 HTTP/1.1" 200 None 2026-03-15 06:47:04,523 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 06:47:04,546 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b3b2d8974c91e64560fccd HTTP/1.1" 200 None 2026-03-15 06:47:04,553 - lava_callback - ERROR - Error processing callback for node 69b3b2d8974c91e64560fccd: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:53828 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35870 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:35886 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58892 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48460 - "GET / HTTP/1.0" 200 OK 2026-03-15 06:47:44,506 - lava_callback - INFO - Received callback for node 69b3b2fd974c91e64560fcda INFO: 172.21.0.1:42254 - "POST /node/69b3b2fd974c91e64560fcda HTTP/1.0" 202 Accepted 2026-03-15 06:47:44,512 - lava_callback - INFO - Starting async job submit for node 69b3b2fd974c91e64560fcda 2026-03-15 06:47:44,512 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 06:47:44,527 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b3b2fd974c91e64560fcda HTTP/1.1" 200 None 2026-03-15 06:47:44,528 - lava_callback - DEBUG - Processing node 69b3b2fd974c91e64560fcda: baseline-arm-clabbe 2026-03-15 06:47:44,528 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b3b2fd974c91e64560fcda 2026-03-15 06:47:44,529 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 06:47:44,546 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b3b2fd974c91e64560fcda HTTP/1.1" 200 None 2026-03-15 06:47:44,548 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 06:47:44,567 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b0b4fc9d19175818251fd6 HTTP/1.1" 200 None 2026-03-15 06:47:44,569 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 06:47:44,589 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b3b2fd974c91e64560fcda HTTP/1.1" 200 None 2026-03-15 06:47:44,591 - lava_callback - ERROR - Error processing callback for node 69b3b2fd974c91e64560fcda: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:42268 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39556 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39568 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52600 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38816 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:38828 - "GET / HTTP/1.0" 200 OK 2026-03-15 06:48:24,510 - lava_callback - INFO - Received callback for node 69b3b322974c91e64560fcf9 INFO: 172.21.0.1:37562 - "POST /node/69b3b322974c91e64560fcf9 HTTP/1.0" 202 Accepted 2026-03-15 06:48:24,515 - lava_callback - INFO - Starting async job submit for node 69b3b322974c91e64560fcf9 2026-03-15 06:48:24,516 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 06:48:24,531 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b3b322974c91e64560fcf9 HTTP/1.1" 200 None 2026-03-15 06:48:24,532 - lava_callback - DEBUG - Processing node 69b3b322974c91e64560fcf9: baseline-arm-clabbe 2026-03-15 06:48:24,532 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b3b322974c91e64560fcf9 2026-03-15 06:48:24,533 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 06:48:24,546 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b3b322974c91e64560fcf9 HTTP/1.1" 200 None 2026-03-15 06:48:24,548 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 06:48:24,568 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b0b4fc9d19175818251fd6 HTTP/1.1" 200 None 2026-03-15 06:48:24,570 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 06:48:24,599 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b3b322974c91e64560fcf9 HTTP/1.1" 200 None 2026-03-15 06:48:24,607 - lava_callback - ERROR - Error processing callback for node 69b3b322974c91e64560fcf9: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:37576 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48530 - "GET / HTTP/1.0" 200 OK 2026-03-15 06:48:43,803 - lava_callback - INFO - Received callback for node 69b3b341974c91e64560fd0f INFO: 172.21.0.1:37056 - "POST /node/69b3b341974c91e64560fd0f HTTP/1.0" 202 Accepted 2026-03-15 06:48:43,809 - lava_callback - INFO - Starting async job submit for node 69b3b341974c91e64560fd0f 2026-03-15 06:48:43,810 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 06:48:43,826 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b3b341974c91e64560fd0f HTTP/1.1" 200 None 2026-03-15 06:48:43,827 - lava_callback - DEBUG - Processing node 69b3b341974c91e64560fd0f: baseline-arm-baylibre 2026-03-15 06:48:43,827 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b3b341974c91e64560fd0f 2026-03-15 06:48:43,828 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 06:48:43,841 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b3b341974c91e64560fd0f HTTP/1.1" 200 None 2026-03-15 06:48:43,843 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 06:48:43,855 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ae11668ef4424e487b2ea2 HTTP/1.1" 200 None 2026-03-15 06:48:43,857 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 06:48:43,901 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b3b341974c91e64560fd0f HTTP/1.1" 200 None 2026-03-15 06:48:43,907 - lava_callback - ERROR - Error processing callback for node 69b3b341974c91e64560fd0f: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:37064 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53646 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53662 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37574 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54608 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:54616 - "GET / HTTP/1.0" 200 OK 2026-03-15 06:49:23,450 - lava_callback - INFO - Received callback for node 69b3b366974c91e64560fd1a INFO: 172.21.0.1:45952 - "POST /node/69b3b366974c91e64560fd1a HTTP/1.0" 202 Accepted 2026-03-15 06:49:23,455 - lava_callback - INFO - Starting async job submit for node 69b3b366974c91e64560fd1a 2026-03-15 06:49:23,456 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 06:49:23,471 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b3b366974c91e64560fd1a HTTP/1.1" 200 None 2026-03-15 06:49:23,472 - lava_callback - DEBUG - Processing node 69b3b366974c91e64560fd1a: baseline-arm-baylibre 2026-03-15 06:49:23,472 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b3b366974c91e64560fd1a 2026-03-15 06:49:23,473 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 06:49:23,486 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b3b366974c91e64560fd1a HTTP/1.1" 200 None 2026-03-15 06:49:23,488 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 06:49:23,501 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ae11668ef4424e487b2ea2 HTTP/1.1" 200 None 2026-03-15 06:49:23,503 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 06:49:23,526 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b3b366974c91e64560fd1a HTTP/1.1" 200 None 2026-03-15 06:49:23,531 - lava_callback - ERROR - Error processing callback for node 69b3b366974c91e64560fd1a: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:45968 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48168 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38954 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39936 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39938 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46480 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49376 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:49386 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54040 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39532 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40280 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59266 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59270 - "GET / HTTP/1.0" 200 OK 2026-03-15 06:51:03,579 - lava_callback - INFO - Received callback for node 69b3b3d4974c91e64560fd39 INFO: 172.21.0.1:53362 - "POST /node/69b3b3d4974c91e64560fd39 HTTP/1.0" 202 Accepted 2026-03-15 06:51:03,585 - lava_callback - INFO - Starting async job submit for node 69b3b3d4974c91e64560fd39 2026-03-15 06:51:03,585 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 06:51:03,605 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b3b3d4974c91e64560fd39 HTTP/1.1" 200 None 2026-03-15 06:51:03,606 - lava_callback - DEBUG - Processing node 69b3b3d4974c91e64560fd39: baseline-arm-baylibre 2026-03-15 06:51:03,606 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b3b3d4974c91e64560fd39 2026-03-15 06:51:03,607 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 06:51:03,620 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b3b3d4974c91e64560fd39 HTTP/1.1" 200 None 2026-03-15 06:51:03,621 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 06:51:03,638 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ae11668ef4424e487b2ea2 HTTP/1.1" 200 None 2026-03-15 06:51:03,640 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 06:51:03,661 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b3b3d4974c91e64560fd39 HTTP/1.1" 200 None 2026-03-15 06:51:03,663 - lava_callback - ERROR - Error processing callback for node 69b3b3d4974c91e64560fd39: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:53370 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51174 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:51186 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59022 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60458 - "GET / HTTP/1.0" 200 OK 2026-03-15 06:51:43,603 - lava_callback - INFO - Received callback for node 69b3b3fa974c91e64560fd44 INFO: 172.21.0.1:52648 - "POST /node/69b3b3fa974c91e64560fd44 HTTP/1.0" 202 Accepted 2026-03-15 06:51:43,609 - lava_callback - INFO - Starting async job submit for node 69b3b3fa974c91e64560fd44 2026-03-15 06:51:43,609 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 06:51:43,625 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b3b3fa974c91e64560fd44 HTTP/1.1" 200 None 2026-03-15 06:51:43,626 - lava_callback - DEBUG - Processing node 69b3b3fa974c91e64560fd44: baseline-arm-baylibre 2026-03-15 06:51:43,626 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b3b3fa974c91e64560fd44 2026-03-15 06:51:43,627 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 06:51:43,640 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b3b3fa974c91e64560fd44 HTTP/1.1" 200 None 2026-03-15 06:51:43,642 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 06:51:43,655 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b35934974c91e64560e49d HTTP/1.1" 200 None 2026-03-15 06:51:43,656 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 06:51:43,699 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b3b3fa974c91e64560fd44 HTTP/1.1" 200 None 2026-03-15 06:51:43,704 - lava_callback - ERROR - Error processing callback for node 69b3b3fa974c91e64560fd44: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:52650 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47686 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47700 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38156 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45074 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:45082 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53864 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43728 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37516 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47882 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47898 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56240 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:32956 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:32968 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35590 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54820 - "GET / HTTP/1.0" 200 OK 2026-03-15 06:53:44,885 - lava_callback - INFO - Received callback for node 69b3b470974c91e64560fd64 INFO: 172.21.0.1:33970 - "POST /node/69b3b470974c91e64560fd64 HTTP/1.0" 202 Accepted 2026-03-15 06:53:44,890 - lava_callback - INFO - Starting async job submit for node 69b3b470974c91e64560fd64 2026-03-15 06:53:44,891 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 06:53:44,905 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b3b470974c91e64560fd64 HTTP/1.1" 200 None 2026-03-15 06:53:44,906 - lava_callback - DEBUG - Processing node 69b3b470974c91e64560fd64: baseline-arm-clabbe 2026-03-15 06:53:44,906 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b3b470974c91e64560fd64 2026-03-15 06:53:44,907 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 06:53:44,924 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b3b470974c91e64560fd64 HTTP/1.1" 200 None 2026-03-15 06:53:44,925 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 06:53:44,939 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b35934974c91e64560e49d HTTP/1.1" 200 None 2026-03-15 06:53:44,940 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 06:53:44,980 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b3b470974c91e64560fd64 HTTP/1.1" 200 None 2026-03-15 06:53:44,982 - lava_callback - ERROR - Error processing callback for node 69b3b470974c91e64560fd64: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:33982 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60612 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60614 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34846 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46542 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:46558 - "GET / HTTP/1.0" 200 OK 2026-03-15 06:54:24,763 - lava_callback - INFO - Received callback for node 69b3b498974c91e64560fd75 INFO: 172.21.0.1:55812 - "POST /node/69b3b498974c91e64560fd75 HTTP/1.0" 202 Accepted 2026-03-15 06:54:24,768 - lava_callback - INFO - Starting async job submit for node 69b3b498974c91e64560fd75 2026-03-15 06:54:24,769 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 06:54:24,787 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b3b498974c91e64560fd75 HTTP/1.1" 200 None 2026-03-15 06:54:24,787 - lava_callback - DEBUG - Processing node 69b3b498974c91e64560fd75: baseline-arm-clabbe 2026-03-15 06:54:24,788 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b3b498974c91e64560fd75 2026-03-15 06:54:24,788 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 06:54:24,802 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b3b498974c91e64560fd75 HTTP/1.1" 200 None 2026-03-15 06:54:24,803 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 06:54:24,820 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b35934974c91e64560e49d HTTP/1.1" 200 None 2026-03-15 06:54:24,821 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 06:54:24,844 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b3b498974c91e64560fd75 HTTP/1.1" 200 None 2026-03-15 06:54:24,849 - lava_callback - ERROR - Error processing callback for node 69b3b498974c91e64560fd75: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:55828 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44312 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59484 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60202 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60214 - "GET / HTTP/1.0" 200 OK 2026-03-15 06:55:04,874 - lava_callback - INFO - Received callback for node 69b3b4be974c91e64560fd84 INFO: 172.21.0.1:52024 - "POST /node/69b3b4be974c91e64560fd84 HTTP/1.0" 202 Accepted 2026-03-15 06:55:04,882 - lava_callback - INFO - Starting async job submit for node 69b3b4be974c91e64560fd84 2026-03-15 06:55:04,884 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 06:55:04,901 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b3b4be974c91e64560fd84 HTTP/1.1" 200 None 2026-03-15 06:55:04,902 - lava_callback - DEBUG - Processing node 69b3b4be974c91e64560fd84: baseline-arm-clabbe 2026-03-15 06:55:04,902 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b3b4be974c91e64560fd84 2026-03-15 06:55:04,903 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 06:55:04,916 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b3b4be974c91e64560fd84 HTTP/1.1" 200 None 2026-03-15 06:55:04,918 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 06:55:04,931 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b35934974c91e64560e49d HTTP/1.1" 200 None 2026-03-15 06:55:04,933 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 06:55:04,953 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b3b4be974c91e64560fd84 HTTP/1.1" 200 None 2026-03-15 06:55:04,958 - lava_callback - ERROR - Error processing callback for node 69b3b4be974c91e64560fd84: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:52030 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34048 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:34060 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44042 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46720 - "GET / HTTP/1.0" 200 OK 2026-03-15 06:55:44,854 - lava_callback - INFO - Received callback for node 69b3b4e3974c91e64560fd8e INFO: 172.21.0.1:46312 - "POST /node/69b3b4e3974c91e64560fd8e HTTP/1.0" 202 Accepted 2026-03-15 06:55:44,859 - lava_callback - INFO - Starting async job submit for node 69b3b4e3974c91e64560fd8e 2026-03-15 06:55:44,860 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 06:55:44,880 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b3b4e3974c91e64560fd8e HTTP/1.1" 200 None 2026-03-15 06:55:44,881 - lava_callback - DEBUG - Processing node 69b3b4e3974c91e64560fd8e: baseline-arm-clabbe 2026-03-15 06:55:44,881 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b3b4e3974c91e64560fd8e 2026-03-15 06:55:44,882 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 06:55:44,895 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b3b4e3974c91e64560fd8e HTTP/1.1" 200 None 2026-03-15 06:55:44,896 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 06:55:44,910 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b35934974c91e64560e49d HTTP/1.1" 200 None 2026-03-15 06:55:44,911 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 06:55:44,951 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b3b4e3974c91e64560fd8e HTTP/1.1" 200 None 2026-03-15 06:55:44,953 - lava_callback - ERROR - Error processing callback for node 69b3b4e3974c91e64560fd8e: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:46318 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39366 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39380 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41256 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50664 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:50666 - "GET / HTTP/1.0" 200 OK 2026-03-15 06:56:24,924 - lava_callback - INFO - Received callback for node 69b3b509974c91e64560fd9a INFO: 172.21.0.1:35602 - "POST /node/69b3b509974c91e64560fd9a HTTP/1.0" 202 Accepted 2026-03-15 06:56:24,930 - lava_callback - INFO - Starting async job submit for node 69b3b509974c91e64560fd9a 2026-03-15 06:56:24,931 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 06:56:24,947 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b3b509974c91e64560fd9a HTTP/1.1" 200 None 2026-03-15 06:56:24,948 - lava_callback - DEBUG - Processing node 69b3b509974c91e64560fd9a: baseline-arm-clabbe 2026-03-15 06:56:24,948 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b3b509974c91e64560fd9a 2026-03-15 06:56:24,949 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 06:56:24,962 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b3b509974c91e64560fd9a HTTP/1.1" 200 None 2026-03-15 06:56:24,964 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 06:56:24,977 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b35934974c91e64560e49d HTTP/1.1" 200 None 2026-03-15 06:56:24,978 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 06:56:24,999 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b3b509974c91e64560fd9a HTTP/1.1" 200 None 2026-03-15 06:56:25,005 - lava_callback - ERROR - Error processing callback for node 69b3b509974c91e64560fd9a: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:35606 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51290 - "GET / HTTP/1.0" 200 OK 2026-03-15 06:56:43,851 - lava_callback - INFO - Received callback for node 69b3b52a974c91e64560fda6 INFO: 172.21.0.1:54200 - "POST /node/69b3b52a974c91e64560fda6 HTTP/1.0" 202 Accepted 2026-03-15 06:56:43,856 - lava_callback - INFO - Starting async job submit for node 69b3b52a974c91e64560fda6 2026-03-15 06:56:43,857 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 06:56:43,871 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b3b52a974c91e64560fda6 HTTP/1.1" 200 None 2026-03-15 06:56:43,872 - lava_callback - DEBUG - Processing node 69b3b52a974c91e64560fda6: baseline-arm-baylibre 2026-03-15 06:56:43,873 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b3b52a974c91e64560fda6 2026-03-15 06:56:43,873 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 06:56:43,889 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b3b52a974c91e64560fda6 HTTP/1.1" 200 None 2026-03-15 06:56:43,891 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 06:56:43,913 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ae11668ef4424e487b2ea2 HTTP/1.1" 200 None 2026-03-15 06:56:43,915 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 06:56:43,935 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b3b52a974c91e64560fda6 HTTP/1.1" 200 None 2026-03-15 06:56:43,945 - lava_callback - ERROR - Error processing callback for node 69b3b52a974c91e64560fda6: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:54206 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42198 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42204 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55414 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60912 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:60918 - "GET / HTTP/1.0" 200 OK 2026-03-15 06:57:23,851 - lava_callback - INFO - Received callback for node 69b3b54f974c91e64560fdb5 INFO: 172.21.0.1:44916 - "POST /node/69b3b54f974c91e64560fdb5 HTTP/1.0" 202 Accepted 2026-03-15 06:57:23,857 - lava_callback - INFO - Starting async job submit for node 69b3b54f974c91e64560fdb5 2026-03-15 06:57:23,857 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 06:57:23,872 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b3b54f974c91e64560fdb5 HTTP/1.1" 200 None 2026-03-15 06:57:23,873 - lava_callback - DEBUG - Processing node 69b3b54f974c91e64560fdb5: baseline-arm-baylibre 2026-03-15 06:57:23,873 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b3b54f974c91e64560fdb5 2026-03-15 06:57:23,874 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 06:57:23,888 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b3b54f974c91e64560fdb5 HTTP/1.1" 200 None 2026-03-15 06:57:23,889 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 06:57:23,903 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ae11668ef4424e487b2ea2 HTTP/1.1" 200 None 2026-03-15 06:57:23,904 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 06:57:23,927 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b3b54f974c91e64560fdb5 HTTP/1.1" 200 None 2026-03-15 06:57:23,929 - lava_callback - ERROR - Error processing callback for node 69b3b54f974c91e64560fdb5: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:44918 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50604 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48502 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34026 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34042 - "GET / HTTP/1.0" 200 OK 2026-03-15 06:58:04,004 - lava_callback - INFO - Received callback for node 69b3b576974c91e64560fdc3 INFO: 172.21.0.1:53826 - "POST /node/69b3b576974c91e64560fdc3 HTTP/1.0" 202 Accepted 2026-03-15 06:58:04,010 - lava_callback - INFO - Starting async job submit for node 69b3b576974c91e64560fdc3 2026-03-15 06:58:04,010 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 06:58:04,025 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b3b576974c91e64560fdc3 HTTP/1.1" 200 None 2026-03-15 06:58:04,026 - lava_callback - DEBUG - Processing node 69b3b576974c91e64560fdc3: baseline-arm-baylibre 2026-03-15 06:58:04,026 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b3b576974c91e64560fdc3 2026-03-15 06:58:04,026 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 06:58:04,040 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b3b576974c91e64560fdc3 HTTP/1.1" 200 None 2026-03-15 06:58:04,041 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 06:58:04,058 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ae11668ef4424e487b2ea2 HTTP/1.1" 200 None 2026-03-15 06:58:04,059 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 06:58:04,080 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b3b576974c91e64560fdc3 HTTP/1.1" 200 None 2026-03-15 06:58:04,082 - lava_callback - ERROR - Error processing callback for node 69b3b576974c91e64560fdc3: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:53838 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41990 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:42000 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50092 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35566 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60660 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55958 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55964 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40298 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52894 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:52910 - "GET / HTTP/1.0" 200 OK 2026-03-15 06:59:23,983 - lava_callback - INFO - Received callback for node 69b3b5bf974c91e64560fdd9 INFO: 172.21.0.1:47242 - "POST /node/69b3b5bf974c91e64560fdd9 HTTP/1.0" 202 Accepted 2026-03-15 06:59:23,988 - lava_callback - INFO - Starting async job submit for node 69b3b5bf974c91e64560fdd9 2026-03-15 06:59:23,989 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 06:59:24,004 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b3b5bf974c91e64560fdd9 HTTP/1.1" 200 None 2026-03-15 06:59:24,005 - lava_callback - DEBUG - Processing node 69b3b5bf974c91e64560fdd9: baseline-arm-baylibre 2026-03-15 06:59:24,005 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b3b5bf974c91e64560fdd9 2026-03-15 06:59:24,006 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 06:59:24,019 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b3b5bf974c91e64560fdd9 HTTP/1.1" 200 None 2026-03-15 06:59:24,020 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 06:59:24,033 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ae11668ef4424e487b2ea2 HTTP/1.1" 200 None 2026-03-15 06:59:24,035 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 06:59:24,055 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b3b5bf974c91e64560fdd9 HTTP/1.1" 200 None 2026-03-15 06:59:24,057 - lava_callback - ERROR - Error processing callback for node 69b3b5bf974c91e64560fdd9: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:47254 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46298 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44014 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43508 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43524 - "GET / HTTP/1.0" 200 OK 2026-03-15 07:00:03,996 - lava_callback - INFO - Received callback for node 69b3b5e1974c91e64560fde6 INFO: 172.21.0.1:58900 - "POST /node/69b3b5e1974c91e64560fde6 HTTP/1.0" 202 Accepted 2026-03-15 07:00:04,002 - lava_callback - INFO - Starting async job submit for node 69b3b5e1974c91e64560fde6 2026-03-15 07:00:04,003 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 07:00:04,018 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b3b5e1974c91e64560fde6 HTTP/1.1" 200 None 2026-03-15 07:00:04,019 - lava_callback - DEBUG - Processing node 69b3b5e1974c91e64560fde6: baseline-arm-baylibre 2026-03-15 07:00:04,020 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b3b5e1974c91e64560fde6 2026-03-15 07:00:04,020 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 07:00:04,033 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b3b5e1974c91e64560fde6 HTTP/1.1" 200 None 2026-03-15 07:00:04,035 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 07:00:04,049 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ae11668ef4424e487b2ea2 HTTP/1.1" 200 None 2026-03-15 07:00:04,051 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 07:00:04,105 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b3b5e1974c91e64560fde6 HTTP/1.1" 200 None 2026-03-15 07:00:04,111 - lava_callback - ERROR - Error processing callback for node 69b3b5e1974c91e64560fde6: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:58908 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54564 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:54576 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42396 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44054 - "GET / HTTP/1.0" 200 OK 2026-03-15 07:00:45,066 - lava_callback - INFO - Received callback for node 69b3b609974c91e64560fdf7 INFO: 172.21.0.1:59902 - "POST /node/69b3b609974c91e64560fdf7 HTTP/1.0" 202 Accepted 2026-03-15 07:00:45,072 - lava_callback - INFO - Starting async job submit for node 69b3b609974c91e64560fdf7 2026-03-15 07:00:45,073 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 07:00:45,097 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b3b609974c91e64560fdf7 HTTP/1.1" 200 None 2026-03-15 07:00:45,098 - lava_callback - DEBUG - Processing node 69b3b609974c91e64560fdf7: baseline-arm-clabbe 2026-03-15 07:00:45,099 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b3b609974c91e64560fdf7 2026-03-15 07:00:45,099 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 07:00:45,123 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b3b609974c91e64560fdf7 HTTP/1.1" 200 None 2026-03-15 07:00:45,124 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 07:00:45,140 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ae11668ef4424e487b2ea2 HTTP/1.1" 200 None 2026-03-15 07:00:45,142 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 07:00:45,187 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b3b609974c91e64560fdf7 HTTP/1.1" 200 None 2026-03-15 07:00:45,193 - lava_callback - ERROR - Error processing callback for node 69b3b609974c91e64560fdf7: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:59912 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45340 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45350 - "GET / HTTP/1.0" 200 OK 2026-03-15 07:01:04,139 - lava_callback - INFO - Received callback for node 69b3b62a974c91e64560fdff INFO: 172.21.0.1:51902 - "POST /node/69b3b62a974c91e64560fdff HTTP/1.0" 202 Accepted 2026-03-15 07:01:04,144 - lava_callback - INFO - Starting async job submit for node 69b3b62a974c91e64560fdff 2026-03-15 07:01:04,145 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 07:01:04,160 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b3b62a974c91e64560fdff HTTP/1.1" 200 None 2026-03-15 07:01:04,161 - lava_callback - DEBUG - Processing node 69b3b62a974c91e64560fdff: baseline-arm-baylibre 2026-03-15 07:01:04,161 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b3b62a974c91e64560fdff 2026-03-15 07:01:04,162 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 07:01:04,176 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b3b62a974c91e64560fdff HTTP/1.1" 200 None 2026-03-15 07:01:04,177 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 07:01:04,193 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ae11668ef4424e487b2ea2 HTTP/1.1" 200 None 2026-03-15 07:01:04,195 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 07:01:04,229 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b3b62a974c91e64560fdff HTTP/1.1" 200 None 2026-03-15 07:01:04,236 - lava_callback - ERROR - Error processing callback for node 69b3b62a974c91e64560fdff: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:51908 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38294 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:38310 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47150 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48822 - "GET / HTTP/1.0" 200 OK 2026-03-15 07:01:45,099 - lava_callback - INFO - Received callback for node 69b3b653974c91e64560fe0b INFO: 172.21.0.1:57600 - "POST /node/69b3b653974c91e64560fe0b HTTP/1.0" 202 Accepted 2026-03-15 07:01:45,105 - lava_callback - INFO - Starting async job submit for node 69b3b653974c91e64560fe0b 2026-03-15 07:01:45,106 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 07:01:45,121 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b3b653974c91e64560fe0b HTTP/1.1" 200 None 2026-03-15 07:01:45,122 - lava_callback - DEBUG - Processing node 69b3b653974c91e64560fe0b: baseline-arm-clabbe 2026-03-15 07:01:45,122 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b3b653974c91e64560fe0b 2026-03-15 07:01:45,123 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 07:01:45,139 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b3b653974c91e64560fe0b HTTP/1.1" 200 None 2026-03-15 07:01:45,140 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 07:01:45,153 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ae11668ef4424e487b2ea2 HTTP/1.1" 200 None 2026-03-15 07:01:45,155 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 07:01:45,175 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b3b653974c91e64560fe0b HTTP/1.1" 200 None 2026-03-15 07:01:45,176 - lava_callback - ERROR - Error processing callback for node 69b3b653974c91e64560fe0b: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:57606 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35094 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35102 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59092 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51298 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:51308 - "GET / HTTP/1.0" 200 OK 2026-03-15 07:02:24,172 - lava_callback - INFO - Received callback for node 69b3b674974c91e64560fe1f INFO: 172.21.0.1:35636 - "POST /node/69b3b674974c91e64560fe1f HTTP/1.0" 202 Accepted 2026-03-15 07:02:24,185 - lava_callback - INFO - Starting async job submit for node 69b3b674974c91e64560fe1f 2026-03-15 07:02:24,186 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 07:02:24,229 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b3b674974c91e64560fe1f HTTP/1.1" 200 None 2026-03-15 07:02:24,230 - lava_callback - DEBUG - Processing node 69b3b674974c91e64560fe1f: baseline-arm-baylibre 2026-03-15 07:02:24,231 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b3b674974c91e64560fe1f 2026-03-15 07:02:24,232 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 07:02:24,246 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b3b674974c91e64560fe1f HTTP/1.1" 200 None 2026-03-15 07:02:24,248 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 07:02:24,262 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ae11668ef4424e487b2ea2 HTTP/1.1" 200 None 2026-03-15 07:02:24,264 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 07:02:24,288 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b3b674974c91e64560fe1f HTTP/1.1" 200 None 2026-03-15 07:02:24,290 - lava_callback - ERROR - Error processing callback for node 69b3b674974c91e64560fe1f: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:35642 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49434 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50960 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35946 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35948 - "GET / HTTP/1.0" 200 OK 2026-03-15 07:03:05,167 - lava_callback - INFO - Received callback for node 69b3b69b974c91e64560fe2d INFO: 172.21.0.1:34606 - "POST /node/69b3b69b974c91e64560fe2d HTTP/1.0" 202 Accepted 2026-03-15 07:03:05,172 - lava_callback - INFO - Starting async job submit for node 69b3b69b974c91e64560fe2d 2026-03-15 07:03:05,173 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 07:03:05,196 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b3b69b974c91e64560fe2d HTTP/1.1" 200 None 2026-03-15 07:03:05,197 - lava_callback - DEBUG - Processing node 69b3b69b974c91e64560fe2d: baseline-arm-clabbe 2026-03-15 07:03:05,197 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b3b69b974c91e64560fe2d 2026-03-15 07:03:05,198 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 07:03:05,211 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b3b69b974c91e64560fe2d HTTP/1.1" 200 None 2026-03-15 07:03:05,213 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 07:03:05,248 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ae11668ef4424e487b2ea2 HTTP/1.1" 200 None 2026-03-15 07:03:05,250 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 07:03:05,311 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b3b69b974c91e64560fe2d HTTP/1.1" 200 None 2026-03-15 07:03:05,313 - lava_callback - ERROR - Error processing callback for node 69b3b69b974c91e64560fe2d: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:34610 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46964 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:46980 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55150 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47406 - "GET / HTTP/1.0" 200 OK 2026-03-15 07:03:45,164 - lava_callback - INFO - Received callback for node 69b3b6c0974c91e64560fe3b INFO: 172.21.0.1:47584 - "POST /node/69b3b6c0974c91e64560fe3b HTTP/1.0" 202 Accepted 2026-03-15 07:03:45,169 - lava_callback - INFO - Starting async job submit for node 69b3b6c0974c91e64560fe3b 2026-03-15 07:03:45,170 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 07:03:45,185 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b3b6c0974c91e64560fe3b HTTP/1.1" 200 None 2026-03-15 07:03:45,186 - lava_callback - DEBUG - Processing node 69b3b6c0974c91e64560fe3b: baseline-arm-clabbe 2026-03-15 07:03:45,186 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b3b6c0974c91e64560fe3b 2026-03-15 07:03:45,186 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 07:03:45,207 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b3b6c0974c91e64560fe3b HTTP/1.1" 200 None 2026-03-15 07:03:45,209 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 07:03:45,222 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ae11668ef4424e487b2ea2 HTTP/1.1" 200 None 2026-03-15 07:03:45,224 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 07:03:45,244 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b3b6c0974c91e64560fe3b HTTP/1.1" 200 None 2026-03-15 07:03:45,245 - lava_callback - ERROR - Error processing callback for node 69b3b6c0974c91e64560fe3b: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:47594 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37460 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37476 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44058 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49058 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:49072 - "GET / HTTP/1.0" 200 OK 2026-03-15 07:04:25,200 - lava_callback - INFO - Received callback for node 69b3b6e4974c91e64560fe45 INFO: 172.21.0.1:39494 - "POST /node/69b3b6e4974c91e64560fe45 HTTP/1.0" 202 Accepted 2026-03-15 07:04:25,205 - lava_callback - INFO - Starting async job submit for node 69b3b6e4974c91e64560fe45 2026-03-15 07:04:25,206 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 07:04:25,229 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b3b6e4974c91e64560fe45 HTTP/1.1" 200 None 2026-03-15 07:04:25,230 - lava_callback - DEBUG - Processing node 69b3b6e4974c91e64560fe45: baseline-arm-clabbe 2026-03-15 07:04:25,230 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b3b6e4974c91e64560fe45 2026-03-15 07:04:25,231 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 07:04:25,244 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b3b6e4974c91e64560fe45 HTTP/1.1" 200 None 2026-03-15 07:04:25,245 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 07:04:25,280 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ae11668ef4424e487b2ea2 HTTP/1.1" 200 None 2026-03-15 07:04:25,281 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 07:04:25,312 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b3b6e4974c91e64560fe45 HTTP/1.1" 200 None 2026-03-15 07:04:25,314 - lava_callback - ERROR - Error processing callback for node 69b3b6e4974c91e64560fe45: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:39506 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44258 - "GET / HTTP/1.0" 200 OK 2026-03-15 07:04:44,433 - lava_callback - INFO - Received callback for node 69b3b706974c91e64560fe50 INFO: 172.21.0.1:36602 - "POST /node/69b3b706974c91e64560fe50 HTTP/1.0" 202 Accepted 2026-03-15 07:04:44,439 - lava_callback - INFO - Starting async job submit for node 69b3b706974c91e64560fe50 2026-03-15 07:04:44,440 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 07:04:44,455 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b3b706974c91e64560fe50 HTTP/1.1" 200 None 2026-03-15 07:04:44,455 - lava_callback - DEBUG - Processing node 69b3b706974c91e64560fe50: baseline-arm-baylibre 2026-03-15 07:04:44,456 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b3b706974c91e64560fe50 2026-03-15 07:04:44,456 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 07:04:44,469 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b3b706974c91e64560fe50 HTTP/1.1" 200 None 2026-03-15 07:04:44,470 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 07:04:44,484 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ae11668ef4424e487b2ea2 HTTP/1.1" 200 None 2026-03-15 07:04:44,486 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 07:04:44,506 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b3b706974c91e64560fe50 HTTP/1.1" 200 None 2026-03-15 07:04:44,507 - lava_callback - ERROR - Error processing callback for node 69b3b706974c91e64560fe50: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:36610 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42986 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42992 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43482 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42244 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:42246 - "GET / HTTP/1.0" 200 OK 2026-03-15 07:05:25,265 - lava_callback - INFO - Received callback for node 69b3b72d974c91e64560fe5a INFO: 172.21.0.1:35474 - "POST /node/69b3b72d974c91e64560fe5a HTTP/1.0" 202 Accepted 2026-03-15 07:05:25,270 - lava_callback - INFO - Starting async job submit for node 69b3b72d974c91e64560fe5a 2026-03-15 07:05:25,271 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 07:05:25,307 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b3b72d974c91e64560fe5a HTTP/1.1" 200 None 2026-03-15 07:05:25,308 - lava_callback - DEBUG - Processing node 69b3b72d974c91e64560fe5a: baseline-arm-clabbe 2026-03-15 07:05:25,308 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b3b72d974c91e64560fe5a 2026-03-15 07:05:25,309 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 07:05:25,322 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b3b72d974c91e64560fe5a HTTP/1.1" 200 None 2026-03-15 07:05:25,324 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 07:05:25,337 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ae11668ef4424e487b2ea2 HTTP/1.1" 200 None 2026-03-15 07:05:25,338 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 07:05:25,371 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b3b72d974c91e64560fe5a HTTP/1.1" 200 None 2026-03-15 07:05:25,377 - lava_callback - ERROR - Error processing callback for node 69b3b72d974c91e64560fe5a: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:35486 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48862 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39794 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50918 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50930 - "GET / HTTP/1.0" 200 OK 2026-03-15 07:06:05,259 - lava_callback - INFO - Received callback for node 69b3b751974c91e64560fe6a INFO: 172.21.0.1:38884 - "POST /node/69b3b751974c91e64560fe6a HTTP/1.0" 202 Accepted 2026-03-15 07:06:05,264 - lava_callback - INFO - Starting async job submit for node 69b3b751974c91e64560fe6a 2026-03-15 07:06:05,265 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 07:06:05,297 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b3b751974c91e64560fe6a HTTP/1.1" 200 None 2026-03-15 07:06:05,298 - lava_callback - DEBUG - Processing node 69b3b751974c91e64560fe6a: baseline-arm-clabbe 2026-03-15 07:06:05,299 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b3b751974c91e64560fe6a 2026-03-15 07:06:05,299 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 07:06:05,321 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b3b751974c91e64560fe6a HTTP/1.1" 200 None 2026-03-15 07:06:05,322 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 07:06:05,337 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ae11668ef4424e487b2ea2 HTTP/1.1" 200 None 2026-03-15 07:06:05,338 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 07:06:05,369 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b3b751974c91e64560fe6a HTTP/1.1" 200 None 2026-03-15 07:06:05,374 - lava_callback - ERROR - Error processing callback for node 69b3b751974c91e64560fe6a: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:38894 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37834 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:37838 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47458 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38382 - "GET / HTTP/1.0" 200 OK 2026-03-15 07:06:44,398 - lava_callback - INFO - Received callback for node 69b3b773974c91e64560fe71 INFO: 172.21.0.1:35170 - "POST /node/69b3b773974c91e64560fe71 HTTP/1.0" 202 Accepted 2026-03-15 07:06:44,403 - lava_callback - INFO - Starting async job submit for node 69b3b773974c91e64560fe71 2026-03-15 07:06:44,404 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 07:06:44,439 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b3b773974c91e64560fe71 HTTP/1.1" 200 None 2026-03-15 07:06:44,440 - lava_callback - DEBUG - Processing node 69b3b773974c91e64560fe71: baseline-arm-baylibre 2026-03-15 07:06:44,440 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b3b773974c91e64560fe71 2026-03-15 07:06:44,440 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 07:06:44,483 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b3b773974c91e64560fe71 HTTP/1.1" 200 None 2026-03-15 07:06:44,485 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 07:06:44,507 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ae11668ef4424e487b2ea2 HTTP/1.1" 200 None 2026-03-15 07:06:44,509 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 07:06:44,530 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b3b773974c91e64560fe71 HTTP/1.1" 200 None 2026-03-15 07:06:44,532 - lava_callback - ERROR - Error processing callback for node 69b3b773974c91e64560fe71: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:35174 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45106 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45116 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54166 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36156 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:36160 - "GET / HTTP/1.0" 200 OK 2026-03-15 07:07:25,343 - lava_callback - INFO - Received callback for node 69b3b799974c91e64560fe7b INFO: 172.21.0.1:38058 - "POST /node/69b3b799974c91e64560fe7b HTTP/1.0" 202 Accepted 2026-03-15 07:07:25,348 - lava_callback - INFO - Starting async job submit for node 69b3b799974c91e64560fe7b 2026-03-15 07:07:25,349 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 07:07:25,363 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b3b799974c91e64560fe7b HTTP/1.1" 200 None 2026-03-15 07:07:25,364 - lava_callback - DEBUG - Processing node 69b3b799974c91e64560fe7b: baseline-arm-clabbe 2026-03-15 07:07:25,365 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b3b799974c91e64560fe7b 2026-03-15 07:07:25,365 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 07:07:25,378 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b3b799974c91e64560fe7b HTTP/1.1" 200 None 2026-03-15 07:07:25,380 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 07:07:25,393 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ae11668ef4424e487b2ea2 HTTP/1.1" 200 None 2026-03-15 07:07:25,395 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 07:07:25,422 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b3b799974c91e64560fe7b HTTP/1.1" 200 None 2026-03-15 07:07:25,424 - lava_callback - ERROR - Error processing callback for node 69b3b799974c91e64560fe7b: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:38074 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53066 - "GET / HTTP/1.0" 200 OK 2026-03-15 07:07:45,312 - lava_callback - INFO - Received callback for node 69b3b7bd974c91e64560fe86 INFO: 172.21.0.1:37572 - "POST /node/69b3b7bd974c91e64560fe86 HTTP/1.0" 202 Accepted 2026-03-15 07:07:45,318 - lava_callback - INFO - Starting async job submit for node 69b3b7bd974c91e64560fe86 2026-03-15 07:07:45,318 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 07:07:45,356 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b3b7bd974c91e64560fe86 HTTP/1.1" 200 None 2026-03-15 07:07:45,356 - lava_callback - DEBUG - Processing node 69b3b7bd974c91e64560fe86: baseline-arm-clabbe 2026-03-15 07:07:45,357 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b3b7bd974c91e64560fe86 2026-03-15 07:07:45,357 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 07:07:45,371 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b3b7bd974c91e64560fe86 HTTP/1.1" 200 None 2026-03-15 07:07:45,372 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 07:07:45,409 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ae11668ef4424e487b2ea2 HTTP/1.1" 200 None 2026-03-15 07:07:45,411 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 07:07:45,430 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b3b7bd974c91e64560fe86 HTTP/1.1" 200 None 2026-03-15 07:07:45,432 - lava_callback - ERROR - Error processing callback for node 69b3b7bd974c91e64560fe86: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:37580 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39984 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39988 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50240 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33682 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:33688 - "GET / HTTP/1.0" 200 OK 2026-03-15 07:08:25,377 - lava_callback - INFO - Received callback for node 69b3b7e2974c91e64560fe90 INFO: 172.21.0.1:59414 - "POST /node/69b3b7e2974c91e64560fe90 HTTP/1.0" 202 Accepted 2026-03-15 07:08:25,382 - lava_callback - INFO - Starting async job submit for node 69b3b7e2974c91e64560fe90 2026-03-15 07:08:25,383 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 07:08:25,397 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b3b7e2974c91e64560fe90 HTTP/1.1" 200 None 2026-03-15 07:08:25,398 - lava_callback - DEBUG - Processing node 69b3b7e2974c91e64560fe90: baseline-arm-clabbe 2026-03-15 07:08:25,398 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b3b7e2974c91e64560fe90 2026-03-15 07:08:25,399 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 07:08:25,412 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b3b7e2974c91e64560fe90 HTTP/1.1" 200 None 2026-03-15 07:08:25,414 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 07:08:25,427 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ae11668ef4424e487b2ea2 HTTP/1.1" 200 None 2026-03-15 07:08:25,428 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 07:08:25,451 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b3b7e2974c91e64560fe90 HTTP/1.1" 200 None 2026-03-15 07:08:25,452 - lava_callback - ERROR - Error processing callback for node 69b3b7e2974c91e64560fe90: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:59420 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55382 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38032 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48048 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48060 - "GET / HTTP/1.0" 200 OK 2026-03-15 07:09:05,379 - lava_callback - INFO - Received callback for node 69b3b806974c91e64560fea9 INFO: 172.21.0.1:35710 - "POST /node/69b3b806974c91e64560fea9 HTTP/1.0" 202 Accepted 2026-03-15 07:09:05,384 - lava_callback - INFO - Starting async job submit for node 69b3b806974c91e64560fea9 2026-03-15 07:09:05,385 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 07:09:05,421 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b3b806974c91e64560fea9 HTTP/1.1" 200 None 2026-03-15 07:09:05,422 - lava_callback - DEBUG - Processing node 69b3b806974c91e64560fea9: baseline-arm-clabbe 2026-03-15 07:09:05,422 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b3b806974c91e64560fea9 2026-03-15 07:09:05,423 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 07:09:05,446 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b3b806974c91e64560fea9 HTTP/1.1" 200 None 2026-03-15 07:09:05,448 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 07:09:05,461 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ae11668ef4424e487b2ea2 HTTP/1.1" 200 None 2026-03-15 07:09:05,462 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 07:09:05,495 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b3b806974c91e64560fea9 HTTP/1.1" 200 None 2026-03-15 07:09:05,500 - lava_callback - ERROR - Error processing callback for node 69b3b806974c91e64560fea9: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:35720 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46706 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:46720 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41902 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36876 - "GET / HTTP/1.0" 200 OK 2026-03-15 07:09:45,443 - lava_callback - INFO - Received callback for node 69b3b82c974c91e64560feb6 INFO: 172.21.0.1:34640 - "POST /node/69b3b82c974c91e64560feb6 HTTP/1.0" 202 Accepted 2026-03-15 07:09:45,448 - lava_callback - INFO - Starting async job submit for node 69b3b82c974c91e64560feb6 2026-03-15 07:09:45,449 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 07:09:45,464 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b3b82c974c91e64560feb6 HTTP/1.1" 200 None 2026-03-15 07:09:45,465 - lava_callback - DEBUG - Processing node 69b3b82c974c91e64560feb6: baseline-arm-clabbe 2026-03-15 07:09:45,465 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b3b82c974c91e64560feb6 2026-03-15 07:09:45,466 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 07:09:45,480 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b3b82c974c91e64560feb6 HTTP/1.1" 200 None 2026-03-15 07:09:45,482 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 07:09:45,495 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ae11668ef4424e487b2ea2 HTTP/1.1" 200 None 2026-03-15 07:09:45,497 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 07:09:45,517 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b3b82c974c91e64560feb6 HTTP/1.1" 200 None 2026-03-15 07:09:45,518 - lava_callback - ERROR - Error processing callback for node 69b3b82c974c91e64560feb6: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:34650 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43686 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43694 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40912 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39098 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:39114 - "GET / HTTP/1.0" 200 OK 2026-03-15 07:10:25,470 - lava_callback - INFO - Received callback for node 69b3b850974c91e64560fed6 INFO: 172.21.0.1:42094 - "POST /node/69b3b850974c91e64560fed6 HTTP/1.0" 202 Accepted 2026-03-15 07:10:25,475 - lava_callback - INFO - Starting async job submit for node 69b3b850974c91e64560fed6 2026-03-15 07:10:25,476 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 07:10:25,504 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b3b850974c91e64560fed6 HTTP/1.1" 200 None 2026-03-15 07:10:25,505 - lava_callback - DEBUG - Processing node 69b3b850974c91e64560fed6: baseline-arm-clabbe 2026-03-15 07:10:25,505 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b3b850974c91e64560fed6 2026-03-15 07:10:25,506 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 07:10:25,533 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b3b850974c91e64560fed6 HTTP/1.1" 200 None 2026-03-15 07:10:25,535 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 07:10:25,548 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ae11668ef4424e487b2ea2 HTTP/1.1" 200 None 2026-03-15 07:10:25,550 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 07:10:25,570 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b3b850974c91e64560fed6 HTTP/1.1" 200 None 2026-03-15 07:10:25,572 - lava_callback - ERROR - Error processing callback for node 69b3b850974c91e64560fed6: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:42102 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35976 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49938 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33024 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33034 - "GET / HTTP/1.0" 200 OK 2026-03-15 07:11:05,539 - lava_callback - INFO - Received callback for node 69b3b875974c91e64560feeb INFO: 172.21.0.1:60136 - "POST /node/69b3b875974c91e64560feeb HTTP/1.0" 202 Accepted 2026-03-15 07:11:05,545 - lava_callback - INFO - Starting async job submit for node 69b3b875974c91e64560feeb 2026-03-15 07:11:05,546 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 07:11:05,568 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b3b875974c91e64560feeb HTTP/1.1" 200 None 2026-03-15 07:11:05,568 - lava_callback - DEBUG - Processing node 69b3b875974c91e64560feeb: baseline-arm-clabbe 2026-03-15 07:11:05,569 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b3b875974c91e64560feeb 2026-03-15 07:11:05,569 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 07:11:05,583 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b3b875974c91e64560feeb HTTP/1.1" 200 None 2026-03-15 07:11:05,584 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 07:11:05,598 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ae11668ef4424e487b2ea2 HTTP/1.1" 200 None 2026-03-15 07:11:05,599 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 07:11:05,620 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b3b875974c91e64560feeb HTTP/1.1" 200 None 2026-03-15 07:11:05,622 - lava_callback - ERROR - Error processing callback for node 69b3b875974c91e64560feeb: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:60150 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52418 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:52426 - "GET / HTTP/1.0" 200 OK 2026-03-15 07:11:25,524 - lava_callback - INFO - Received callback for node 69b3b899974c91e64560fef5 INFO: 172.21.0.1:55302 - "POST /node/69b3b899974c91e64560fef5 HTTP/1.0" 202 Accepted 2026-03-15 07:11:25,530 - lava_callback - INFO - Starting async job submit for node 69b3b899974c91e64560fef5 2026-03-15 07:11:25,531 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 07:11:25,544 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b3b899974c91e64560fef5 HTTP/1.1" 200 None 2026-03-15 07:11:25,545 - lava_callback - DEBUG - Processing node 69b3b899974c91e64560fef5: baseline-arm-clabbe 2026-03-15 07:11:25,546 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b3b899974c91e64560fef5 2026-03-15 07:11:25,546 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 07:11:25,559 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b3b899974c91e64560fef5 HTTP/1.1" 200 None 2026-03-15 07:11:25,561 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 07:11:25,581 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ae11668ef4424e487b2ea2 HTTP/1.1" 200 None 2026-03-15 07:11:25,582 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 07:11:25,612 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b3b899974c91e64560fef5 HTTP/1.1" 200 None 2026-03-15 07:11:25,623 - lava_callback - ERROR - Error processing callback for node 69b3b899974c91e64560fef5: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:55318 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49620 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49618 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47342 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47358 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46630 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:32900 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:32916 - "GET / HTTP/1.0" 200 OK 2026-03-15 07:12:24,761 - lava_callback - INFO - Received callback for node 69b3b8c3974c91e64560ff00 INFO: 172.21.0.1:53040 - "POST /node/69b3b8c3974c91e64560ff00 HTTP/1.0" 202 Accepted 2026-03-15 07:12:24,767 - lava_callback - INFO - Starting async job submit for node 69b3b8c3974c91e64560ff00 2026-03-15 07:12:24,768 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 07:12:24,781 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b3b8c3974c91e64560ff00 HTTP/1.1" 200 None 2026-03-15 07:12:24,782 - lava_callback - DEBUG - Processing node 69b3b8c3974c91e64560ff00: baseline-arm64-baylibre 2026-03-15 07:12:24,782 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b3b8c3974c91e64560ff00 2026-03-15 07:12:24,783 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 07:12:24,796 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b3b8c3974c91e64560ff00 HTTP/1.1" 200 None 2026-03-15 07:12:24,797 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 07:12:24,812 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b0b5149d19175818251feb HTTP/1.1" 200 None 2026-03-15 07:12:24,813 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 07:12:24,834 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b3b8c3974c91e64560ff00 HTTP/1.1" 200 None 2026-03-15 07:12:24,841 - lava_callback - ERROR - Error processing callback for node 69b3b8c3974c91e64560ff00: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:53052 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37206 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60434 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35224 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35234 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54436 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55772 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:55780 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51646 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40544 - "GET / HTTP/1.0" 200 OK 2026-03-15 07:13:44,757 - lava_callback - INFO - Received callback for node 69b3b915974c91e64560ff1a INFO: 172.21.0.1:50554 - "POST /node/69b3b915974c91e64560ff1a HTTP/1.0" 202 Accepted 2026-03-15 07:13:44,762 - lava_callback - INFO - Starting async job submit for node 69b3b915974c91e64560ff1a 2026-03-15 07:13:44,763 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 07:13:44,777 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b3b915974c91e64560ff1a HTTP/1.1" 200 None 2026-03-15 07:13:44,778 - lava_callback - DEBUG - Processing node 69b3b915974c91e64560ff1a: baseline-arm64-baylibre 2026-03-15 07:13:44,778 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b3b915974c91e64560ff1a 2026-03-15 07:13:44,779 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 07:13:44,794 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b3b915974c91e64560ff1a HTTP/1.1" 200 None 2026-03-15 07:13:44,795 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 07:13:44,808 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b0b5149d19175818251feb HTTP/1.1" 200 None 2026-03-15 07:13:44,810 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 07:13:44,831 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b3b915974c91e64560ff1a HTTP/1.1" 200 None 2026-03-15 07:13:44,837 - lava_callback - ERROR - Error processing callback for node 69b3b915974c91e64560ff1a: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:50556 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40770 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40782 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46210 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42434 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:42440 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57450 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57496 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34724 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45578 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45588 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53084 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57506 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:57514 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52890 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33492 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59792 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43446 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43448 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52096 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52016 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:52022 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58998 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40938 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41554 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33662 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33664 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34760 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34246 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:34254 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38732 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49430 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39724 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33138 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33148 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43852 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57930 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:57940 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51264 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54644 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34638 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52918 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52930 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37590 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33458 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:33466 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54972 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43288 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35642 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44720 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44732 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43990 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55968 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:55978 - "GET / HTTP/1.0" 200 OK 2026-03-15 07:20:25,182 - lava_callback - INFO - Received callback for node 69b3baaf974c91e64560ff80 INFO: 172.21.0.1:36826 - "POST /node/69b3baaf974c91e64560ff80 HTTP/1.0" 202 Accepted 2026-03-15 07:20:25,188 - lava_callback - INFO - Starting async job submit for node 69b3baaf974c91e64560ff80 2026-03-15 07:20:25,188 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 07:20:25,203 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b3baaf974c91e64560ff80 HTTP/1.1" 200 None 2026-03-15 07:20:25,204 - lava_callback - DEBUG - Processing node 69b3baaf974c91e64560ff80: baseline-arm64-baylibre 2026-03-15 07:20:25,204 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b3baaf974c91e64560ff80 2026-03-15 07:20:25,205 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 07:20:25,219 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b3baaf974c91e64560ff80 HTTP/1.1" 200 None 2026-03-15 07:20:25,221 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 07:20:25,235 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b3594d974c91e64560e4b2 HTTP/1.1" 200 None 2026-03-15 07:20:25,236 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 07:20:25,257 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b3baaf974c91e64560ff80 HTTP/1.1" 200 None 2026-03-15 07:20:25,263 - lava_callback - ERROR - Error processing callback for node 69b3baaf974c91e64560ff80: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:36832 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45750 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54890 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60176 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60184 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60486 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39610 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:39616 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56552 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35392 - "GET / HTTP/1.0" 200 OK 2026-03-15 07:21:45,392 - lava_callback - INFO - Received callback for node 69b3bb01974c91e64560ff98 INFO: 172.21.0.1:35632 - "POST /node/69b3bb01974c91e64560ff98 HTTP/1.0" 202 Accepted 2026-03-15 07:21:45,397 - lava_callback - INFO - Starting async job submit for node 69b3bb01974c91e64560ff98 2026-03-15 07:21:45,398 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 07:21:45,413 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b3bb01974c91e64560ff98 HTTP/1.1" 200 None 2026-03-15 07:21:45,414 - lava_callback - DEBUG - Processing node 69b3bb01974c91e64560ff98: baseline-arm64-baylibre 2026-03-15 07:21:45,414 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b3bb01974c91e64560ff98 2026-03-15 07:21:45,415 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 07:21:45,428 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b3bb01974c91e64560ff98 HTTP/1.1" 200 None 2026-03-15 07:21:45,430 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 07:21:45,447 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b3594d974c91e64560e4b2 HTTP/1.1" 200 None 2026-03-15 07:21:45,449 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 07:21:45,470 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b3bb01974c91e64560ff98 HTTP/1.1" 200 None 2026-03-15 07:21:45,476 - lava_callback - ERROR - Error processing callback for node 69b3bb01974c91e64560ff98: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:35640 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52090 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52092 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39680 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58070 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:58082 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37030 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51616 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36756 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59950 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59962 - "GET / HTTP/1.0" 200 OK 2026-03-15 07:23:06,302 - lava_callback - INFO - Received callback for node 69b3bb53974c91e64560ffb0 INFO: 172.21.0.1:47558 - "POST /node/69b3bb53974c91e64560ffb0 HTTP/1.0" 202 Accepted 2026-03-15 07:23:06,308 - lava_callback - INFO - Starting async job submit for node 69b3bb53974c91e64560ffb0 2026-03-15 07:23:06,309 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 07:23:06,323 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b3bb53974c91e64560ffb0 HTTP/1.1" 200 None 2026-03-15 07:23:06,324 - lava_callback - DEBUG - Processing node 69b3bb53974c91e64560ffb0: baseline-arm64-baylibre 2026-03-15 07:23:06,325 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b3bb53974c91e64560ffb0 2026-03-15 07:23:06,325 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 07:23:06,355 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b3bb53974c91e64560ffb0 HTTP/1.1" 200 None 2026-03-15 07:23:06,357 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 07:23:06,372 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b3594d974c91e64560e4b2 HTTP/1.1" 200 None 2026-03-15 07:23:06,374 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 07:23:06,407 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b3bb53974c91e64560ffb0 HTTP/1.1" 200 None 2026-03-15 07:23:06,408 - lava_callback - ERROR - Error processing callback for node 69b3bb53974c91e64560ffb0: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:47572 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50142 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:50152 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58404 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46350 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45598 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47312 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47314 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46966 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35996 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:36008 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50956 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48992 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53180 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:32970 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:32974 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58042 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53594 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:53598 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41954 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49846 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42834 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54276 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54288 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40180 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38256 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:38270 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34578 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34054 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55160 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40754 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40760 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56008 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33884 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:33900 - "GET / HTTP/1.0" 200 OK 2026-03-15 07:27:26,284 - lava_callback - INFO - Received callback for node 69b3bc52974c91e64560ffee INFO: 172.21.0.1:56114 - "POST /node/69b3bc52974c91e64560ffee HTTP/1.0" 202 Accepted 2026-03-15 07:27:26,289 - lava_callback - INFO - Starting async job submit for node 69b3bc52974c91e64560ffee 2026-03-15 07:27:26,290 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 07:27:26,306 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b3bc52974c91e64560ffee HTTP/1.1" 200 None 2026-03-15 07:27:26,307 - lava_callback - DEBUG - Processing node 69b3bc52974c91e64560ffee: baseline-arm64-clabbe 2026-03-15 07:27:26,307 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b3bc52974c91e64560ffee 2026-03-15 07:27:26,308 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 07:27:26,321 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b3bc52974c91e64560ffee HTTP/1.1" 200 None 2026-03-15 07:27:26,323 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 07:27:26,336 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b3594d974c91e64560e4b2 HTTP/1.1" 200 None 2026-03-15 07:27:26,338 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 07:27:26,360 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b3bc52974c91e64560ffee HTTP/1.1" 200 None 2026-03-15 07:27:26,362 - lava_callback - ERROR - Error processing callback for node 69b3bc52974c91e64560ffee: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:56130 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55648 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46402 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41756 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41766 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34766 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36206 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:36208 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43916 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52066 - "GET / HTTP/1.0" 200 OK 2026-03-15 07:28:46,353 - lava_callback - INFO - Received callback for node 69b3bca5974c91e645610003 INFO: 172.21.0.1:35022 - "POST /node/69b3bca5974c91e645610003 HTTP/1.0" 202 Accepted 2026-03-15 07:28:46,358 - lava_callback - INFO - Starting async job submit for node 69b3bca5974c91e645610003 2026-03-15 07:28:46,359 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 07:28:46,374 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b3bca5974c91e645610003 HTTP/1.1" 200 None 2026-03-15 07:28:46,375 - lava_callback - DEBUG - Processing node 69b3bca5974c91e645610003: baseline-arm64-clabbe 2026-03-15 07:28:46,376 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b3bca5974c91e645610003 2026-03-15 07:28:46,376 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 07:28:46,389 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b3bca5974c91e645610003 HTTP/1.1" 200 None 2026-03-15 07:28:46,391 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 07:28:46,404 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b3594d974c91e64560e4b2 HTTP/1.1" 200 None 2026-03-15 07:28:46,405 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 07:28:46,436 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b3bca5974c91e645610003 HTTP/1.1" 200 None 2026-03-15 07:28:46,437 - lava_callback - ERROR - Error processing callback for node 69b3bca5974c91e645610003: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:35032 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36142 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36158 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36088 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34144 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:34154 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33056 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38096 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57878 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58120 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58136 - "GET / HTTP/1.0" 200 OK 2026-03-15 07:30:06,520 - lava_callback - INFO - Received callback for node 69b3bcf8974c91e64561001b INFO: 172.21.0.1:44588 - "POST /node/69b3bcf8974c91e64561001b HTTP/1.0" 202 Accepted 2026-03-15 07:30:06,525 - lava_callback - INFO - Starting async job submit for node 69b3bcf8974c91e64561001b 2026-03-15 07:30:06,526 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 INFO: 172.21.0.1:44604 - "GET / HTTP/1.0" 200 OK 2026-03-15 07:30:06,568 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b3bcf8974c91e64561001b HTTP/1.1" 200 None 2026-03-15 07:30:06,568 - lava_callback - DEBUG - Processing node 69b3bcf8974c91e64561001b: baseline-arm64-clabbe 2026-03-15 07:30:06,569 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b3bcf8974c91e64561001b 2026-03-15 07:30:06,569 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 07:30:06,583 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b3bcf8974c91e64561001b HTTP/1.1" 200 None 2026-03-15 07:30:06,584 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 07:30:06,609 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b3594d974c91e64560e4b2 HTTP/1.1" 200 None 2026-03-15 07:30:06,610 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 07:30:06,632 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b3bcf8974c91e64561001b HTTP/1.1" 200 None 2026-03-15 07:30:06,633 - lava_callback - ERROR - Error processing callback for node 69b3bcf8974c91e64561001b: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:37882 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:37892 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60990 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57678 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60760 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49148 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49164 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35144 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37978 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:37980 - "GET / HTTP/1.0" 200 OK 2026-03-15 07:31:26,410 - lava_callback - INFO - Received callback for node 69b3bd47974c91e645610023 INFO: 172.21.0.1:50836 - "POST /node/69b3bd47974c91e645610023 HTTP/1.0" 202 Accepted 2026-03-15 07:31:26,416 - lava_callback - INFO - Starting async job submit for node 69b3bd47974c91e645610023 2026-03-15 07:31:26,417 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 07:31:26,431 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b3bd47974c91e645610023 HTTP/1.1" 200 None 2026-03-15 07:31:26,432 - lava_callback - DEBUG - Processing node 69b3bd47974c91e645610023: baseline-arm64-clabbe 2026-03-15 07:31:26,432 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b3bd47974c91e645610023 2026-03-15 07:31:26,433 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 07:31:26,447 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b3bd47974c91e645610023 HTTP/1.1" 200 None 2026-03-15 07:31:26,448 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 07:31:26,462 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b3594d974c91e64560e4b2 HTTP/1.1" 200 None 2026-03-15 07:31:26,463 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 07:31:26,492 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b3bd47974c91e645610023 HTTP/1.1" 200 None 2026-03-15 07:31:26,493 - lava_callback - ERROR - Error processing callback for node 69b3bd47974c91e645610023: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:50852 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51952 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60804 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38978 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38988 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47722 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55314 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:55318 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41718 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46740 - "GET / HTTP/1.0" 200 OK 2026-03-15 07:32:46,479 - lava_callback - INFO - Received callback for node 69b3bd96974c91e645610032 INFO: 172.21.0.1:49390 - "POST /node/69b3bd96974c91e645610032 HTTP/1.0" 202 Accepted 2026-03-15 07:32:46,485 - lava_callback - INFO - Starting async job submit for node 69b3bd96974c91e645610032 2026-03-15 07:32:46,486 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 07:32:46,500 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b3bd96974c91e645610032 HTTP/1.1" 200 None 2026-03-15 07:32:46,501 - lava_callback - DEBUG - Processing node 69b3bd96974c91e645610032: baseline-arm64-clabbe 2026-03-15 07:32:46,501 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b3bd96974c91e645610032 2026-03-15 07:32:46,501 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 07:32:46,514 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b3bd96974c91e645610032 HTTP/1.1" 200 None 2026-03-15 07:32:46,516 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 INFO: 172.21.0.1:49398 - "GET / HTTP/1.0" 200 OK 2026-03-15 07:32:46,530 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b3594d974c91e64560e4b2 HTTP/1.1" 200 None 2026-03-15 07:32:46,531 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 07:32:46,555 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b3bd96974c91e645610032 HTTP/1.1" 200 None 2026-03-15 07:32:46,556 - lava_callback - ERROR - Error processing callback for node 69b3bd96974c91e645610032: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:54434 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54442 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54926 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33712 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:33726 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45564 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60258 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54560 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42706 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42708 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40890 - "GET / HTTP/1.0" 200 OK 2026-03-15 07:34:06,591 - lava_callback - INFO - Received callback for node 69b3bde7974c91e645610047 INFO: 172.21.0.1:40906 - "POST /node/69b3bde7974c91e645610047 HTTP/1.0" 202 Accepted 2026-03-15 07:34:06,597 - lava_callback - INFO - Starting async job submit for node 69b3bde7974c91e645610047 2026-03-15 07:34:06,597 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 07:34:06,612 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b3bde7974c91e645610047 HTTP/1.1" 200 None 2026-03-15 07:34:06,613 - lava_callback - DEBUG - Processing node 69b3bde7974c91e645610047: baseline-arm64-clabbe 2026-03-15 07:34:06,613 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b3bde7974c91e645610047 2026-03-15 07:34:06,614 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 07:34:06,634 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b3bde7974c91e645610047 HTTP/1.1" 200 None 2026-03-15 07:34:06,635 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 07:34:06,648 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b3594d974c91e64560e4b2 HTTP/1.1" 200 None 2026-03-15 07:34:06,650 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 07:34:06,674 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b3bde7974c91e645610047 HTTP/1.1" 200 None 2026-03-15 07:34:06,683 - lava_callback - ERROR - Error processing callback for node 69b3bde7974c91e645610047: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:47212 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:47218 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46418 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51196 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54176 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46464 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46476 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56512 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55764 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:55774 - "GET / HTTP/1.0" 200 OK 2026-03-15 07:35:25,935 - lava_callback - INFO - Received callback for node 69b3be32974c91e645610057 INFO: 172.21.0.1:46590 - "POST /node/69b3be32974c91e645610057 HTTP/1.0" 202 Accepted 2026-03-15 07:35:25,940 - lava_callback - INFO - Starting async job submit for node 69b3be32974c91e645610057 2026-03-15 07:35:25,941 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 07:35:25,957 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b3be32974c91e645610057 HTTP/1.1" 200 None 2026-03-15 07:35:25,958 - lava_callback - DEBUG - Processing node 69b3be32974c91e645610057: baseline-arm64-baylibre 2026-03-15 07:35:25,958 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b3be32974c91e645610057 2026-03-15 07:35:25,959 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 07:35:25,975 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b3be32974c91e645610057 HTTP/1.1" 200 None 2026-03-15 07:35:25,976 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 07:35:25,989 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b0b5149d19175818251feb HTTP/1.1" 200 None 2026-03-15 07:35:25,991 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 07:35:26,012 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b3be32974c91e645610057 HTTP/1.1" 200 None 2026-03-15 07:35:26,019 - lava_callback - ERROR - Error processing callback for node 69b3be32974c91e645610057: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:46604 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39042 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44606 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37744 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37752 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36142 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38114 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:38122 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47902 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46788 - "GET / HTTP/1.0" 200 OK 2026-03-15 07:36:45,900 - lava_callback - INFO - Received callback for node 69b3be84974c91e64561006d INFO: 172.21.0.1:54466 - "POST /node/69b3be84974c91e64561006d HTTP/1.0" 202 Accepted 2026-03-15 07:36:45,906 - lava_callback - INFO - Starting async job submit for node 69b3be84974c91e64561006d 2026-03-15 07:36:45,907 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 07:36:45,923 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b3be84974c91e64561006d HTTP/1.1" 200 None 2026-03-15 07:36:45,924 - lava_callback - DEBUG - Processing node 69b3be84974c91e64561006d: baseline-arm64-baylibre 2026-03-15 07:36:45,924 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b3be84974c91e64561006d 2026-03-15 07:36:45,924 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 07:36:45,938 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b3be84974c91e64561006d HTTP/1.1" 200 None 2026-03-15 07:36:45,939 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 07:36:45,953 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b0b5149d19175818251feb HTTP/1.1" 200 None 2026-03-15 07:36:45,954 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 07:36:45,978 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b3be84974c91e64561006d HTTP/1.1" 200 None 2026-03-15 07:36:45,985 - lava_callback - ERROR - Error processing callback for node 69b3be84974c91e64561006d: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:54480 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58624 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58632 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45404 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59450 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:59462 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48892 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51074 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48654 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44916 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44932 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56060 - "GET / HTTP/1.0" 200 OK 2026-03-15 07:38:06,787 - lava_callback - INFO - Received callback for node 69b3bedb974c91e645610086 INFO: 172.21.0.1:56074 - "POST /node/69b3bedb974c91e645610086 HTTP/1.0" 202 Accepted 2026-03-15 07:38:06,792 - lava_callback - INFO - Starting async job submit for node 69b3bedb974c91e645610086 2026-03-15 07:38:06,793 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 07:38:06,807 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b3bedb974c91e645610086 HTTP/1.1" 200 None 2026-03-15 07:38:06,808 - lava_callback - DEBUG - Processing node 69b3bedb974c91e645610086: baseline-arm64-clabbe 2026-03-15 07:38:06,808 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b3bedb974c91e645610086 2026-03-15 07:38:06,809 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 07:38:06,822 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b3bedb974c91e645610086 HTTP/1.1" 200 None 2026-03-15 07:38:06,824 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 07:38:06,837 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b0b5149d19175818251feb HTTP/1.1" 200 None 2026-03-15 07:38:06,838 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 07:38:06,858 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b3bedb974c91e645610086 HTTP/1.1" 200 None 2026-03-15 07:38:06,861 - lava_callback - ERROR - Error processing callback for node 69b3bedb974c91e645610086: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:37844 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:37858 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52016 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35766 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42356 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55646 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55658 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46224 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44490 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:44492 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47768 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51418 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54068 - "GET / HTTP/1.0" 200 OK 2026-03-15 07:39:46,818 - lava_callback - INFO - Received callback for node 69b3bf2d974c91e64561009c INFO: 172.21.0.1:54076 - "POST /node/69b3bf2d974c91e64561009c HTTP/1.0" 202 Accepted 2026-03-15 07:39:46,824 - lava_callback - INFO - Starting async job submit for node 69b3bf2d974c91e64561009c 2026-03-15 07:39:46,824 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 07:39:46,842 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b3bf2d974c91e64561009c HTTP/1.1" 200 None 2026-03-15 07:39:46,843 - lava_callback - DEBUG - Processing node 69b3bf2d974c91e64561009c: baseline-arm64-clabbe 2026-03-15 07:39:46,843 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b3bf2d974c91e64561009c 2026-03-15 07:39:46,844 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 07:39:46,857 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b3bf2d974c91e64561009c HTTP/1.1" 200 None 2026-03-15 07:39:46,859 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 07:39:46,898 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b0b5149d19175818251feb HTTP/1.1" 200 None 2026-03-15 07:39:46,900 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 07:39:46,924 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b3bf2d974c91e64561009c HTTP/1.1" 200 None 2026-03-15 07:39:46,929 - lava_callback - ERROR - Error processing callback for node 69b3bf2d974c91e64561009c: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:50138 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50140 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50428 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39082 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:39086 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38132 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53364 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48882 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59028 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59030 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60400 - "GET / HTTP/1.0" 200 OK 2026-03-15 07:41:06,896 - lava_callback - INFO - Received callback for node 69b3bf7f974c91e6456100a9 INFO: 172.21.0.1:60416 - "POST /node/69b3bf7f974c91e6456100a9 HTTP/1.0" 202 Accepted 2026-03-15 07:41:06,902 - lava_callback - INFO - Starting async job submit for node 69b3bf7f974c91e6456100a9 2026-03-15 07:41:06,903 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 07:41:06,921 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b3bf7f974c91e6456100a9 HTTP/1.1" 200 None 2026-03-15 07:41:06,922 - lava_callback - DEBUG - Processing node 69b3bf7f974c91e6456100a9: baseline-arm64-clabbe 2026-03-15 07:41:06,922 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b3bf7f974c91e6456100a9 2026-03-15 07:41:06,923 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 07:41:06,936 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b3bf7f974c91e6456100a9 HTTP/1.1" 200 None 2026-03-15 07:41:06,937 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 07:41:06,951 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b0b5149d19175818251feb HTTP/1.1" 200 None 2026-03-15 07:41:06,952 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 07:41:06,974 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b3bf7f974c91e6456100a9 HTTP/1.1" 200 None 2026-03-15 07:41:06,976 - lava_callback - ERROR - Error processing callback for node 69b3bf7f974c91e6456100a9: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:51234 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:51242 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48206 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38068 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34108 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38948 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38956 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50036 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41230 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:41232 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44610 - "GET / HTTP/1.0" 200 OK 2026-03-15 07:42:27,203 - lava_callback - INFO - Received callback for node 69b3bfd0974c91e6456100bf INFO: 172.21.0.1:44624 - "POST /node/69b3bfd0974c91e6456100bf HTTP/1.0" 202 Accepted 2026-03-15 07:42:27,209 - lava_callback - INFO - Starting async job submit for node 69b3bfd0974c91e6456100bf 2026-03-15 07:42:27,210 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 07:42:27,224 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b3bfd0974c91e6456100bf HTTP/1.1" 200 None 2026-03-15 07:42:27,225 - lava_callback - DEBUG - Processing node 69b3bfd0974c91e6456100bf: baseline-arm64-clabbe 2026-03-15 07:42:27,225 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b3bfd0974c91e6456100bf 2026-03-15 07:42:27,226 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 07:42:27,239 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b3bfd0974c91e6456100bf HTTP/1.1" 200 None 2026-03-15 07:42:27,240 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 07:42:27,276 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b0b5149d19175818251feb HTTP/1.1" 200 None 2026-03-15 07:42:27,278 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 07:42:27,298 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b3bfd0974c91e6456100bf HTTP/1.1" 200 None 2026-03-15 07:42:27,300 - lava_callback - ERROR - Error processing callback for node 69b3bfd0974c91e6456100bf: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:48882 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56762 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44480 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44488 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60066 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58460 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:58464 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48354 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46120 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48158 - "GET / HTTP/1.0" 200 OK 2026-03-15 07:43:47,002 - lava_callback - INFO - Received callback for node 69b3c023974c91e6456100d3 INFO: 172.21.0.1:48160 - "POST /node/69b3c023974c91e6456100d3 HTTP/1.0" 202 Accepted 2026-03-15 07:43:47,007 - lava_callback - INFO - Starting async job submit for node 69b3c023974c91e6456100d3 2026-03-15 07:43:47,008 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 07:43:47,022 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b3c023974c91e6456100d3 HTTP/1.1" 200 None 2026-03-15 07:43:47,023 - lava_callback - DEBUG - Processing node 69b3c023974c91e6456100d3: baseline-arm64-clabbe 2026-03-15 07:43:47,023 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b3c023974c91e6456100d3 2026-03-15 07:43:47,024 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 07:43:47,038 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b3c023974c91e6456100d3 HTTP/1.1" 200 None 2026-03-15 07:43:47,039 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 07:43:47,052 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b0b5149d19175818251feb HTTP/1.1" 200 None 2026-03-15 07:43:47,054 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 07:43:47,076 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b3c023974c91e6456100d3 HTTP/1.1" 200 None 2026-03-15 07:43:47,078 - lava_callback - ERROR - Error processing callback for node 69b3c023974c91e6456100d3: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:33544 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33546 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54874 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59000 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:59012 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33888 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56504 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46242 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52232 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52238 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45262 - "GET / HTTP/1.0" 200 OK 2026-03-15 07:45:07,108 - lava_callback - INFO - Received callback for node 69b3c077974c91e6456100e9 INFO: 172.21.0.1:45272 - "POST /node/69b3c077974c91e6456100e9 HTTP/1.0" 202 Accepted 2026-03-15 07:45:07,113 - lava_callback - INFO - Starting async job submit for node 69b3c077974c91e6456100e9 2026-03-15 07:45:07,114 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 07:45:07,129 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b3c077974c91e6456100e9 HTTP/1.1" 200 None 2026-03-15 07:45:07,130 - lava_callback - DEBUG - Processing node 69b3c077974c91e6456100e9: baseline-arm64-clabbe 2026-03-15 07:45:07,130 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b3c077974c91e6456100e9 2026-03-15 07:45:07,131 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 07:45:07,144 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b3c077974c91e6456100e9 HTTP/1.1" 200 None 2026-03-15 07:45:07,145 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 07:45:07,158 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b0b5149d19175818251feb HTTP/1.1" 200 None 2026-03-15 07:45:07,160 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 07:45:07,190 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b3c077974c91e6456100e9 HTTP/1.1" 200 None 2026-03-15 07:45:07,195 - lava_callback - ERROR - Error processing callback for node 69b3c077974c91e6456100e9: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:43498 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:43502 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45960 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46462 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53232 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53234 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53236 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53242 - "GET /favicon.ico HTTP/1.0" 404 Not Found INFO: 172.21.0.1:59066 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59082 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59092 - "GET /sitemap.xml HTTP/1.0" 404 Not Found INFO: 172.21.0.1:47656 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52064 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:52068 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45198 - "GET / HTTP/1.0" 200 OK 2026-03-15 07:46:27,213 - lava_callback - INFO - Received callback for node 69b3c0c9974c91e6456100f9 INFO: 172.21.0.1:45212 - "POST /node/69b3c0c9974c91e6456100f9 HTTP/1.0" 202 Accepted 2026-03-15 07:46:27,218 - lava_callback - INFO - Starting async job submit for node 69b3c0c9974c91e6456100f9 2026-03-15 07:46:27,219 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 07:46:27,233 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b3c0c9974c91e6456100f9 HTTP/1.1" 200 None 2026-03-15 07:46:27,234 - lava_callback - DEBUG - Processing node 69b3c0c9974c91e6456100f9: baseline-arm64-clabbe 2026-03-15 07:46:27,234 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b3c0c9974c91e6456100f9 2026-03-15 07:46:27,235 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 07:46:27,249 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b3c0c9974c91e6456100f9 HTTP/1.1" 200 None 2026-03-15 07:46:27,251 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 07:46:27,264 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b0b5149d19175818251feb HTTP/1.1" 200 None 2026-03-15 07:46:27,265 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 07:46:27,286 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b3c0c9974c91e6456100f9 HTTP/1.1" 200 None 2026-03-15 07:46:27,293 - lava_callback - ERROR - Error processing callback for node 69b3c0c9974c91e6456100f9: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:50300 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34486 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35078 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35080 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37262 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33034 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:33048 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57960 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44226 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34870 - "GET / HTTP/1.0" 200 OK 2026-03-15 07:47:47,214 - lava_callback - INFO - Received callback for node 69b3c11c974c91e645610112 INFO: 172.21.0.1:34886 - "POST /node/69b3c11c974c91e645610112 HTTP/1.0" 202 Accepted 2026-03-15 07:47:47,220 - lava_callback - INFO - Starting async job submit for node 69b3c11c974c91e645610112 2026-03-15 07:47:47,221 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 07:47:47,238 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b3c11c974c91e645610112 HTTP/1.1" 200 None 2026-03-15 07:47:47,239 - lava_callback - DEBUG - Processing node 69b3c11c974c91e645610112: baseline-arm64-clabbe 2026-03-15 07:47:47,239 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b3c11c974c91e645610112 2026-03-15 07:47:47,240 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 07:47:47,253 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b3c11c974c91e645610112 HTTP/1.1" 200 None 2026-03-15 07:47:47,255 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 07:47:47,289 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b0b5149d19175818251feb HTTP/1.1" 200 None 2026-03-15 07:47:47,291 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 07:47:47,316 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b3c11c974c91e645610112 HTTP/1.1" 200 None 2026-03-15 07:47:47,322 - lava_callback - ERROR - Error processing callback for node 69b3c11c974c91e645610112: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:36284 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36292 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42250 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37044 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:37052 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38602 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50428 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53080 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34142 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34144 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50236 - "GET / HTTP/1.0" 200 OK 2026-03-15 07:49:07,251 - lava_callback - INFO - Received callback for node 69b3c16e974c91e64561011e INFO: 172.21.0.1:50240 - "POST /node/69b3c16e974c91e64561011e HTTP/1.0" 202 Accepted 2026-03-15 07:49:07,257 - lava_callback - INFO - Starting async job submit for node 69b3c16e974c91e64561011e 2026-03-15 07:49:07,258 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 07:49:07,279 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b3c16e974c91e64561011e HTTP/1.1" 200 None 2026-03-15 07:49:07,280 - lava_callback - DEBUG - Processing node 69b3c16e974c91e64561011e: baseline-arm64-clabbe 2026-03-15 07:49:07,280 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b3c16e974c91e64561011e 2026-03-15 07:49:07,281 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 07:49:07,320 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b3c16e974c91e64561011e HTTP/1.1" 200 None 2026-03-15 07:49:07,321 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 07:49:07,335 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b0b5149d19175818251feb HTTP/1.1" 200 None 2026-03-15 07:49:07,337 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 07:49:07,358 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b3c16e974c91e64561011e HTTP/1.1" 200 None 2026-03-15 07:49:07,363 - lava_callback - ERROR - Error processing callback for node 69b3c16e974c91e64561011e: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:33520 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:33534 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53744 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46150 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51380 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50132 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50146 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37920 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50338 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:50342 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45378 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46690 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53946 - "GET / HTTP/1.0" 200 OK 2026-03-15 07:50:47,328 - lava_callback - INFO - Received callback for node 69b3c1c2974c91e64561012b INFO: 172.21.0.1:53954 - "POST /node/69b3c1c2974c91e64561012b HTTP/1.0" 202 Accepted 2026-03-15 07:50:47,333 - lava_callback - INFO - Starting async job submit for node 69b3c1c2974c91e64561012b 2026-03-15 07:50:47,334 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 07:50:47,351 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b3c1c2974c91e64561012b HTTP/1.1" 200 None 2026-03-15 07:50:47,352 - lava_callback - DEBUG - Processing node 69b3c1c2974c91e64561012b: baseline-arm64-clabbe 2026-03-15 07:50:47,352 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b3c1c2974c91e64561012b 2026-03-15 07:50:47,353 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 07:50:47,370 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b3c1c2974c91e64561012b HTTP/1.1" 200 None 2026-03-15 07:50:47,372 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 07:50:47,407 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b0b5149d19175818251feb HTTP/1.1" 200 None 2026-03-15 07:50:47,409 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 07:50:47,431 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b3c1c2974c91e64561012b HTTP/1.1" 200 None 2026-03-15 07:50:47,432 - lava_callback - ERROR - Error processing callback for node 69b3c1c2974c91e64561012b: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:53530 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53538 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41540 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37594 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:37600 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59086 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45312 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42698 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33638 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33654 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49144 - "GET / HTTP/1.0" 200 OK 2026-03-15 07:52:07,445 - lava_callback - INFO - Received callback for node 69b3c214974c91e645610137 INFO: 172.21.0.1:49158 - "POST /node/69b3c214974c91e645610137 HTTP/1.0" 202 Accepted 2026-03-15 07:52:07,450 - lava_callback - INFO - Starting async job submit for node 69b3c214974c91e645610137 2026-03-15 07:52:07,451 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 07:52:07,466 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b3c214974c91e645610137 HTTP/1.1" 200 None 2026-03-15 07:52:07,467 - lava_callback - DEBUG - Processing node 69b3c214974c91e645610137: baseline-arm64-clabbe 2026-03-15 07:52:07,467 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b3c214974c91e645610137 2026-03-15 07:52:07,468 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 07:52:07,487 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b3c214974c91e645610137 HTTP/1.1" 200 None 2026-03-15 07:52:07,488 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 07:52:07,502 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b0b5149d19175818251feb HTTP/1.1" 200 None 2026-03-15 07:52:07,504 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 07:52:07,526 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b3c214974c91e645610137 HTTP/1.1" 200 None 2026-03-15 07:52:07,527 - lava_callback - ERROR - Error processing callback for node 69b3c214974c91e645610137: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:35894 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:35902 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42446 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40780 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48064 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45324 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45334 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46334 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56630 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:56644 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46342 - "GET / HTTP/1.0" 200 OK 2026-03-15 07:53:27,556 - lava_callback - INFO - Received callback for node 69b3c266974c91e645610144 INFO: 172.21.0.1:46354 - "POST /node/69b3c266974c91e645610144 HTTP/1.0" 202 Accepted 2026-03-15 07:53:27,562 - lava_callback - INFO - Starting async job submit for node 69b3c266974c91e645610144 2026-03-15 07:53:27,563 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 07:53:27,578 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b3c266974c91e645610144 HTTP/1.1" 200 None 2026-03-15 07:53:27,579 - lava_callback - DEBUG - Processing node 69b3c266974c91e645610144: baseline-arm64-clabbe 2026-03-15 07:53:27,579 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b3c266974c91e645610144 2026-03-15 07:53:27,580 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 07:53:27,596 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b3c266974c91e645610144 HTTP/1.1" 200 None 2026-03-15 07:53:27,598 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 07:53:27,646 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b0b5149d19175818251feb HTTP/1.1" 200 None 2026-03-15 07:53:27,647 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 07:53:27,668 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b3c266974c91e645610144 HTTP/1.1" 200 None 2026-03-15 07:53:27,674 - lava_callback - ERROR - Error processing callback for node 69b3c266974c91e645610144: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:33216 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48490 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59688 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59704 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58296 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54830 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:54844 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55284 - "GET / HTTP/1.0" 200 OK 2026-03-15 07:54:26,922 - lava_callback - INFO - Received callback for node 69b3c2ae974c91e64561014a INFO: 172.21.0.1:55296 - "POST /node/69b3c2ae974c91e64561014a HTTP/1.0" 202 Accepted 2026-03-15 07:54:26,931 - lava_callback - INFO - Starting async job submit for node 69b3c2ae974c91e64561014a 2026-03-15 07:54:26,932 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 07:54:26,959 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b3c2ae974c91e64561014a HTTP/1.1" 200 None 2026-03-15 07:54:26,960 - lava_callback - DEBUG - Processing node 69b3c2ae974c91e64561014a: baseline-arm64-baylibre 2026-03-15 07:54:26,960 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b3c2ae974c91e64561014a 2026-03-15 07:54:26,961 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 07:54:26,977 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b3c2ae974c91e64561014a HTTP/1.1" 200 None 2026-03-15 07:54:26,979 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 07:54:26,992 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ae11758ef4424e487b2eb1 HTTP/1.1" 200 None 2026-03-15 07:54:26,994 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 07:54:27,017 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b3c2ae974c91e64561014a HTTP/1.1" 200 None 2026-03-15 07:54:27,026 - lava_callback - ERROR - Error processing callback for node 69b3c2ae974c91e64561014a: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:41548 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36526 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60502 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60504 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60172 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53532 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:53544 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58556 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42892 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60164 - "GET / HTTP/1.0" 200 OK 2026-03-15 07:55:46,946 - lava_callback - INFO - Received callback for node 69b3c301974c91e645610158 INFO: 172.21.0.1:60168 - "POST /node/69b3c301974c91e645610158 HTTP/1.0" 202 Accepted 2026-03-15 07:55:46,952 - lava_callback - INFO - Starting async job submit for node 69b3c301974c91e645610158 2026-03-15 07:55:46,953 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 07:55:46,967 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b3c301974c91e645610158 HTTP/1.1" 200 None 2026-03-15 07:55:46,968 - lava_callback - DEBUG - Processing node 69b3c301974c91e645610158: baseline-arm64-baylibre 2026-03-15 07:55:46,968 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b3c301974c91e645610158 2026-03-15 07:55:46,969 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 07:55:46,982 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b3c301974c91e645610158 HTTP/1.1" 200 None 2026-03-15 07:55:46,984 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 07:55:46,997 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ae11758ef4424e487b2eb1 HTTP/1.1" 200 None 2026-03-15 07:55:46,999 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 07:55:47,025 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b3c301974c91e645610158 HTTP/1.1" 200 None 2026-03-15 07:55:47,026 - lava_callback - ERROR - Error processing callback for node 69b3c301974c91e645610158: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:52952 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52956 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39142 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50090 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:50102 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36132 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60088 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50516 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54578 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54584 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44670 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39060 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:39068 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44572 - "GET / HTTP/1.0" 200 OK 2026-03-15 07:57:26,996 - lava_callback - INFO - Received callback for node 69b3c352974c91e645610167 INFO: 172.21.0.1:44574 - "POST /node/69b3c352974c91e645610167 HTTP/1.0" 202 Accepted 2026-03-15 07:57:27,002 - lava_callback - INFO - Starting async job submit for node 69b3c352974c91e645610167 2026-03-15 07:57:27,003 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 07:57:27,022 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b3c352974c91e645610167 HTTP/1.1" 200 None 2026-03-15 07:57:27,023 - lava_callback - DEBUG - Processing node 69b3c352974c91e645610167: baseline-arm64-baylibre 2026-03-15 07:57:27,023 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b3c352974c91e645610167 2026-03-15 07:57:27,024 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 07:57:27,047 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b3c352974c91e645610167 HTTP/1.1" 200 None 2026-03-15 07:57:27,049 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 07:57:27,061 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ae11758ef4424e487b2eb1 HTTP/1.1" 200 None 2026-03-15 07:57:27,063 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 07:57:27,089 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b3c352974c91e645610167 HTTP/1.1" 200 None 2026-03-15 07:57:27,091 - lava_callback - ERROR - Error processing callback for node 69b3c352974c91e645610167: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:47302 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44056 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50858 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50862 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38124 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50016 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:50026 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45130 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49998 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55064 - "GET / HTTP/1.0" 200 OK 2026-03-15 07:58:47,099 - lava_callback - INFO - Received callback for node 69b3c3a3974c91e645610177 INFO: 172.21.0.1:55070 - "POST /node/69b3c3a3974c91e645610177 HTTP/1.0" 202 Accepted 2026-03-15 07:58:47,105 - lava_callback - INFO - Starting async job submit for node 69b3c3a3974c91e645610177 2026-03-15 07:58:47,106 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 07:58:47,121 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b3c3a3974c91e645610177 HTTP/1.1" 200 None 2026-03-15 07:58:47,122 - lava_callback - DEBUG - Processing node 69b3c3a3974c91e645610177: baseline-arm64-baylibre 2026-03-15 07:58:47,123 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b3c3a3974c91e645610177 2026-03-15 07:58:47,123 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 07:58:47,137 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b3c3a3974c91e645610177 HTTP/1.1" 200 None 2026-03-15 07:58:47,138 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 07:58:47,151 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ae11758ef4424e487b2eb1 HTTP/1.1" 200 None 2026-03-15 07:58:47,153 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 07:58:47,191 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b3c3a3974c91e645610177 HTTP/1.1" 200 None 2026-03-15 07:58:47,193 - lava_callback - ERROR - Error processing callback for node 69b3c3a3974c91e645610177: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:60956 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60972 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43920 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42144 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:42146 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56646 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45800 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43836 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36568 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36578 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58428 - "GET / HTTP/1.0" 200 OK 2026-03-15 08:00:07,165 - lava_callback - INFO - Received callback for node 69b3c3f5974c91e645610182 INFO: 172.21.0.1:58434 - "POST /node/69b3c3f5974c91e645610182 HTTP/1.0" 202 Accepted 2026-03-15 08:00:07,170 - lava_callback - INFO - Starting async job submit for node 69b3c3f5974c91e645610182 2026-03-15 08:00:07,171 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 08:00:07,186 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b3c3f5974c91e645610182 HTTP/1.1" 200 None 2026-03-15 08:00:07,187 - lava_callback - DEBUG - Processing node 69b3c3f5974c91e645610182: baseline-arm64-baylibre 2026-03-15 08:00:07,187 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b3c3f5974c91e645610182 2026-03-15 08:00:07,188 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 08:00:07,201 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b3c3f5974c91e645610182 HTTP/1.1" 200 None 2026-03-15 08:00:07,202 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 08:00:07,216 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ae11758ef4424e487b2eb1 HTTP/1.1" 200 None 2026-03-15 08:00:07,218 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 08:00:07,259 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b3c3f5974c91e645610182 HTTP/1.1" 200 None 2026-03-15 08:00:07,264 - lava_callback - ERROR - Error processing callback for node 69b3c3f5974c91e645610182: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:60596 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:60608 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44400 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34962 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37614 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59990 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59992 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39382 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56418 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:56422 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34956 - "GET / HTTP/1.0" 200 OK 2026-03-15 08:01:27,220 - lava_callback - INFO - Received callback for node 69b3c443974c91e64561018f INFO: 172.21.0.1:34968 - "POST /node/69b3c443974c91e64561018f HTTP/1.0" 202 Accepted 2026-03-15 08:01:27,226 - lava_callback - INFO - Starting async job submit for node 69b3c443974c91e64561018f 2026-03-15 08:01:27,227 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 08:01:27,245 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b3c443974c91e64561018f HTTP/1.1" 200 None 2026-03-15 08:01:27,246 - lava_callback - DEBUG - Processing node 69b3c443974c91e64561018f: baseline-arm64-baylibre 2026-03-15 08:01:27,246 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b3c443974c91e64561018f 2026-03-15 08:01:27,247 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 08:01:27,282 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b3c443974c91e64561018f HTTP/1.1" 200 None 2026-03-15 08:01:27,283 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 08:01:27,319 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ae11758ef4424e487b2eb1 HTTP/1.1" 200 None 2026-03-15 08:01:27,321 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 08:01:27,346 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b3c443974c91e64561018f HTTP/1.1" 200 None 2026-03-15 08:01:27,349 - lava_callback - ERROR - Error processing callback for node 69b3c443974c91e64561018f: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:40336 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46464 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53626 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53638 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53236 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41642 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:41658 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59698 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54776 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41882 - "GET / HTTP/1.0" 200 OK 2026-03-15 08:02:47,949 - lava_callback - INFO - Received callback for node 69b3c49e974c91e64561019f INFO: 172.21.0.1:41888 - "POST /node/69b3c49e974c91e64561019f HTTP/1.0" 202 Accepted 2026-03-15 08:02:47,954 - lava_callback - INFO - Starting async job submit for node 69b3c49e974c91e64561019f 2026-03-15 08:02:47,955 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 08:02:47,981 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b3c49e974c91e64561019f HTTP/1.1" 200 None 2026-03-15 08:02:47,982 - lava_callback - DEBUG - Processing node 69b3c49e974c91e64561019f: baseline-arm64-clabbe 2026-03-15 08:02:47,983 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b3c49e974c91e64561019f 2026-03-15 08:02:47,983 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 08:02:48,010 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b3c49e974c91e64561019f HTTP/1.1" 200 None 2026-03-15 08:02:48,012 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 08:02:48,047 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ae11758ef4424e487b2eb1 HTTP/1.1" 200 None 2026-03-15 08:02:48,049 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 08:02:48,069 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b3c49e974c91e64561019f HTTP/1.1" 200 None 2026-03-15 08:02:48,071 - lava_callback - ERROR - Error processing callback for node 69b3c49e974c91e64561019f: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:56566 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56568 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34874 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60082 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:60086 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48804 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49712 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37520 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56472 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56482 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53676 - "GET / HTTP/1.0" 200 OK 2026-03-15 08:04:07,955 - lava_callback - INFO - Received callback for node 69b3c4f0974c91e6456101ad INFO: 172.21.0.1:53686 - "POST /node/69b3c4f0974c91e6456101ad HTTP/1.0" 202 Accepted 2026-03-15 08:04:07,960 - lava_callback - INFO - Starting async job submit for node 69b3c4f0974c91e6456101ad 2026-03-15 08:04:07,961 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 08:04:07,984 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b3c4f0974c91e6456101ad HTTP/1.1" 200 None 2026-03-15 08:04:07,985 - lava_callback - DEBUG - Processing node 69b3c4f0974c91e6456101ad: baseline-arm64-clabbe 2026-03-15 08:04:07,985 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b3c4f0974c91e6456101ad 2026-03-15 08:04:07,986 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 08:04:08,006 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b3c4f0974c91e6456101ad HTTP/1.1" 200 None 2026-03-15 08:04:08,007 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 08:04:08,066 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ae11758ef4424e487b2eb1 HTTP/1.1" 200 None 2026-03-15 08:04:08,068 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 08:04:08,092 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b3c4f0974c91e6456101ad HTTP/1.1" 200 None 2026-03-15 08:04:08,093 - lava_callback - ERROR - Error processing callback for node 69b3c4f0974c91e6456101ad: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:41662 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:41674 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42466 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48592 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37768 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50758 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50770 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34876 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35718 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:35732 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45294 - "GET / HTTP/1.0" 200 OK 2026-03-15 08:05:27,430 - lava_callback - INFO - Received callback for node 69b3c539974c91e6456101b4 INFO: 172.21.0.1:45300 - "POST /node/69b3c539974c91e6456101b4 HTTP/1.0" 202 Accepted 2026-03-15 08:05:27,435 - lava_callback - INFO - Starting async job submit for node 69b3c539974c91e6456101b4 2026-03-15 08:05:27,436 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 08:05:27,451 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b3c539974c91e6456101b4 HTTP/1.1" 200 None 2026-03-15 08:05:27,452 - lava_callback - DEBUG - Processing node 69b3c539974c91e6456101b4: baseline-arm64-baylibre 2026-03-15 08:05:27,452 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b3c539974c91e6456101b4 2026-03-15 08:05:27,453 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 08:05:27,483 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b3c539974c91e6456101b4 HTTP/1.1" 200 None 2026-03-15 08:05:27,485 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 08:05:27,499 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ae11758ef4424e487b2eb1 HTTP/1.1" 200 None 2026-03-15 08:05:27,500 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 08:05:27,522 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b3c539974c91e6456101b4 HTTP/1.1" 200 None 2026-03-15 08:05:27,528 - lava_callback - ERROR - Error processing callback for node 69b3c539974c91e6456101b4: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:49044 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53296 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51442 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51452 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50574 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48140 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:48142 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37738 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58496 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56840 - "GET / HTTP/1.0" 200 OK 2026-03-15 08:06:48,026 - lava_callback - INFO - Received callback for node 69b3c593974c91e6456101c4 INFO: 172.21.0.1:56856 - "POST /node/69b3c593974c91e6456101c4 HTTP/1.0" 202 Accepted 2026-03-15 08:06:48,032 - lava_callback - INFO - Starting async job submit for node 69b3c593974c91e6456101c4 2026-03-15 08:06:48,032 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 08:06:48,068 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b3c593974c91e6456101c4 HTTP/1.1" 200 None 2026-03-15 08:06:48,069 - lava_callback - DEBUG - Processing node 69b3c593974c91e6456101c4: baseline-arm64-clabbe 2026-03-15 08:06:48,069 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b3c593974c91e6456101c4 2026-03-15 08:06:48,070 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 08:06:48,110 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b3c593974c91e6456101c4 HTTP/1.1" 200 None 2026-03-15 08:06:48,111 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 08:06:48,146 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ae11758ef4424e487b2eb1 HTTP/1.1" 200 None 2026-03-15 08:06:48,147 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 08:06:48,176 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b3c593974c91e6456101c4 HTTP/1.1" 200 None 2026-03-15 08:06:48,177 - lava_callback - ERROR - Error processing callback for node 69b3c593974c91e6456101c4: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:47882 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47896 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46782 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35710 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:35722 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37084 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54984 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34740 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55414 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55422 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47126 - "GET / HTTP/1.0" 200 OK 2026-03-15 08:08:07,728 - lava_callback - INFO - Received callback for node 69b3c5dd974c91e6456101cf INFO: 172.21.0.1:47136 - "POST /node/69b3c5dd974c91e6456101cf HTTP/1.0" 202 Accepted 2026-03-15 08:08:07,734 - lava_callback - INFO - Starting async job submit for node 69b3c5dd974c91e6456101cf 2026-03-15 08:08:07,735 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 08:08:07,754 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b3c5dd974c91e6456101cf HTTP/1.1" 200 None 2026-03-15 08:08:07,755 - lava_callback - DEBUG - Processing node 69b3c5dd974c91e6456101cf: baseline-arm64-baylibre 2026-03-15 08:08:07,755 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b3c5dd974c91e6456101cf 2026-03-15 08:08:07,756 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 08:08:07,780 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b3c5dd974c91e6456101cf HTTP/1.1" 200 None 2026-03-15 08:08:07,782 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 08:08:07,817 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ae11758ef4424e487b2eb1 HTTP/1.1" 200 None 2026-03-15 08:08:07,818 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 08:08:07,840 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b3c5dd974c91e6456101cf HTTP/1.1" 200 None 2026-03-15 08:08:07,846 - lava_callback - ERROR - Error processing callback for node 69b3c5dd974c91e6456101cf: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:46216 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:46224 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53326 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36422 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35546 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34940 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34952 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50488 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36836 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:36844 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40742 - "GET / HTTP/1.0" 200 OK 2026-03-15 08:09:27,839 - lava_callback - INFO - Received callback for node 69b3c631974c91e6456101d6 INFO: 172.21.0.1:40748 - "POST /node/69b3c631974c91e6456101d6 HTTP/1.0" 202 Accepted 2026-03-15 08:09:27,844 - lava_callback - INFO - Starting async job submit for node 69b3c631974c91e6456101d6 2026-03-15 08:09:27,845 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 08:09:27,860 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b3c631974c91e6456101d6 HTTP/1.1" 200 None 2026-03-15 08:09:27,861 - lava_callback - DEBUG - Processing node 69b3c631974c91e6456101d6: baseline-arm64-baylibre 2026-03-15 08:09:27,861 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b3c631974c91e6456101d6 2026-03-15 08:09:27,862 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 08:09:27,882 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b3c631974c91e6456101d6 HTTP/1.1" 200 None 2026-03-15 08:09:27,884 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 08:09:27,897 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ae11758ef4424e487b2eb1 HTTP/1.1" 200 None 2026-03-15 08:09:27,898 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 08:09:27,946 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b3c631974c91e6456101d6 HTTP/1.1" 200 None 2026-03-15 08:09:27,947 - lava_callback - ERROR - Error processing callback for node 69b3c631974c91e6456101d6: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:46492 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55912 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37200 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37206 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47992 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59924 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:59930 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42930 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55716 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41464 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51448 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51452 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44072 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42958 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:42962 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60664 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45002 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46774 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54322 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54328 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52542 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36134 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:36150 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41428 - "GET / HTTP/1.0" 200 OK 2026-03-15 08:12:28,301 - lava_callback - INFO - Received callback for node 69b3c6db974c91e6456101eb INFO: 172.21.0.1:41444 - "POST /node/69b3c6db974c91e6456101eb HTTP/1.0" 202 Accepted 2026-03-15 08:12:28,307 - lava_callback - INFO - Starting async job submit for node 69b3c6db974c91e6456101eb 2026-03-15 08:12:28,308 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 08:12:28,343 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b3c6db974c91e6456101eb HTTP/1.1" 200 None 2026-03-15 08:12:28,344 - lava_callback - DEBUG - Processing node 69b3c6db974c91e6456101eb: baseline-arm64-clabbe 2026-03-15 08:12:28,344 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b3c6db974c91e6456101eb 2026-03-15 08:12:28,345 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 08:12:28,358 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b3c6db974c91e6456101eb HTTP/1.1" 200 None 2026-03-15 08:12:28,360 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 08:12:28,372 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ae11758ef4424e487b2eb1 HTTP/1.1" 200 None 2026-03-15 08:12:28,374 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 08:12:28,396 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b3c6db974c91e6456101eb HTTP/1.1" 200 None 2026-03-15 08:12:28,406 - lava_callback - ERROR - Error processing callback for node 69b3c6db974c91e6456101eb: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:56848 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58078 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56256 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56266 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38792 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43044 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:43056 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48316 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51548 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36448 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37874 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37886 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51438 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57576 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:57586 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37564 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51946 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41292 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33288 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33300 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40026 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52080 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:52086 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56382 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52932 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42904 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52464 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52474 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33514 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39246 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:39262 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50144 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50506 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52368 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35888 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35898 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56156 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37874 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:37888 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53818 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49542 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47274 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39738 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39750 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43138 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:32966 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:32976 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58852 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47776 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52204 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33488 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33492 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52500 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60868 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:60880 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51868 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41358 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55550 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47762 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47778 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59346 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34924 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:34926 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40888 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55858 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34890 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38490 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38504 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47818 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48870 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:48872 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44384 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42022 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56376 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47582 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47598 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44160 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57062 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:57064 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51342 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57884 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41684 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34398 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34404 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36646 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50426 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:50442 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58386 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56808 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41878 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43578 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43584 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53774 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52124 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:52138 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59220 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58424 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33768 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43846 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43856 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50784 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53234 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:53250 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57306 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60590 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33566 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44262 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44264 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50000 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60144 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:60158 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57374 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35642 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34342 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46098 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46108 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47364 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55248 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:55250 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47820 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45258 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54362 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34724 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34732 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53540 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50168 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:50182 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34026 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46404 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38662 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44610 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44622 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49846 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37318 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:37322 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43434 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52380 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43580 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33476 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33484 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42570 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36266 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:36280 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36758 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39632 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48966 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59530 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59542 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53070 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40538 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:40544 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36726 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33574 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52082 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36336 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36346 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50308 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55688 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:55704 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54478 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36272 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52906 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59902 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59914 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49498 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57546 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:57548 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36072 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51308 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42040 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35694 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35706 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33504 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40330 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:40342 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51744 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35180 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53784 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59474 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59484 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54756 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45722 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:45732 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58624 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46004 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54994 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50040 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50046 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39956 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51588 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:51596 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34124 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50484 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39060 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55740 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55752 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60418 - "GET / HTTP/1.0" 200 OK 2026-03-15 08:37:09,072 - lava_callback - INFO - Received callback for node 69b3ccb01727ff69d6f221c4 INFO: 172.21.0.1:60428 - "POST /node/69b3ccb01727ff69d6f221c4 HTTP/1.0" 202 Accepted 2026-03-15 08:37:09,077 - lava_callback - INFO - Starting async job submit for node 69b3ccb01727ff69d6f221c4 2026-03-15 08:37:09,078 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 08:37:09,093 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b3ccb01727ff69d6f221c4 HTTP/1.1" 200 None 2026-03-15 08:37:09,094 - lava_callback - DEBUG - Processing node 69b3ccb01727ff69d6f221c4: baseline-arm-baylibre 2026-03-15 08:37:09,094 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b3ccb01727ff69d6f221c4 2026-03-15 08:37:09,095 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 08:37:09,109 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b3ccb01727ff69d6f221c4 HTTP/1.1" 200 None 2026-03-15 08:37:09,110 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 08:37:09,124 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b3c7f91727ff69d6f21d89 HTTP/1.1" 200 None 2026-03-15 08:37:09,125 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 08:37:09,162 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b3ccb01727ff69d6f221c4 HTTP/1.1" 200 None 2026-03-15 08:37:09,167 - lava_callback - ERROR - Error processing callback for node 69b3ccb01727ff69d6f221c4: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' 2026-03-15 08:37:09,732 - lava_callback - INFO - Received callback for node 69b3ccb11727ff69d6f221c7 INFO: 172.21.0.1:47992 - "POST /node/69b3ccb11727ff69d6f221c7 HTTP/1.0" 202 Accepted 2026-03-15 08:37:09,738 - lava_callback - INFO - Starting async job submit for node 69b3ccb11727ff69d6f221c7 2026-03-15 08:37:09,739 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 08:37:09,760 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b3ccb11727ff69d6f221c7 HTTP/1.1" 200 None 2026-03-15 08:37:09,761 - lava_callback - DEBUG - Processing node 69b3ccb11727ff69d6f221c7: baseline-arm-baylibre 2026-03-15 08:37:09,761 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b3ccb11727ff69d6f221c7 2026-03-15 08:37:09,762 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 08:37:09,775 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b3ccb11727ff69d6f221c7 HTTP/1.1" 200 None 2026-03-15 08:37:09,777 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 08:37:09,790 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b3c7f91727ff69d6f21d89 HTTP/1.1" 200 None 2026-03-15 08:37:09,791 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 08:37:09,820 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b3ccb11727ff69d6f221c7 HTTP/1.1" 200 None 2026-03-15 08:37:09,822 - lava_callback - ERROR - Error processing callback for node 69b3ccb11727ff69d6f221c7: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' 2026-03-15 08:37:10,368 - lava_callback - INFO - Received callback for node 69b3ccb21727ff69d6f221ca INFO: 172.21.0.1:48000 - "POST /node/69b3ccb21727ff69d6f221ca HTTP/1.0" 202 Accepted 2026-03-15 08:37:10,374 - lava_callback - INFO - Starting async job submit for node 69b3ccb21727ff69d6f221ca 2026-03-15 08:37:10,375 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 08:37:10,389 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b3ccb21727ff69d6f221ca HTTP/1.1" 200 None 2026-03-15 08:37:10,390 - lava_callback - DEBUG - Processing node 69b3ccb21727ff69d6f221ca: baseline-arm-baylibre 2026-03-15 08:37:10,390 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b3ccb21727ff69d6f221ca 2026-03-15 08:37:10,391 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 08:37:10,413 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b3ccb21727ff69d6f221ca HTTP/1.1" 200 None 2026-03-15 08:37:10,415 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 08:37:10,429 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b3c7f91727ff69d6f21d89 HTTP/1.1" 200 None 2026-03-15 08:37:10,431 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 08:37:10,451 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b3ccb21727ff69d6f221ca HTTP/1.1" 200 None 2026-03-15 08:37:10,461 - lava_callback - ERROR - Error processing callback for node 69b3ccb21727ff69d6f221ca: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:48008 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:48018 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52802 - "GET / HTTP/1.0" 200 OK 2026-03-15 08:37:29,020 - lava_callback - INFO - Received callback for node 69b3ccb51727ff69d6f221d5 INFO: 172.21.0.1:52812 - "POST /node/69b3ccb51727ff69d6f221d5 HTTP/1.0" 202 Accepted 2026-03-15 08:37:29,025 - lava_callback - INFO - Starting async job submit for node 69b3ccb51727ff69d6f221d5 2026-03-15 08:37:29,026 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 08:37:29,040 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b3ccb51727ff69d6f221d5 HTTP/1.1" 200 None 2026-03-15 08:37:29,041 - lava_callback - DEBUG - Processing node 69b3ccb51727ff69d6f221d5: baseline-arm-baylibre 2026-03-15 08:37:29,041 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b3ccb51727ff69d6f221d5 2026-03-15 08:37:29,042 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 08:37:29,063 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b3ccb51727ff69d6f221d5 HTTP/1.1" 200 None 2026-03-15 08:37:29,066 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 08:37:29,083 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b3c7f91727ff69d6f21d89 HTTP/1.1" 200 None 2026-03-15 08:37:29,085 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 08:37:29,107 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b3ccb51727ff69d6f221d5 HTTP/1.1" 200 None 2026-03-15 08:37:29,108 - lava_callback - ERROR - Error processing callback for node 69b3ccb51727ff69d6f221d5: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' 2026-03-15 08:37:29,494 - lava_callback - INFO - Received callback for node 69b3ccbe1727ff69d6f221ef INFO: 172.21.0.1:52828 - "POST /node/69b3ccbe1727ff69d6f221ef HTTP/1.0" 202 Accepted 2026-03-15 08:37:29,500 - lava_callback - INFO - Starting async job submit for node 69b3ccbe1727ff69d6f221ef 2026-03-15 08:37:29,501 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 08:37:29,539 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b3ccbe1727ff69d6f221ef HTTP/1.1" 200 None 2026-03-15 08:37:29,540 - lava_callback - DEBUG - Processing node 69b3ccbe1727ff69d6f221ef: baseline-arm-clabbe 2026-03-15 08:37:29,540 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b3ccbe1727ff69d6f221ef 2026-03-15 08:37:29,541 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 08:37:29,554 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b3ccbe1727ff69d6f221ef HTTP/1.1" 200 None 2026-03-15 08:37:29,556 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 08:37:29,574 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b3c7f91727ff69d6f21d89 HTTP/1.1" 200 None 2026-03-15 08:37:29,576 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 08:37:29,601 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b3ccbe1727ff69d6f221ef HTTP/1.1" 200 None 2026-03-15 08:37:29,602 - lava_callback - ERROR - Error processing callback for node 69b3ccbe1727ff69d6f221ef: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' 2026-03-15 08:37:29,687 - lava_callback - INFO - Received callback for node 69b3ccb61727ff69d6f221d8 INFO: 172.21.0.1:52836 - "POST /node/69b3ccb61727ff69d6f221d8 HTTP/1.0" 202 Accepted 2026-03-15 08:37:29,697 - lava_callback - INFO - Starting async job submit for node 69b3ccb61727ff69d6f221d8 2026-03-15 08:37:29,698 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 08:37:29,725 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b3ccb61727ff69d6f221d8 HTTP/1.1" 200 None 2026-03-15 08:37:29,726 - lava_callback - DEBUG - Processing node 69b3ccb61727ff69d6f221d8: baseline-arm-baylibre 2026-03-15 08:37:29,726 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b3ccb61727ff69d6f221d8 2026-03-15 08:37:29,727 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 08:37:29,748 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b3ccb61727ff69d6f221d8 HTTP/1.1" 200 None 2026-03-15 08:37:29,750 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 08:37:29,764 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b3c7f91727ff69d6f21d89 HTTP/1.1" 200 None 2026-03-15 08:37:29,766 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 08:37:29,793 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b3ccb61727ff69d6f221d8 HTTP/1.1" 200 None 2026-03-15 08:37:29,794 - lava_callback - ERROR - Error processing callback for node 69b3ccb61727ff69d6f221d8: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' 2026-03-15 08:37:30,151 - lava_callback - INFO - Received callback for node 69b3ccc31727ff69d6f221fd INFO: 172.21.0.1:40984 - "POST /node/69b3ccc31727ff69d6f221fd HTTP/1.0" 202 Accepted 2026-03-15 08:37:30,157 - lava_callback - INFO - Starting async job submit for node 69b3ccc31727ff69d6f221fd 2026-03-15 08:37:30,158 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 08:37:30,172 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b3ccc31727ff69d6f221fd HTTP/1.1" 200 None 2026-03-15 08:37:30,173 - lava_callback - DEBUG - Processing node 69b3ccc31727ff69d6f221fd: baseline-arm-clabbe 2026-03-15 08:37:30,174 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b3ccc31727ff69d6f221fd 2026-03-15 08:37:30,174 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 08:37:30,196 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b3ccc31727ff69d6f221fd HTTP/1.1" 200 None 2026-03-15 08:37:30,197 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 08:37:30,211 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b3c7f91727ff69d6f21d89 HTTP/1.1" 200 None 2026-03-15 08:37:30,212 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 08:37:30,236 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b3ccc31727ff69d6f221fd HTTP/1.1" 200 None 2026-03-15 08:37:30,241 - lava_callback - ERROR - Error processing callback for node 69b3ccc31727ff69d6f221fd: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' 2026-03-15 08:37:30,808 - lava_callback - INFO - Received callback for node 69b3ccc31727ff69d6f22200 INFO: 172.21.0.1:40992 - "POST /node/69b3ccc31727ff69d6f22200 HTTP/1.0" 202 Accepted 2026-03-15 08:37:30,814 - lava_callback - INFO - Starting async job submit for node 69b3ccc31727ff69d6f22200 2026-03-15 08:37:30,814 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 08:37:30,829 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b3ccc31727ff69d6f22200 HTTP/1.1" 200 None 2026-03-15 08:37:30,830 - lava_callback - DEBUG - Processing node 69b3ccc31727ff69d6f22200: baseline-arm-clabbe 2026-03-15 08:37:30,830 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b3ccc31727ff69d6f22200 2026-03-15 08:37:30,831 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 08:37:30,844 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b3ccc31727ff69d6f22200 HTTP/1.1" 200 None 2026-03-15 08:37:30,845 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 08:37:30,859 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b3c7f91727ff69d6f21d89 HTTP/1.1" 200 None 2026-03-15 08:37:30,860 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 08:37:30,881 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b3ccc31727ff69d6f22200 HTTP/1.1" 200 None 2026-03-15 08:37:30,887 - lava_callback - ERROR - Error processing callback for node 69b3ccc31727ff69d6f22200: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' 2026-03-15 08:37:31,470 - lava_callback - INFO - Received callback for node 69b3ccc41727ff69d6f22224 INFO: 172.21.0.1:41006 - "POST /node/69b3ccc41727ff69d6f22224 HTTP/1.0" 202 Accepted 2026-03-15 08:37:31,475 - lava_callback - INFO - Starting async job submit for node 69b3ccc41727ff69d6f22224 2026-03-15 08:37:31,476 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 08:37:31,498 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b3ccc41727ff69d6f22224 HTTP/1.1" 200 None 2026-03-15 08:37:31,499 - lava_callback - DEBUG - Processing node 69b3ccc41727ff69d6f22224: baseline-arm-clabbe 2026-03-15 08:37:31,499 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b3ccc41727ff69d6f22224 2026-03-15 08:37:31,499 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 08:37:31,516 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b3ccc41727ff69d6f22224 HTTP/1.1" 200 None 2026-03-15 08:37:31,517 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 08:37:31,530 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b3c7f91727ff69d6f21d89 HTTP/1.1" 200 None 2026-03-15 08:37:31,532 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 08:37:31,560 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b3ccc41727ff69d6f22224 HTTP/1.1" 200 None 2026-03-15 08:37:31,563 - lava_callback - ERROR - Error processing callback for node 69b3ccc41727ff69d6f22224: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' 2026-03-15 08:37:32,136 - lava_callback - INFO - Received callback for node 69b3ccc71727ff69d6f22231 INFO: 172.21.0.1:41014 - "POST /node/69b3ccc71727ff69d6f22231 HTTP/1.0" 202 Accepted 2026-03-15 08:37:32,143 - lava_callback - INFO - Starting async job submit for node 69b3ccc71727ff69d6f22231 2026-03-15 08:37:32,144 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 08:37:32,162 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b3ccc71727ff69d6f22231 HTTP/1.1" 200 None 2026-03-15 08:37:32,163 - lava_callback - DEBUG - Processing node 69b3ccc71727ff69d6f22231: baseline-arm-clabbe 2026-03-15 08:37:32,163 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b3ccc71727ff69d6f22231 2026-03-15 08:37:32,164 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 08:37:32,178 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b3ccc71727ff69d6f22231 HTTP/1.1" 200 None 2026-03-15 08:37:32,180 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 08:37:32,195 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b3c7f91727ff69d6f21d89 HTTP/1.1" 200 None 2026-03-15 08:37:32,197 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 08:37:32,218 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b3ccc71727ff69d6f22231 HTTP/1.1" 200 None 2026-03-15 08:37:32,227 - lava_callback - ERROR - Error processing callback for node 69b3ccc71727ff69d6f22231: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:41026 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46506 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48178 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48188 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35400 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54744 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:54756 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42064 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54294 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55090 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42804 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42816 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47334 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39462 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:39476 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33404 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43502 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47108 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43108 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43120 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51748 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55464 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:55476 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51996 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42244 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33188 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43496 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43504 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46818 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54334 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:54350 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42120 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52456 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59938 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45226 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45238 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33748 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47184 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:47200 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44558 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53382 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43972 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53436 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53450 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50648 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52428 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:52438 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44700 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52258 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48758 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59442 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59458 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35274 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35712 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:35714 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36804 - "GET / HTTP/1.0" 200 OK 2026-03-15 08:44:29,810 - lava_callback - INFO - Received callback for node 69b3ce621727ff69d6f223c9 INFO: 172.21.0.1:37960 - "POST /node/69b3ce621727ff69d6f223c9 HTTP/1.0" 202 Accepted 2026-03-15 08:44:29,815 - lava_callback - INFO - Starting async job submit for node 69b3ce621727ff69d6f223c9 2026-03-15 08:44:29,816 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 08:44:29,830 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b3ce621727ff69d6f223c9 HTTP/1.1" 200 None 2026-03-15 08:44:29,831 - lava_callback - DEBUG - Processing node 69b3ce621727ff69d6f223c9: baseline-arm-clabbe 2026-03-15 08:44:29,831 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b3ce621727ff69d6f223c9 2026-03-15 08:44:29,832 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 08:44:29,845 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b3ce621727ff69d6f223c9 HTTP/1.1" 200 None 2026-03-15 08:44:29,846 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 08:44:29,863 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b12591a870a1dc3343ba82 HTTP/1.1" 200 None 2026-03-15 08:44:29,864 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 08:44:29,906 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b3ce621727ff69d6f223c9 HTTP/1.1" 200 None 2026-03-15 08:44:29,908 - lava_callback - ERROR - Error processing callback for node 69b3ce621727ff69d6f223c9: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:37962 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48966 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50894 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50910 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53940 - "GET / HTTP/1.0" 200 OK 2026-03-15 08:45:09,776 - lava_callback - INFO - Received callback for node 69b3ce881727ff69d6f223de INFO: 172.21.0.1:45774 - "POST /node/69b3ce881727ff69d6f223de HTTP/1.0" 202 Accepted 2026-03-15 08:45:09,782 - lava_callback - INFO - Starting async job submit for node 69b3ce881727ff69d6f223de 2026-03-15 08:45:09,783 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 08:45:09,796 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b3ce881727ff69d6f223de HTTP/1.1" 200 None 2026-03-15 08:45:09,797 - lava_callback - DEBUG - Processing node 69b3ce881727ff69d6f223de: baseline-arm-clabbe 2026-03-15 08:45:09,797 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b3ce881727ff69d6f223de 2026-03-15 08:45:09,798 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 08:45:09,811 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b3ce881727ff69d6f223de HTTP/1.1" 200 None 2026-03-15 08:45:09,813 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 08:45:09,826 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b12591a870a1dc3343ba82 HTTP/1.1" 200 None 2026-03-15 08:45:09,827 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 08:45:09,847 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b3ce881727ff69d6f223de HTTP/1.1" 200 None 2026-03-15 08:45:09,848 - lava_callback - ERROR - Error processing callback for node 69b3ce881727ff69d6f223de: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:45788 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:45800 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57158 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56204 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39366 - "GET / HTTP/1.0" 200 OK 2026-03-15 08:45:49,897 - lava_callback - INFO - Received callback for node 69b3ceae1727ff69d6f223e9 INFO: 172.21.0.1:42458 - "POST /node/69b3ceae1727ff69d6f223e9 HTTP/1.0" 202 Accepted 2026-03-15 08:45:49,903 - lava_callback - INFO - Starting async job submit for node 69b3ceae1727ff69d6f223e9 2026-03-15 08:45:49,904 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 08:45:49,923 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b3ceae1727ff69d6f223e9 HTTP/1.1" 200 None 2026-03-15 08:45:49,924 - lava_callback - DEBUG - Processing node 69b3ceae1727ff69d6f223e9: baseline-arm-clabbe 2026-03-15 08:45:49,924 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b3ceae1727ff69d6f223e9 2026-03-15 08:45:49,925 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 08:45:49,939 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b3ceae1727ff69d6f223e9 HTTP/1.1" 200 None 2026-03-15 08:45:49,941 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 08:45:49,954 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b12591a870a1dc3343ba82 HTTP/1.1" 200 None 2026-03-15 08:45:49,955 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 08:45:49,980 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b3ceae1727ff69d6f223e9 HTTP/1.1" 200 None 2026-03-15 08:45:49,981 - lava_callback - ERROR - Error processing callback for node 69b3ceae1727ff69d6f223e9: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:42468 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42482 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42678 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57422 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:57436 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58176 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57542 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35294 - "GET / HTTP/1.0" 200 OK 2026-03-15 08:46:49,931 - lava_callback - INFO - Received callback for node 69b3cef71727ff69d6f22411 INFO: 172.21.0.1:46960 - "POST /node/69b3cef71727ff69d6f22411 HTTP/1.0" 202 Accepted 2026-03-15 08:46:49,937 - lava_callback - INFO - Starting async job submit for node 69b3cef71727ff69d6f22411 2026-03-15 08:46:49,938 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 08:46:49,978 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b3cef71727ff69d6f22411 HTTP/1.1" 200 None 2026-03-15 08:46:49,979 - lava_callback - DEBUG - Processing node 69b3cef71727ff69d6f22411: baseline-arm-clabbe 2026-03-15 08:46:49,979 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b3cef71727ff69d6f22411 2026-03-15 08:46:49,980 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 08:46:49,992 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b3cef71727ff69d6f22411 HTTP/1.1" 200 None 2026-03-15 08:46:49,994 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 08:46:50,016 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b12591a870a1dc3343ba82 HTTP/1.1" 200 None 2026-03-15 08:46:50,018 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 08:46:50,048 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b3cef71727ff69d6f22411 HTTP/1.1" 200 None 2026-03-15 08:46:50,051 - lava_callback - ERROR - Error processing callback for node 69b3cef71727ff69d6f22411: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:46966 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46980 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60024 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53130 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:53138 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55224 - "GET / HTTP/1.0" 200 OK 2026-03-15 08:47:29,918 - lava_callback - INFO - Received callback for node 69b3cf1c1727ff69d6f2241b INFO: 172.21.0.1:44568 - "POST /node/69b3cf1c1727ff69d6f2241b HTTP/1.0" 202 Accepted 2026-03-15 08:47:29,924 - lava_callback - INFO - Starting async job submit for node 69b3cf1c1727ff69d6f2241b 2026-03-15 08:47:29,924 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 08:47:29,948 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b3cf1c1727ff69d6f2241b HTTP/1.1" 200 None 2026-03-15 08:47:29,949 - lava_callback - DEBUG - Processing node 69b3cf1c1727ff69d6f2241b: baseline-arm-clabbe 2026-03-15 08:47:29,949 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b3cf1c1727ff69d6f2241b 2026-03-15 08:47:29,950 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 08:47:29,968 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b3cf1c1727ff69d6f2241b HTTP/1.1" 200 None 2026-03-15 08:47:29,969 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 08:47:29,984 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b12591a870a1dc3343ba82 HTTP/1.1" 200 None 2026-03-15 08:47:29,986 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 08:47:30,007 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b3cf1c1727ff69d6f2241b HTTP/1.1" 200 None 2026-03-15 08:47:30,009 - lava_callback - ERROR - Error processing callback for node 69b3cf1c1727ff69d6f2241b: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:44572 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39456 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34874 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34882 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58498 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54250 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:54254 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47164 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58716 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38736 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56458 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56474 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35322 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52618 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:52624 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52874 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34864 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35350 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51096 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51112 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48108 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50136 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:50148 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45402 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56518 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51484 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48038 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48042 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37760 - "GET / HTTP/1.0" 200 OK 2026-03-15 08:51:09,819 - lava_callback - INFO - Received callback for node 69b3cfec1727ff69d6f22518 INFO: 172.21.0.1:47662 - "POST /node/69b3cfec1727ff69d6f22518 HTTP/1.0" 202 Accepted 2026-03-15 08:51:09,825 - lava_callback - INFO - Starting async job submit for node 69b3cfec1727ff69d6f22518 2026-03-15 08:51:09,826 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 08:51:09,840 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b3cfec1727ff69d6f22518 HTTP/1.1" 200 None 2026-03-15 08:51:09,841 - lava_callback - DEBUG - Processing node 69b3cfec1727ff69d6f22518: baseline-arm64-baylibre 2026-03-15 08:51:09,841 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b3cfec1727ff69d6f22518 2026-03-15 08:51:09,842 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 08:51:09,863 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b3cfec1727ff69d6f22518 HTTP/1.1" 200 None 2026-03-15 08:51:09,865 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 08:51:09,899 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b3c8061727ff69d6f21d98 HTTP/1.1" 200 None 2026-03-15 08:51:09,901 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 08:51:09,922 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b3cfec1727ff69d6f22518 HTTP/1.1" 200 None 2026-03-15 08:51:09,930 - lava_callback - ERROR - Error processing callback for node 69b3cfec1727ff69d6f22518: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' 2026-03-15 08:51:10,467 - lava_callback - INFO - Received callback for node 69b3cfee1727ff69d6f2251b INFO: 172.21.0.1:47664 - "POST /node/69b3cfee1727ff69d6f2251b HTTP/1.0" 202 Accepted 2026-03-15 08:51:10,473 - lava_callback - INFO - Starting async job submit for node 69b3cfee1727ff69d6f2251b 2026-03-15 08:51:10,474 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 08:51:10,488 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b3cfee1727ff69d6f2251b HTTP/1.1" 200 None 2026-03-15 08:51:10,489 - lava_callback - DEBUG - Processing node 69b3cfee1727ff69d6f2251b: baseline-arm64-baylibre 2026-03-15 08:51:10,489 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b3cfee1727ff69d6f2251b 2026-03-15 08:51:10,490 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 08:51:10,511 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b3cfee1727ff69d6f2251b HTTP/1.1" 200 None 2026-03-15 08:51:10,513 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 08:51:10,526 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b3c8061727ff69d6f21d98 HTTP/1.1" 200 None 2026-03-15 08:51:10,528 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 08:51:10,558 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b3cfee1727ff69d6f2251b HTTP/1.1" 200 None 2026-03-15 08:51:10,560 - lava_callback - ERROR - Error processing callback for node 69b3cfee1727ff69d6f2251b: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' 2026-03-15 08:51:11,165 - lava_callback - INFO - Received callback for node 69b3cff01727ff69d6f22534 INFO: 172.21.0.1:47666 - "POST /node/69b3cff01727ff69d6f22534 HTTP/1.0" 202 Accepted 2026-03-15 08:51:11,171 - lava_callback - INFO - Starting async job submit for node 69b3cff01727ff69d6f22534 2026-03-15 08:51:11,172 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 08:51:11,187 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b3cff01727ff69d6f22534 HTTP/1.1" 200 None 2026-03-15 08:51:11,188 - lava_callback - DEBUG - Processing node 69b3cff01727ff69d6f22534: baseline-arm64-baylibre 2026-03-15 08:51:11,188 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b3cff01727ff69d6f22534 2026-03-15 08:51:11,189 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 08:51:11,204 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b3cff01727ff69d6f22534 HTTP/1.1" 200 None 2026-03-15 08:51:11,205 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 08:51:11,219 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b3c8061727ff69d6f21d98 HTTP/1.1" 200 None 2026-03-15 08:51:11,220 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 08:51:11,245 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b3cff01727ff69d6f22534 HTTP/1.1" 200 None 2026-03-15 08:51:11,255 - lava_callback - ERROR - Error processing callback for node 69b3cff01727ff69d6f22534: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' 2026-03-15 08:51:11,827 - lava_callback - INFO - Received callback for node 69b3cff41727ff69d6f2253d INFO: 172.21.0.1:47680 - "POST /node/69b3cff41727ff69d6f2253d HTTP/1.0" 202 Accepted 2026-03-15 08:51:11,832 - lava_callback - INFO - Starting async job submit for node 69b3cff41727ff69d6f2253d 2026-03-15 08:51:11,833 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 08:51:11,876 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b3cff41727ff69d6f2253d HTTP/1.1" 200 None 2026-03-15 08:51:11,878 - lava_callback - DEBUG - Processing node 69b3cff41727ff69d6f2253d: baseline-arm64-baylibre 2026-03-15 08:51:11,878 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b3cff41727ff69d6f2253d 2026-03-15 08:51:11,878 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 08:51:11,892 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b3cff41727ff69d6f2253d HTTP/1.1" 200 None 2026-03-15 08:51:11,894 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 08:51:11,907 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b3c8061727ff69d6f21d98 HTTP/1.1" 200 None 2026-03-15 08:51:11,908 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 08:51:11,930 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b3cff41727ff69d6f2253d HTTP/1.1" 200 None 2026-03-15 08:51:11,931 - lava_callback - ERROR - Error processing callback for node 69b3cff41727ff69d6f2253d: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' 2026-03-15 08:51:12,475 - lava_callback - INFO - Received callback for node 69b3cff61727ff69d6f22540 INFO: 172.21.0.1:47688 - "POST /node/69b3cff61727ff69d6f22540 HTTP/1.0" 202 Accepted 2026-03-15 08:51:12,480 - lava_callback - INFO - Starting async job submit for node 69b3cff61727ff69d6f22540 2026-03-15 08:51:12,481 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 08:51:12,497 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b3cff61727ff69d6f22540 HTTP/1.1" 200 None 2026-03-15 08:51:12,498 - lava_callback - DEBUG - Processing node 69b3cff61727ff69d6f22540: baseline-arm64-baylibre 2026-03-15 08:51:12,498 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b3cff61727ff69d6f22540 2026-03-15 08:51:12,499 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 08:51:12,512 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b3cff61727ff69d6f22540 HTTP/1.1" 200 None 2026-03-15 08:51:12,514 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 08:51:12,527 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b3c8061727ff69d6f21d98 HTTP/1.1" 200 None 2026-03-15 08:51:12,528 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 08:51:12,551 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b3cff61727ff69d6f22540 HTTP/1.1" 200 None 2026-03-15 08:51:12,556 - lava_callback - ERROR - Error processing callback for node 69b3cff61727ff69d6f22540: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' 2026-03-15 08:51:13,160 - lava_callback - INFO - Received callback for node 69b3cff81727ff69d6f22547 INFO: 172.21.0.1:47694 - "POST /node/69b3cff81727ff69d6f22547 HTTP/1.0" 202 Accepted 2026-03-15 08:51:13,166 - lava_callback - INFO - Starting async job submit for node 69b3cff81727ff69d6f22547 2026-03-15 08:51:13,167 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 08:51:13,181 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b3cff81727ff69d6f22547 HTTP/1.1" 200 None 2026-03-15 08:51:13,181 - lava_callback - DEBUG - Processing node 69b3cff81727ff69d6f22547: baseline-arm64-baylibre 2026-03-15 08:51:13,182 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b3cff81727ff69d6f22547 2026-03-15 08:51:13,182 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 08:51:13,195 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b3cff81727ff69d6f22547 HTTP/1.1" 200 None 2026-03-15 08:51:13,197 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 08:51:13,216 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b3c8061727ff69d6f21d98 HTTP/1.1" 200 None 2026-03-15 08:51:13,218 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 08:51:13,242 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b3cff81727ff69d6f22547 HTTP/1.1" 200 None 2026-03-15 08:51:13,247 - lava_callback - ERROR - Error processing callback for node 69b3cff81727ff69d6f22547: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:47710 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:47712 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34436 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50144 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54242 - "GET / HTTP/1.0" 200 OK 2026-03-15 08:51:50,151 - lava_callback - INFO - Received callback for node 69b3d00f1727ff69d6f22585 INFO: 172.21.0.1:41134 - "POST /node/69b3d00f1727ff69d6f22585 HTTP/1.0" 202 Accepted 2026-03-15 08:51:50,156 - lava_callback - INFO - Starting async job submit for node 69b3d00f1727ff69d6f22585 2026-03-15 08:51:50,157 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 08:51:50,171 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b3d00f1727ff69d6f22585 HTTP/1.1" 200 None 2026-03-15 08:51:50,172 - lava_callback - DEBUG - Processing node 69b3d00f1727ff69d6f22585: baseline-arm64-clabbe 2026-03-15 08:51:50,172 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b3d00f1727ff69d6f22585 2026-03-15 08:51:50,173 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 08:51:50,186 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b3d00f1727ff69d6f22585 HTTP/1.1" 200 None 2026-03-15 08:51:50,188 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 08:51:50,201 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b3c8061727ff69d6f21d98 HTTP/1.1" 200 None 2026-03-15 08:51:50,203 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 08:51:50,224 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b3d00f1727ff69d6f22585 HTTP/1.1" 200 None 2026-03-15 08:51:50,225 - lava_callback - ERROR - Error processing callback for node 69b3d00f1727ff69d6f22585: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' 2026-03-15 08:51:50,808 - lava_callback - INFO - Received callback for node 69b3d0121727ff69d6f22588 INFO: 172.21.0.1:41142 - "POST /node/69b3d0121727ff69d6f22588 HTTP/1.0" 202 Accepted 2026-03-15 08:51:50,814 - lava_callback - INFO - Starting async job submit for node 69b3d0121727ff69d6f22588 2026-03-15 08:51:50,815 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 08:51:50,829 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b3d0121727ff69d6f22588 HTTP/1.1" 200 None 2026-03-15 08:51:50,830 - lava_callback - DEBUG - Processing node 69b3d0121727ff69d6f22588: baseline-arm64-clabbe 2026-03-15 08:51:50,830 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b3d0121727ff69d6f22588 2026-03-15 08:51:50,831 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 08:51:50,844 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b3d0121727ff69d6f22588 HTTP/1.1" 200 None 2026-03-15 08:51:50,846 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 08:51:50,860 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b3c8061727ff69d6f21d98 HTTP/1.1" 200 None 2026-03-15 08:51:50,862 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 08:51:50,882 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b3d0121727ff69d6f22588 HTTP/1.1" 200 None 2026-03-15 08:51:50,888 - lava_callback - ERROR - Error processing callback for node 69b3d0121727ff69d6f22588: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' 2026-03-15 08:51:51,465 - lava_callback - INFO - Received callback for node 69b3d0131727ff69d6f22590 INFO: 172.21.0.1:41158 - "POST /node/69b3d0131727ff69d6f22590 HTTP/1.0" 202 Accepted 2026-03-15 08:51:51,471 - lava_callback - INFO - Starting async job submit for node 69b3d0131727ff69d6f22590 2026-03-15 08:51:51,472 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 08:51:51,493 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b3d0131727ff69d6f22590 HTTP/1.1" 200 None 2026-03-15 08:51:51,494 - lava_callback - DEBUG - Processing node 69b3d0131727ff69d6f22590: baseline-arm64-clabbe 2026-03-15 08:51:51,494 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b3d0131727ff69d6f22590 2026-03-15 08:51:51,494 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 08:51:51,508 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b3d0131727ff69d6f22590 HTTP/1.1" 200 None 2026-03-15 08:51:51,510 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 08:51:51,522 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b3c8061727ff69d6f21d98 HTTP/1.1" 200 None 2026-03-15 08:51:51,524 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 08:51:51,548 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b3d0131727ff69d6f22590 HTTP/1.1" 200 None 2026-03-15 08:51:51,550 - lava_callback - ERROR - Error processing callback for node 69b3d0131727ff69d6f22590: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' 2026-03-15 08:51:52,140 - lava_callback - INFO - Received callback for node 69b3d0141727ff69d6f22593 INFO: 172.21.0.1:41162 - "POST /node/69b3d0141727ff69d6f22593 HTTP/1.0" 202 Accepted 2026-03-15 08:51:52,146 - lava_callback - INFO - Starting async job submit for node 69b3d0141727ff69d6f22593 2026-03-15 08:51:52,147 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 08:51:52,169 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b3d0141727ff69d6f22593 HTTP/1.1" 200 None 2026-03-15 08:51:52,170 - lava_callback - DEBUG - Processing node 69b3d0141727ff69d6f22593: baseline-arm64-clabbe 2026-03-15 08:51:52,170 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b3d0141727ff69d6f22593 2026-03-15 08:51:52,171 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 08:51:52,184 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b3d0141727ff69d6f22593 HTTP/1.1" 200 None 2026-03-15 08:51:52,186 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 08:51:52,199 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b3c8061727ff69d6f21d98 HTTP/1.1" 200 None 2026-03-15 08:51:52,201 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 08:51:52,226 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b3d0141727ff69d6f22593 HTTP/1.1" 200 None 2026-03-15 08:51:52,228 - lava_callback - ERROR - Error processing callback for node 69b3d0141727ff69d6f22593: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' 2026-03-15 08:51:52,800 - lava_callback - INFO - Received callback for node 69b3d0191727ff69d6f2259c INFO: 172.21.0.1:41178 - "POST /node/69b3d0191727ff69d6f2259c HTTP/1.0" 202 Accepted 2026-03-15 08:51:52,806 - lava_callback - INFO - Starting async job submit for node 69b3d0191727ff69d6f2259c 2026-03-15 08:51:52,807 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 08:51:52,831 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b3d0191727ff69d6f2259c HTTP/1.1" 200 None 2026-03-15 08:51:52,831 - lava_callback - DEBUG - Processing node 69b3d0191727ff69d6f2259c: baseline-arm64-clabbe 2026-03-15 08:51:52,832 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b3d0191727ff69d6f2259c 2026-03-15 08:51:52,832 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 08:51:52,846 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b3d0191727ff69d6f2259c HTTP/1.1" 200 None 2026-03-15 08:51:52,847 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 08:51:52,860 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b3c8061727ff69d6f21d98 HTTP/1.1" 200 None 2026-03-15 08:51:52,862 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 08:51:52,883 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b3d0191727ff69d6f2259c HTTP/1.1" 200 None 2026-03-15 08:51:52,892 - lava_callback - ERROR - Error processing callback for node 69b3d0191727ff69d6f2259c: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' 2026-03-15 08:51:53,457 - lava_callback - INFO - Received callback for node 69b3d0171727ff69d6f22599 INFO: 172.21.0.1:41182 - "POST /node/69b3d0171727ff69d6f22599 HTTP/1.0" 202 Accepted 2026-03-15 08:51:53,463 - lava_callback - INFO - Starting async job submit for node 69b3d0171727ff69d6f22599 2026-03-15 08:51:53,464 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 08:51:53,481 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b3d0171727ff69d6f22599 HTTP/1.1" 200 None 2026-03-15 08:51:53,482 - lava_callback - DEBUG - Processing node 69b3d0171727ff69d6f22599: baseline-arm64-clabbe 2026-03-15 08:51:53,483 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b3d0171727ff69d6f22599 2026-03-15 08:51:53,483 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 08:51:53,498 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b3d0171727ff69d6f22599 HTTP/1.1" 200 None 2026-03-15 08:51:53,500 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 08:51:53,513 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b3c8061727ff69d6f21d98 HTTP/1.1" 200 None 2026-03-15 08:51:53,514 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 08:51:53,535 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b3d0171727ff69d6f22599 HTTP/1.1" 200 None 2026-03-15 08:51:53,540 - lava_callback - ERROR - Error processing callback for node 69b3d0171727ff69d6f22599: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:41190 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41206 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33774 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58902 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:58904 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41080 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54482 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38944 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48912 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48924 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49996 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39790 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:39800 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48732 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60392 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55842 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36444 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36446 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56884 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36356 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:36368 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60850 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58636 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43702 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42414 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42426 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41380 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53908 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:53920 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55014 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42570 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53824 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53402 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53408 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60610 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35180 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:35190 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55040 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57252 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38952 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44328 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44334 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49148 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52386 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:52402 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38126 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53622 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57692 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39622 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39630 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36212 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37700 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:37702 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53658 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42052 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52440 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35298 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35310 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41310 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49866 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:49874 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49274 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43810 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52486 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36132 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36148 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44100 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49494 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:49496 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55530 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47036 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40188 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38782 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38798 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37064 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55310 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:55326 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60084 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36878 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43700 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48558 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48560 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56492 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35560 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:35574 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50218 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35532 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54762 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52466 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52480 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54680 - "GET / HTTP/1.0" 200 OK 2026-03-15 09:03:10,443 - lava_callback - INFO - Received callback for node 69b3d2b91727ff69d6f227ae INFO: 172.21.0.1:45642 - "POST /node/69b3d2b91727ff69d6f227ae HTTP/1.0" 202 Accepted 2026-03-15 09:03:10,449 - lava_callback - INFO - Starting async job submit for node 69b3d2b91727ff69d6f227ae 2026-03-15 09:03:10,450 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 09:03:10,481 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b3d2b91727ff69d6f227ae HTTP/1.1" 200 None 2026-03-15 09:03:10,482 - lava_callback - DEBUG - Processing node 69b3d2b91727ff69d6f227ae: baseline-arm-baylibre 2026-03-15 09:03:10,483 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b3d2b91727ff69d6f227ae 2026-03-15 09:03:10,483 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 09:03:10,508 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b3d2b91727ff69d6f227ae HTTP/1.1" 200 None 2026-03-15 09:03:10,510 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 09:03:10,523 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ae8223c660ead8a389aafd HTTP/1.1" 200 None 2026-03-15 09:03:10,524 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 09:03:10,544 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b3d2b91727ff69d6f227ae HTTP/1.1" 200 None 2026-03-15 09:03:10,552 - lava_callback - ERROR - Error processing callback for node 69b3d2b91727ff69d6f227ae: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:45652 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:45656 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38626 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49716 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46168 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46846 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46862 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47706 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45456 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:45466 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55468 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50154 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41178 - "GET / HTTP/1.0" 200 OK 2026-03-15 09:04:50,554 - lava_callback - INFO - Received callback for node 69b3d32d1727ff69d6f227cc INFO: 172.21.0.1:38994 - "POST /node/69b3d32d1727ff69d6f227cc HTTP/1.0" 202 Accepted 2026-03-15 09:04:50,560 - lava_callback - INFO - Starting async job submit for node 69b3d32d1727ff69d6f227cc 2026-03-15 09:04:50,561 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 09:04:50,582 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b3d32d1727ff69d6f227cc HTTP/1.1" 200 None 2026-03-15 09:04:50,583 - lava_callback - DEBUG - Processing node 69b3d32d1727ff69d6f227cc: baseline-arm-baylibre 2026-03-15 09:04:50,583 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b3d32d1727ff69d6f227cc 2026-03-15 09:04:50,584 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 09:04:50,598 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b3d32d1727ff69d6f227cc HTTP/1.1" 200 None 2026-03-15 09:04:50,599 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 09:04:50,612 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ae8223c660ead8a389aafd HTTP/1.1" 200 None 2026-03-15 09:04:50,614 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 09:04:50,652 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b3d32d1727ff69d6f227cc HTTP/1.1" 200 None 2026-03-15 09:04:50,653 - lava_callback - ERROR - Error processing callback for node 69b3d32d1727ff69d6f227cc: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:39006 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39014 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49776 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45710 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:45718 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38798 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49652 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33268 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35246 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35252 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37768 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50706 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:50722 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50402 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36998 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45520 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44156 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44172 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55734 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37402 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:37404 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43228 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50592 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37222 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59996 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60012 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51580 - "GET / HTTP/1.0" 200 OK 2026-03-15 09:08:10,709 - lava_callback - INFO - Received callback for node 69b3d3f21727ff69d6f22802 INFO: 172.21.0.1:60120 - "POST /node/69b3d3f21727ff69d6f22802 HTTP/1.0" 202 Accepted 2026-03-15 09:08:10,715 - lava_callback - INFO - Starting async job submit for node 69b3d3f21727ff69d6f22802 2026-03-15 09:08:10,715 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 09:08:10,756 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b3d3f21727ff69d6f22802 HTTP/1.1" 200 None 2026-03-15 09:08:10,757 - lava_callback - DEBUG - Processing node 69b3d3f21727ff69d6f22802: baseline-arm-baylibre 2026-03-15 09:08:10,757 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b3d3f21727ff69d6f22802 2026-03-15 09:08:10,758 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 09:08:10,793 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b3d3f21727ff69d6f22802 HTTP/1.1" 200 None 2026-03-15 09:08:10,795 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 09:08:10,808 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ae8223c660ead8a389aafd HTTP/1.1" 200 None 2026-03-15 09:08:10,810 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 09:08:10,831 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b3d3f21727ff69d6f22802 HTTP/1.1" 200 None 2026-03-15 09:08:10,833 - lava_callback - ERROR - Error processing callback for node 69b3d3f21727ff69d6f22802: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:60130 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:60136 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55352 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60178 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42028 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53444 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53448 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45060 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48436 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:48438 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53030 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53242 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57304 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56140 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56144 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36600 - "GET / HTTP/1.0" 200 OK 2026-03-15 09:10:10,802 - lava_callback - INFO - Received callback for node 69b3d4651727ff69d6f2281a INFO: 172.21.0.1:41424 - "POST /node/69b3d4651727ff69d6f2281a HTTP/1.0" 202 Accepted 2026-03-15 09:10:10,808 - lava_callback - INFO - Starting async job submit for node 69b3d4651727ff69d6f2281a 2026-03-15 09:10:10,809 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 09:10:10,833 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b3d4651727ff69d6f2281a HTTP/1.1" 200 None 2026-03-15 09:10:10,834 - lava_callback - DEBUG - Processing node 69b3d4651727ff69d6f2281a: baseline-arm-baylibre 2026-03-15 09:10:10,834 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b3d4651727ff69d6f2281a 2026-03-15 09:10:10,835 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 09:10:10,852 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b3d4651727ff69d6f2281a HTTP/1.1" 200 None 2026-03-15 09:10:10,854 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 09:10:10,872 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ae8223c660ead8a389aafd HTTP/1.1" 200 None 2026-03-15 09:10:10,873 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 09:10:10,913 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b3d4651727ff69d6f2281a HTTP/1.1" 200 None 2026-03-15 09:10:10,915 - lava_callback - ERROR - Error processing callback for node 69b3d4651727ff69d6f2281a: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:41436 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:41442 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52368 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55870 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39108 - "GET / HTTP/1.0" 200 OK 2026-03-15 09:10:50,771 - lava_callback - INFO - Received callback for node 69b3d4881727ff69d6f22828 INFO: 172.21.0.1:39420 - "POST /node/69b3d4881727ff69d6f22828 HTTP/1.0" 202 Accepted 2026-03-15 09:10:50,776 - lava_callback - INFO - Starting async job submit for node 69b3d4881727ff69d6f22828 2026-03-15 09:10:50,777 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 09:10:50,792 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b3d4881727ff69d6f22828 HTTP/1.1" 200 None 2026-03-15 09:10:50,793 - lava_callback - DEBUG - Processing node 69b3d4881727ff69d6f22828: baseline-arm-baylibre 2026-03-15 09:10:50,793 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b3d4881727ff69d6f22828 2026-03-15 09:10:50,794 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 09:10:50,808 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b3d4881727ff69d6f22828 HTTP/1.1" 200 None 2026-03-15 09:10:50,809 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 09:10:50,823 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69abdf2740deb775998f3ba4 HTTP/1.1" 200 None 2026-03-15 09:10:50,824 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 09:10:50,846 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b3d4881727ff69d6f22828 HTTP/1.1" 200 None 2026-03-15 09:10:50,848 - lava_callback - ERROR - Error processing callback for node 69b3d4881727ff69d6f22828: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:39428 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39442 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57696 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54670 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:54680 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47130 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53430 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59910 - "GET / HTTP/1.0" 200 OK 2026-03-15 09:11:51,124 - lava_callback - INFO - Received callback for node 69b3d4d51727ff69d6f22845 INFO: 172.21.0.1:44658 - "POST /node/69b3d4d51727ff69d6f22845 HTTP/1.0" 202 Accepted 2026-03-15 09:11:51,129 - lava_callback - INFO - Starting async job submit for node 69b3d4d51727ff69d6f22845 2026-03-15 09:11:51,130 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 09:11:51,153 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b3d4d51727ff69d6f22845 HTTP/1.1" 200 None 2026-03-15 09:11:51,154 - lava_callback - DEBUG - Processing node 69b3d4d51727ff69d6f22845: baseline-arm-baylibre 2026-03-15 09:11:51,154 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b3d4d51727ff69d6f22845 2026-03-15 09:11:51,154 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 09:11:51,168 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b3d4d51727ff69d6f22845 HTTP/1.1" 200 None 2026-03-15 09:11:51,169 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 09:11:51,191 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ae8223c660ead8a389aafd HTTP/1.1" 200 None 2026-03-15 09:11:51,193 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 09:11:51,242 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b3d4d51727ff69d6f22845 HTTP/1.1" 200 None 2026-03-15 09:11:51,249 - lava_callback - ERROR - Error processing callback for node 69b3d4d51727ff69d6f22845: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:44660 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44662 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35654 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38140 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:38150 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49106 - "GET / HTTP/1.0" 200 OK 2026-03-15 09:12:30,868 - lava_callback - INFO - Received callback for node 69b3d4f91727ff69d6f2284e INFO: 172.21.0.1:35934 - "POST /node/69b3d4f91727ff69d6f2284e HTTP/1.0" 202 Accepted 2026-03-15 09:12:30,874 - lava_callback - INFO - Starting async job submit for node 69b3d4f91727ff69d6f2284e 2026-03-15 09:12:30,875 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 09:12:30,889 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b3d4f91727ff69d6f2284e HTTP/1.1" 200 None 2026-03-15 09:12:30,890 - lava_callback - DEBUG - Processing node 69b3d4f91727ff69d6f2284e: baseline-arm-baylibre 2026-03-15 09:12:30,891 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b3d4f91727ff69d6f2284e 2026-03-15 09:12:30,891 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 09:12:30,905 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b3d4f91727ff69d6f2284e HTTP/1.1" 200 None 2026-03-15 09:12:30,906 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 09:12:30,939 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ae8223c660ead8a389aafd HTTP/1.1" 200 None 2026-03-15 09:12:30,941 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 09:12:30,972 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b3d4f91727ff69d6f2284e HTTP/1.1" 200 None 2026-03-15 09:12:30,974 - lava_callback - ERROR - Error processing callback for node 69b3d4f91727ff69d6f2284e: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:35936 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33880 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45248 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45254 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40160 - "GET / HTTP/1.0" 200 OK 2026-03-15 09:13:10,996 - lava_callback - INFO - Received callback for node 69b3d51e1727ff69d6f2285c INFO: 172.21.0.1:54248 - "POST /node/69b3d51e1727ff69d6f2285c HTTP/1.0" 202 Accepted 2026-03-15 09:13:11,003 - lava_callback - INFO - Starting async job submit for node 69b3d51e1727ff69d6f2285c 2026-03-15 09:13:11,004 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 09:13:11,023 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b3d51e1727ff69d6f2285c HTTP/1.1" 200 None 2026-03-15 09:13:11,023 - lava_callback - DEBUG - Processing node 69b3d51e1727ff69d6f2285c: baseline-arm-clabbe 2026-03-15 09:13:11,024 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b3d51e1727ff69d6f2285c 2026-03-15 09:13:11,024 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 09:13:11,042 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b3d51e1727ff69d6f2285c HTTP/1.1" 200 None 2026-03-15 09:13:11,044 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 09:13:11,057 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ae8223c660ead8a389aafd HTTP/1.1" 200 None 2026-03-15 09:13:11,059 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 09:13:11,080 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b3d51e1727ff69d6f2285c HTTP/1.1" 200 None 2026-03-15 09:13:11,082 - lava_callback - ERROR - Error processing callback for node 69b3d51e1727ff69d6f2285c: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:54252 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:54266 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60406 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52642 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37052 - "GET / HTTP/1.0" 200 OK 2026-03-15 09:13:51,006 - lava_callback - INFO - Received callback for node 69b3d5431727ff69d6f2286f INFO: 172.21.0.1:58278 - "POST /node/69b3d5431727ff69d6f2286f HTTP/1.0" 202 Accepted 2026-03-15 09:13:51,012 - lava_callback - INFO - Starting async job submit for node 69b3d5431727ff69d6f2286f 2026-03-15 09:13:51,013 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 09:13:51,027 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b3d5431727ff69d6f2286f HTTP/1.1" 200 None 2026-03-15 09:13:51,028 - lava_callback - DEBUG - Processing node 69b3d5431727ff69d6f2286f: baseline-arm-clabbe 2026-03-15 09:13:51,028 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b3d5431727ff69d6f2286f 2026-03-15 09:13:51,029 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 09:13:51,041 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b3d5431727ff69d6f2286f HTTP/1.1" 200 None 2026-03-15 09:13:51,043 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 09:13:51,058 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ae8223c660ead8a389aafd HTTP/1.1" 200 None 2026-03-15 09:13:51,059 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 09:13:51,086 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b3d5431727ff69d6f2286f HTTP/1.1" 200 None 2026-03-15 09:13:51,087 - lava_callback - ERROR - Error processing callback for node 69b3d5431727ff69d6f2286f: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:58284 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58292 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38490 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38932 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:38948 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49524 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49288 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40532 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33590 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33602 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58752 - "GET / HTTP/1.0" 200 OK 2026-03-15 09:15:11,050 - lava_callback - INFO - Received callback for node 69b3d58c1727ff69d6f22885 INFO: 172.21.0.1:50098 - "POST /node/69b3d58c1727ff69d6f22885 HTTP/1.0" 202 Accepted 2026-03-15 09:15:11,056 - lava_callback - INFO - Starting async job submit for node 69b3d58c1727ff69d6f22885 2026-03-15 09:15:11,057 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 09:15:11,099 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b3d58c1727ff69d6f22885 HTTP/1.1" 200 None 2026-03-15 09:15:11,100 - lava_callback - DEBUG - Processing node 69b3d58c1727ff69d6f22885: baseline-arm-clabbe 2026-03-15 09:15:11,101 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b3d58c1727ff69d6f22885 2026-03-15 09:15:11,101 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 09:15:11,115 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b3d58c1727ff69d6f22885 HTTP/1.1" 200 None 2026-03-15 09:15:11,117 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 09:15:11,158 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ae8223c660ead8a389aafd HTTP/1.1" 200 None 2026-03-15 09:15:11,160 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 09:15:11,200 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b3d58c1727ff69d6f22885 HTTP/1.1" 200 None 2026-03-15 09:15:11,201 - lava_callback - ERROR - Error processing callback for node 69b3d58c1727ff69d6f22885: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:50104 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:50116 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55438 - "GET / HTTP/1.0" 200 OK 2026-03-15 09:15:31,162 - lava_callback - INFO - Received callback for node 69b3d5b01727ff69d6f22892 INFO: 172.21.0.1:38022 - "POST /node/69b3d5b01727ff69d6f22892 HTTP/1.0" 202 Accepted 2026-03-15 09:15:31,168 - lava_callback - INFO - Starting async job submit for node 69b3d5b01727ff69d6f22892 2026-03-15 09:15:31,169 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 09:15:31,183 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b3d5b01727ff69d6f22892 HTTP/1.1" 200 None 2026-03-15 09:15:31,184 - lava_callback - DEBUG - Processing node 69b3d5b01727ff69d6f22892: baseline-arm-clabbe 2026-03-15 09:15:31,184 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b3d5b01727ff69d6f22892 2026-03-15 09:15:31,185 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 09:15:31,198 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b3d5b01727ff69d6f22892 HTTP/1.1" 200 None 2026-03-15 09:15:31,199 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 09:15:31,213 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ae8223c660ead8a389aafd HTTP/1.1" 200 None 2026-03-15 09:15:31,215 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 09:15:31,242 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b3d5b01727ff69d6f22892 HTTP/1.1" 200 None 2026-03-15 09:15:31,243 - lava_callback - ERROR - Error processing callback for node 69b3d5b01727ff69d6f22892: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:38030 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37284 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42296 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42304 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47162 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43440 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:43450 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51418 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33388 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33482 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48076 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48080 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33734 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34790 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:34806 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56070 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37912 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55040 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45440 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45454 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39314 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50524 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:50532 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38122 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44938 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39454 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33514 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33520 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47272 - "GET / HTTP/1.0" 200 OK 2026-03-15 09:19:11,246 - lava_callback - INFO - Received callback for node 69b3d67a1727ff69d6f228b1 INFO: 172.21.0.1:33398 - "POST /node/69b3d67a1727ff69d6f228b1 HTTP/1.0" 202 Accepted 2026-03-15 09:19:11,252 - lava_callback - INFO - Starting async job submit for node 69b3d67a1727ff69d6f228b1 2026-03-15 09:19:11,253 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 09:19:11,267 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b3d67a1727ff69d6f228b1 HTTP/1.1" 200 None 2026-03-15 09:19:11,268 - lava_callback - DEBUG - Processing node 69b3d67a1727ff69d6f228b1: baseline-arm-clabbe 2026-03-15 09:19:11,268 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b3d67a1727ff69d6f228b1 2026-03-15 09:19:11,269 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 09:19:11,282 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b3d67a1727ff69d6f228b1 HTTP/1.1" 200 None 2026-03-15 09:19:11,283 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 09:19:11,297 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ae8223c660ead8a389aafd HTTP/1.1" 200 None 2026-03-15 09:19:11,298 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 09:19:11,337 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b3d67a1727ff69d6f228b1 HTTP/1.1" 200 None 2026-03-15 09:19:11,339 - lava_callback - ERROR - Error processing callback for node 69b3d67a1727ff69d6f228b1: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:33414 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:33420 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39112 - "GET / HTTP/1.0" 200 OK 2026-03-15 09:19:31,287 - lava_callback - INFO - Received callback for node 69b3d69b1727ff69d6f228c3 INFO: 172.21.0.1:47446 - "POST /node/69b3d69b1727ff69d6f228c3 HTTP/1.0" 202 Accepted 2026-03-15 09:19:31,296 - lava_callback - INFO - Starting async job submit for node 69b3d69b1727ff69d6f228c3 2026-03-15 09:19:31,297 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 09:19:31,312 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b3d69b1727ff69d6f228c3 HTTP/1.1" 200 None 2026-03-15 09:19:31,313 - lava_callback - DEBUG - Processing node 69b3d69b1727ff69d6f228c3: baseline-arm-baylibre 2026-03-15 09:19:31,313 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b3d69b1727ff69d6f228c3 2026-03-15 09:19:31,314 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 09:19:31,327 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b3d69b1727ff69d6f228c3 HTTP/1.1" 200 None 2026-03-15 09:19:31,329 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 09:19:31,352 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69abdf2740deb775998f3ba4 HTTP/1.1" 200 None 2026-03-15 09:19:31,353 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 09:19:31,378 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b3d69b1727ff69d6f228c3 HTTP/1.1" 200 None 2026-03-15 09:19:31,380 - lava_callback - ERROR - Error processing callback for node 69b3d69b1727ff69d6f228c3: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:47458 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59842 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33028 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33032 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41158 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47444 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:47460 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35784 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44204 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53378 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44628 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44640 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44758 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38492 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:38506 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59086 - "GET / HTTP/1.0" 200 OK 2026-03-15 09:21:31,408 - lava_callback - INFO - Received callback for node 69b3d7101727ff69d6f228de INFO: 172.21.0.1:44548 - "POST /node/69b3d7101727ff69d6f228de HTTP/1.0" 202 Accepted 2026-03-15 09:21:31,414 - lava_callback - INFO - Starting async job submit for node 69b3d7101727ff69d6f228de 2026-03-15 09:21:31,414 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 09:21:31,451 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b3d7101727ff69d6f228de HTTP/1.1" 200 None 2026-03-15 09:21:31,452 - lava_callback - DEBUG - Processing node 69b3d7101727ff69d6f228de: baseline-arm-baylibre 2026-03-15 09:21:31,452 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b3d7101727ff69d6f228de 2026-03-15 09:21:31,453 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 09:21:31,504 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b3d7101727ff69d6f228de HTTP/1.1" 200 None 2026-03-15 09:21:31,505 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 09:21:31,532 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69abdf2740deb775998f3ba4 HTTP/1.1" 200 None 2026-03-15 09:21:31,534 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 09:21:31,594 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b3d7101727ff69d6f228de HTTP/1.1" 200 None 2026-03-15 09:21:31,595 - lava_callback - ERROR - Error processing callback for node 69b3d7101727ff69d6f228de: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:44556 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42230 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41664 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41676 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33064 - "GET / HTTP/1.0" 200 OK 2026-03-15 09:22:11,414 - lava_callback - INFO - Received callback for node 69b3d7351727ff69d6f228ee INFO: 172.21.0.1:37688 - "POST /node/69b3d7351727ff69d6f228ee HTTP/1.0" 202 Accepted 2026-03-15 09:22:11,420 - lava_callback - INFO - Starting async job submit for node 69b3d7351727ff69d6f228ee 2026-03-15 09:22:11,421 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 09:22:11,435 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b3d7351727ff69d6f228ee HTTP/1.1" 200 None 2026-03-15 09:22:11,436 - lava_callback - DEBUG - Processing node 69b3d7351727ff69d6f228ee: baseline-arm-baylibre 2026-03-15 09:22:11,437 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b3d7351727ff69d6f228ee 2026-03-15 09:22:11,437 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 09:22:11,452 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b3d7351727ff69d6f228ee HTTP/1.1" 200 None 2026-03-15 09:22:11,454 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 09:22:11,476 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69abdf2740deb775998f3ba4 HTTP/1.1" 200 None 2026-03-15 09:22:11,477 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 09:22:11,500 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b3d7351727ff69d6f228ee HTTP/1.1" 200 None 2026-03-15 09:22:11,502 - lava_callback - ERROR - Error processing callback for node 69b3d7351727ff69d6f228ee: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:37700 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:37708 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57946 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50124 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45360 - "GET / HTTP/1.0" 200 OK 2026-03-15 09:22:51,410 - lava_callback - INFO - Received callback for node 69b3d75d1727ff69d6f228f6 INFO: 172.21.0.1:60518 - "POST /node/69b3d75d1727ff69d6f228f6 HTTP/1.0" 202 Accepted 2026-03-15 09:22:51,416 - lava_callback - INFO - Starting async job submit for node 69b3d75d1727ff69d6f228f6 2026-03-15 09:22:51,417 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 09:22:51,432 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b3d75d1727ff69d6f228f6 HTTP/1.1" 200 None 2026-03-15 09:22:51,432 - lava_callback - DEBUG - Processing node 69b3d75d1727ff69d6f228f6: baseline-arm-clabbe 2026-03-15 09:22:51,433 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b3d75d1727ff69d6f228f6 2026-03-15 09:22:51,433 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 09:22:51,446 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b3d75d1727ff69d6f228f6 HTTP/1.1" 200 None 2026-03-15 09:22:51,447 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 09:22:51,461 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69abdf2740deb775998f3ba4 HTTP/1.1" 200 None 2026-03-15 09:22:51,462 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 09:22:51,483 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b3d75d1727ff69d6f228f6 HTTP/1.1" 200 None 2026-03-15 09:22:51,485 - lava_callback - ERROR - Error processing callback for node 69b3d75d1727ff69d6f228f6: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:60532 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60546 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46528 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38496 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:38504 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48122 - "GET / HTTP/1.0" 200 OK 2026-03-15 09:23:31,404 - lava_callback - INFO - Received callback for node 69b3d7821727ff69d6f22900 INFO: 172.21.0.1:46832 - "POST /node/69b3d7821727ff69d6f22900 HTTP/1.0" 202 Accepted 2026-03-15 09:23:31,409 - lava_callback - INFO - Starting async job submit for node 69b3d7821727ff69d6f22900 2026-03-15 09:23:31,410 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 09:23:31,424 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b3d7821727ff69d6f22900 HTTP/1.1" 200 None 2026-03-15 09:23:31,425 - lava_callback - DEBUG - Processing node 69b3d7821727ff69d6f22900: baseline-arm-clabbe 2026-03-15 09:23:31,426 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b3d7821727ff69d6f22900 2026-03-15 09:23:31,426 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 09:23:31,440 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b3d7821727ff69d6f22900 HTTP/1.1" 200 None 2026-03-15 09:23:31,441 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 09:23:31,466 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69abdf2740deb775998f3ba4 HTTP/1.1" 200 None 2026-03-15 09:23:31,468 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 09:23:31,499 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b3d7821727ff69d6f22900 HTTP/1.1" 200 None 2026-03-15 09:23:31,504 - lava_callback - ERROR - Error processing callback for node 69b3d7821727ff69d6f22900: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:46846 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60816 - "GET / HTTP/1.0" 200 OK 2026-03-15 09:23:51,530 - lava_callback - INFO - Received callback for node 69b3d7a41727ff69d6f2290a INFO: 172.21.0.1:33952 - "POST /node/69b3d7a41727ff69d6f2290a HTTP/1.0" 202 Accepted 2026-03-15 09:23:51,535 - lava_callback - INFO - Starting async job submit for node 69b3d7a41727ff69d6f2290a 2026-03-15 09:23:51,536 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 09:23:51,578 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b3d7a41727ff69d6f2290a HTTP/1.1" 200 None 2026-03-15 09:23:51,579 - lava_callback - DEBUG - Processing node 69b3d7a41727ff69d6f2290a: baseline-arm-baylibre 2026-03-15 09:23:51,580 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b3d7a41727ff69d6f2290a 2026-03-15 09:23:51,580 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 09:23:51,596 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b3d7a41727ff69d6f2290a HTTP/1.1" 200 None 2026-03-15 09:23:51,598 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 09:23:51,612 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69abdf2740deb775998f3ba4 HTTP/1.1" 200 None 2026-03-15 09:23:51,614 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 09:23:51,639 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b3d7a41727ff69d6f2290a HTTP/1.1" 200 None 2026-03-15 09:23:51,641 - lava_callback - ERROR - Error processing callback for node 69b3d7a41727ff69d6f2290a: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:33966 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33972 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39582 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58584 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:58594 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49762 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54814 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42660 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50276 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50288 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60188 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51788 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:51804 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36920 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51174 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37648 - "GET / HTTP/1.0" 200 OK 2026-03-15 09:25:51,727 - lava_callback - INFO - Received callback for node 69b3d81a1727ff69d6f22923 INFO: 172.21.0.1:44960 - "POST /node/69b3d81a1727ff69d6f22923 HTTP/1.0" 202 Accepted 2026-03-15 09:25:51,733 - lava_callback - INFO - Starting async job submit for node 69b3d81a1727ff69d6f22923 2026-03-15 09:25:51,734 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 09:25:51,751 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b3d81a1727ff69d6f22923 HTTP/1.1" 200 None 2026-03-15 09:25:51,752 - lava_callback - DEBUG - Processing node 69b3d81a1727ff69d6f22923: baseline-arm-baylibre 2026-03-15 09:25:51,752 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b3d81a1727ff69d6f22923 2026-03-15 09:25:51,753 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 09:25:51,767 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b3d81a1727ff69d6f22923 HTTP/1.1" 200 None 2026-03-15 09:25:51,769 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 09:25:51,782 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69abdf2740deb775998f3ba4 HTTP/1.1" 200 None 2026-03-15 09:25:51,784 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 09:25:51,813 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b3d81a1727ff69d6f22923 HTTP/1.1" 200 None 2026-03-15 09:25:51,814 - lava_callback - ERROR - Error processing callback for node 69b3d81a1727ff69d6f22923: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:44964 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44980 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35182 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39316 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:39318 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35364 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55828 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60432 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57114 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57130 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56136 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45496 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:45506 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51782 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46882 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50554 - "GET / HTTP/1.0" 200 OK 2026-03-15 09:27:51,739 - lava_callback - INFO - Received callback for node 69b3d8951727ff69d6f2293b INFO: 172.21.0.1:39912 - "POST /node/69b3d8951727ff69d6f2293b HTTP/1.0" 202 Accepted 2026-03-15 09:27:51,744 - lava_callback - INFO - Starting async job submit for node 69b3d8951727ff69d6f2293b 2026-03-15 09:27:51,745 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 09:27:51,771 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b3d8951727ff69d6f2293b HTTP/1.1" 200 None 2026-03-15 09:27:51,772 - lava_callback - DEBUG - Processing node 69b3d8951727ff69d6f2293b: baseline-arm64-baylibre 2026-03-15 09:27:51,772 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b3d8951727ff69d6f2293b 2026-03-15 09:27:51,773 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 09:27:51,810 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b3d8951727ff69d6f2293b HTTP/1.1" 200 None 2026-03-15 09:27:51,811 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 09:27:51,847 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ae822fc660ead8a389ab0e HTTP/1.1" 200 None 2026-03-15 09:27:51,849 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 09:27:51,870 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b3d8951727ff69d6f2293b HTTP/1.1" 200 None 2026-03-15 09:27:51,880 - lava_callback - ERROR - Error processing callback for node 69b3d8951727ff69d6f2293b: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:39916 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39918 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33614 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40808 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:40810 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59116 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36662 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49524 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39024 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39036 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41650 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35132 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:35146 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59776 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35394 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42156 - "GET / HTTP/1.0" 200 OK 2026-03-15 09:29:51,924 - lava_callback - INFO - Received callback for node 69b3d90b1727ff69d6f22955 INFO: 172.21.0.1:53446 - "POST /node/69b3d90b1727ff69d6f22955 HTTP/1.0" 202 Accepted 2026-03-15 09:29:51,929 - lava_callback - INFO - Starting async job submit for node 69b3d90b1727ff69d6f22955 2026-03-15 09:29:51,930 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 09:29:51,945 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b3d90b1727ff69d6f22955 HTTP/1.1" 200 None 2026-03-15 09:29:51,945 - lava_callback - DEBUG - Processing node 69b3d90b1727ff69d6f22955: baseline-arm64-baylibre 2026-03-15 09:29:51,946 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b3d90b1727ff69d6f22955 2026-03-15 09:29:51,946 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 09:29:51,975 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b3d90b1727ff69d6f22955 HTTP/1.1" 200 None 2026-03-15 09:29:51,976 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 09:29:51,991 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ae822fc660ead8a389ab0e HTTP/1.1" 200 None 2026-03-15 09:29:51,992 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 09:29:52,020 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b3d90b1727ff69d6f22955 HTTP/1.1" 200 None 2026-03-15 09:29:52,021 - lava_callback - ERROR - Error processing callback for node 69b3d90b1727ff69d6f22955: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:53460 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53462 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40330 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56486 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:56494 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35316 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41784 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51504 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48550 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48554 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50852 - "GET / HTTP/1.0" 200 OK 2026-03-15 09:31:11,939 - lava_callback - INFO - Received callback for node 69b3d95b1727ff69d6f22961 INFO: 172.21.0.1:34352 - "POST /node/69b3d95b1727ff69d6f22961 HTTP/1.0" 202 Accepted 2026-03-15 09:31:11,945 - lava_callback - INFO - Starting async job submit for node 69b3d95b1727ff69d6f22961 2026-03-15 09:31:11,946 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 09:31:11,990 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b3d95b1727ff69d6f22961 HTTP/1.1" 200 None 2026-03-15 09:31:11,991 - lava_callback - DEBUG - Processing node 69b3d95b1727ff69d6f22961: baseline-arm64-baylibre 2026-03-15 09:31:11,991 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b3d95b1727ff69d6f22961 2026-03-15 09:31:11,992 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 09:31:12,008 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b3d95b1727ff69d6f22961 HTTP/1.1" 200 None 2026-03-15 09:31:12,010 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 09:31:12,047 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ae822fc660ead8a389ab0e HTTP/1.1" 200 None 2026-03-15 09:31:12,048 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 09:31:12,069 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b3d95b1727ff69d6f22961 HTTP/1.1" 200 None 2026-03-15 09:31:12,072 - lava_callback - ERROR - Error processing callback for node 69b3d95b1727ff69d6f22961: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:34368 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:34378 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53218 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53350 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58526 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41286 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41294 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33084 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45550 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:45558 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59850 - "GET / HTTP/1.0" 200 OK 2026-03-15 09:32:32,078 - lava_callback - INFO - Received callback for node 69b3d9ae1727ff69d6f2296f INFO: 172.21.0.1:38172 - "POST /node/69b3d9ae1727ff69d6f2296f HTTP/1.0" 202 Accepted 2026-03-15 09:32:32,083 - lava_callback - INFO - Starting async job submit for node 69b3d9ae1727ff69d6f2296f 2026-03-15 09:32:32,084 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 09:32:32,127 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b3d9ae1727ff69d6f2296f HTTP/1.1" 200 None 2026-03-15 09:32:32,128 - lava_callback - DEBUG - Processing node 69b3d9ae1727ff69d6f2296f: baseline-arm64-baylibre 2026-03-15 09:32:32,128 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b3d9ae1727ff69d6f2296f 2026-03-15 09:32:32,129 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 09:32:32,142 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b3d9ae1727ff69d6f2296f HTTP/1.1" 200 None 2026-03-15 09:32:32,144 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 09:32:32,158 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ae822fc660ead8a389ab0e HTTP/1.1" 200 None 2026-03-15 09:32:32,159 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 09:32:32,180 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b3d9ae1727ff69d6f2296f HTTP/1.1" 200 None 2026-03-15 09:32:32,182 - lava_callback - ERROR - Error processing callback for node 69b3d9ae1727ff69d6f2296f: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:38174 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38390 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34224 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34240 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43076 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48390 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:48398 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45764 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48966 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35208 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59976 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59980 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43834 - "GET / HTTP/1.0" 200 OK 2026-03-15 09:34:12,138 - lava_callback - INFO - Received callback for node 69b3da011727ff69d6f22982 INFO: 172.21.0.1:33484 - "POST /node/69b3da011727ff69d6f22982 HTTP/1.0" 202 Accepted 2026-03-15 09:34:12,144 - lava_callback - INFO - Starting async job submit for node 69b3da011727ff69d6f22982 2026-03-15 09:34:12,145 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 09:34:12,160 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b3da011727ff69d6f22982 HTTP/1.1" 200 None 2026-03-15 09:34:12,161 - lava_callback - DEBUG - Processing node 69b3da011727ff69d6f22982: baseline-arm64-baylibre 2026-03-15 09:34:12,161 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b3da011727ff69d6f22982 2026-03-15 09:34:12,162 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 09:34:12,176 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b3da011727ff69d6f22982 HTTP/1.1" 200 None 2026-03-15 09:34:12,177 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 09:34:12,192 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ae822fc660ead8a389ab0e HTTP/1.1" 200 None 2026-03-15 09:34:12,194 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 09:34:12,243 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b3da011727ff69d6f22982 HTTP/1.1" 200 None 2026-03-15 09:34:12,245 - lava_callback - ERROR - Error processing callback for node 69b3da011727ff69d6f22982: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:33496 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:33510 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60884 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55730 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39784 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39988 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39998 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42414 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45172 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:45182 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49344 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54252 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49692 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52594 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52602 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55972 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50228 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:50236 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40084 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44860 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35514 - "GET / HTTP/1.0" 200 OK 2026-03-15 09:36:52,508 - lava_callback - INFO - Received callback for node 69b3daa71727ff69d6f2299b INFO: 172.21.0.1:41014 - "POST /node/69b3daa71727ff69d6f2299b HTTP/1.0" 202 Accepted 2026-03-15 09:36:52,514 - lava_callback - INFO - Starting async job submit for node 69b3daa71727ff69d6f2299b 2026-03-15 09:36:52,515 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 09:36:52,529 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b3daa71727ff69d6f2299b HTTP/1.1" 200 None 2026-03-15 09:36:52,530 - lava_callback - DEBUG - Processing node 69b3daa71727ff69d6f2299b: baseline-arm64-baylibre 2026-03-15 09:36:52,530 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b3daa71727ff69d6f2299b 2026-03-15 09:36:52,531 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 09:36:52,544 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b3daa71727ff69d6f2299b HTTP/1.1" 200 None 2026-03-15 09:36:52,546 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 09:36:52,559 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ae822fc660ead8a389ab0e HTTP/1.1" 200 None 2026-03-15 09:36:52,560 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 09:36:52,599 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b3daa71727ff69d6f2299b HTTP/1.1" 200 None 2026-03-15 09:36:52,601 - lava_callback - ERROR - Error processing callback for node 69b3daa71727ff69d6f2299b: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:41026 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34974 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34982 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54954 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:54964 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:32908 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34402 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34724 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51808 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58920 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58934 - "GET / HTTP/1.0" 200 OK 2026-03-15 09:38:12,047 - lava_callback - INFO - Received callback for node 69b3daf11727ff69d6f229a2 INFO: 172.21.0.1:41294 - "POST /node/69b3daf11727ff69d6f229a2 HTTP/1.0" 202 Accepted 2026-03-15 09:38:12,052 - lava_callback - INFO - Starting async job submit for node 69b3daf11727ff69d6f229a2 2026-03-15 09:38:12,053 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 09:38:12,067 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b3daf11727ff69d6f229a2 HTTP/1.1" 200 None 2026-03-15 09:38:12,068 - lava_callback - DEBUG - Processing node 69b3daf11727ff69d6f229a2: baseline-arm-clabbe 2026-03-15 09:38:12,069 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b3daf11727ff69d6f229a2 2026-03-15 09:38:12,069 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 09:38:12,093 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b3daf11727ff69d6f229a2 HTTP/1.1" 200 None 2026-03-15 09:38:12,094 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 09:38:12,107 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69abdf2740deb775998f3ba4 HTTP/1.1" 200 None 2026-03-15 09:38:12,109 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 09:38:12,130 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b3daf11727ff69d6f229a2 HTTP/1.1" 200 None 2026-03-15 09:38:12,131 - lava_callback - ERROR - Error processing callback for node 69b3daf11727ff69d6f229a2: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:41304 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:41306 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51482 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58972 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35750 - "GET / HTTP/1.0" 200 OK 2026-03-15 09:38:52,081 - lava_callback - INFO - Received callback for node 69b3db241727ff69d6f229b0 INFO: 172.21.0.1:58558 - "POST /node/69b3db241727ff69d6f229b0 HTTP/1.0" 202 Accepted 2026-03-15 09:38:52,087 - lava_callback - INFO - Starting async job submit for node 69b3db241727ff69d6f229b0 2026-03-15 09:38:52,087 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 09:38:52,102 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b3db241727ff69d6f229b0 HTTP/1.1" 200 None 2026-03-15 09:38:52,103 - lava_callback - DEBUG - Processing node 69b3db241727ff69d6f229b0: baseline-arm64-clabbe 2026-03-15 09:38:52,103 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b3db241727ff69d6f229b0 2026-03-15 09:38:52,104 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 09:38:52,123 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b3db241727ff69d6f229b0 HTTP/1.1" 200 None 2026-03-15 09:38:52,125 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 09:38:52,138 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ae822fc660ead8a389ab0e HTTP/1.1" 200 None 2026-03-15 09:38:52,140 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 09:38:52,160 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b3db241727ff69d6f229b0 HTTP/1.1" 200 None 2026-03-15 09:38:52,161 - lava_callback - ERROR - Error processing callback for node 69b3db241727ff69d6f229b0: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:58574 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44576 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44584 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49402 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:49404 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47396 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59474 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45124 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37794 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37358 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37364 - "GET / HTTP/1.0" 200 OK 2026-03-15 09:40:12,132 - lava_callback - INFO - Received callback for node 69b3db781727ff69d6f229bf INFO: 172.21.0.1:52706 - "POST /node/69b3db781727ff69d6f229bf HTTP/1.0" 202 Accepted 2026-03-15 09:40:12,137 - lava_callback - INFO - Starting async job submit for node 69b3db781727ff69d6f229bf 2026-03-15 09:40:12,138 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 09:40:12,153 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b3db781727ff69d6f229bf HTTP/1.1" 200 None 2026-03-15 09:40:12,154 - lava_callback - DEBUG - Processing node 69b3db781727ff69d6f229bf: baseline-arm64-clabbe 2026-03-15 09:40:12,154 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b3db781727ff69d6f229bf 2026-03-15 09:40:12,155 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 09:40:12,175 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b3db781727ff69d6f229bf HTTP/1.1" 200 None 2026-03-15 09:40:12,176 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 09:40:12,190 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ae822fc660ead8a389ab0e HTTP/1.1" 200 None 2026-03-15 09:40:12,191 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 09:40:12,212 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b3db781727ff69d6f229bf HTTP/1.1" 200 None 2026-03-15 09:40:12,213 - lava_callback - ERROR - Error processing callback for node 69b3db781727ff69d6f229bf: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:52714 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:52728 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52194 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52678 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50786 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42940 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60528 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60542 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41578 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:41590 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49776 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58282 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58400 - "GET / HTTP/1.0" 200 OK 2026-03-15 09:41:52,278 - lava_callback - INFO - Received callback for node 69b3dbcd1727ff69d6f229ca INFO: 172.21.0.1:46060 - "POST /node/69b3dbcd1727ff69d6f229ca HTTP/1.0" 202 Accepted 2026-03-15 09:41:52,283 - lava_callback - INFO - Starting async job submit for node 69b3dbcd1727ff69d6f229ca 2026-03-15 09:41:52,284 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 09:41:52,308 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b3dbcd1727ff69d6f229ca HTTP/1.1" 200 None 2026-03-15 09:41:52,309 - lava_callback - DEBUG - Processing node 69b3dbcd1727ff69d6f229ca: baseline-arm64-clabbe 2026-03-15 09:41:52,309 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b3dbcd1727ff69d6f229ca 2026-03-15 09:41:52,310 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 09:41:52,328 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b3dbcd1727ff69d6f229ca HTTP/1.1" 200 None 2026-03-15 09:41:52,330 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 09:41:52,354 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ae822fc660ead8a389ab0e HTTP/1.1" 200 None 2026-03-15 09:41:52,356 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 09:41:52,376 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b3dbcd1727ff69d6f229ca HTTP/1.1" 200 None 2026-03-15 09:41:52,377 - lava_callback - ERROR - Error processing callback for node 69b3dbcd1727ff69d6f229ca: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:46064 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54890 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54902 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36336 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:36340 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55948 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41498 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46236 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53404 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50902 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50906 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58488 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:58500 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40548 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60610 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38952 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45670 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36950 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36958 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36210 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:36226 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36024 - "GET / HTTP/1.0" 200 OK 2026-03-15 09:44:32,344 - lava_callback - INFO - Received callback for node 69b3dc721727ff69d6f229dd INFO: 172.21.0.1:46118 - "POST /node/69b3dc721727ff69d6f229dd HTTP/1.0" 202 Accepted 2026-03-15 09:44:32,349 - lava_callback - INFO - Starting async job submit for node 69b3dc721727ff69d6f229dd 2026-03-15 09:44:32,350 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 09:44:32,390 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b3dc721727ff69d6f229dd HTTP/1.1" 200 None 2026-03-15 09:44:32,391 - lava_callback - DEBUG - Processing node 69b3dc721727ff69d6f229dd: baseline-arm64-clabbe 2026-03-15 09:44:32,391 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b3dc721727ff69d6f229dd 2026-03-15 09:44:32,392 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 09:44:32,417 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b3dc721727ff69d6f229dd HTTP/1.1" 200 None 2026-03-15 09:44:32,419 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 09:44:32,433 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ae822fc660ead8a389ab0e HTTP/1.1" 200 None 2026-03-15 09:44:32,434 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 09:44:32,454 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b3dc721727ff69d6f229dd HTTP/1.1" 200 None 2026-03-15 09:44:32,456 - lava_callback - ERROR - Error processing callback for node 69b3dc721727ff69d6f229dd: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:46120 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40164 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33470 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40594 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40604 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57608 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:57616 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50976 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42518 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57448 - "GET / HTTP/1.0" 200 OK 2026-03-15 09:45:52,390 - lava_callback - INFO - Received callback for node 69b3dcc41727ff69d6f229e7 INFO: 172.21.0.1:54670 - "POST /node/69b3dcc41727ff69d6f229e7 HTTP/1.0" 202 Accepted 2026-03-15 09:45:52,395 - lava_callback - INFO - Starting async job submit for node 69b3dcc41727ff69d6f229e7 2026-03-15 09:45:52,396 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 09:45:52,410 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b3dcc41727ff69d6f229e7 HTTP/1.1" 200 None 2026-03-15 09:45:52,411 - lava_callback - DEBUG - Processing node 69b3dcc41727ff69d6f229e7: baseline-arm64-clabbe 2026-03-15 09:45:52,411 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b3dcc41727ff69d6f229e7 2026-03-15 09:45:52,412 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 09:45:52,430 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b3dcc41727ff69d6f229e7 HTTP/1.1" 200 None 2026-03-15 09:45:52,431 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 09:45:52,445 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ae822fc660ead8a389ab0e HTTP/1.1" 200 None 2026-03-15 09:45:52,446 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 09:45:52,468 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b3dcc41727ff69d6f229e7 HTTP/1.1" 200 None 2026-03-15 09:45:52,478 - lava_callback - ERROR - Error processing callback for node 69b3dcc41727ff69d6f229e7: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:54674 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44526 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44532 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44110 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:44116 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37850 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43202 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35058 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47328 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34200 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34210 - "GET / HTTP/1.0" 200 OK 2026-03-15 09:47:12,435 - lava_callback - INFO - Received callback for node 69b3dd151727ff69d6f229f0 INFO: 172.21.0.1:44226 - "POST /node/69b3dd151727ff69d6f229f0 HTTP/1.0" 202 Accepted 2026-03-15 09:47:12,441 - lava_callback - INFO - Starting async job submit for node 69b3dd151727ff69d6f229f0 2026-03-15 09:47:12,442 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 09:47:12,457 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b3dd151727ff69d6f229f0 HTTP/1.1" 200 None 2026-03-15 09:47:12,458 - lava_callback - DEBUG - Processing node 69b3dd151727ff69d6f229f0: baseline-arm64-clabbe 2026-03-15 09:47:12,458 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b3dd151727ff69d6f229f0 2026-03-15 09:47:12,459 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 09:47:12,472 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b3dd151727ff69d6f229f0 HTTP/1.1" 200 None 2026-03-15 09:47:12,474 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 09:47:12,491 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ae822fc660ead8a389ab0e HTTP/1.1" 200 None 2026-03-15 09:47:12,493 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 09:47:12,515 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b3dd151727ff69d6f229f0 HTTP/1.1" 200 None 2026-03-15 09:47:12,516 - lava_callback - ERROR - Error processing callback for node 69b3dd151727ff69d6f229f0: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:44242 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:44256 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51664 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49784 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53248 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60240 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56550 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56552 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45302 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:45314 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58948 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45054 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38818 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59294 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37486 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37488 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37882 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:37888 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56960 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48888 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57728 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35950 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37538 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37550 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37908 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:37922 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36396 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34560 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40322 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50940 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50164 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50170 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39708 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:39720 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42142 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33674 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53086 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40474 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54252 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54266 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54484 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:54498 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:32868 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36650 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38270 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35492 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39680 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39696 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37298 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:37304 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46692 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49328 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52776 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35342 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37482 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37488 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38286 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:38300 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55748 - "GET / HTTP/1.0" 200 OK 2026-03-15 09:54:33,190 - lava_callback - INFO - Received callback for node 69b3deca1727ff69d6f22a29 INFO: 172.21.0.1:35698 - "POST /node/69b3deca1727ff69d6f22a29 HTTP/1.0" 202 Accepted 2026-03-15 09:54:33,196 - lava_callback - INFO - Starting async job submit for node 69b3deca1727ff69d6f22a29 2026-03-15 09:54:33,197 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 09:54:33,216 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b3deca1727ff69d6f22a29 HTTP/1.1" 200 None 2026-03-15 09:54:33,216 - lava_callback - DEBUG - Processing node 69b3deca1727ff69d6f22a29: baseline-arm64-baylibre 2026-03-15 09:54:33,217 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b3deca1727ff69d6f22a29 2026-03-15 09:54:33,217 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 09:54:33,230 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b3deca1727ff69d6f22a29 HTTP/1.1" 200 None 2026-03-15 09:54:33,232 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 09:54:33,245 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69abdf3340deb775998f3bb5 HTTP/1.1" 200 None 2026-03-15 09:54:33,246 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 09:54:33,278 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b3deca1727ff69d6f22a29 HTTP/1.1" 200 None 2026-03-15 09:54:33,279 - lava_callback - ERROR - Error processing callback for node 69b3deca1727ff69d6f22a29: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:35706 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45532 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60782 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59946 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59956 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51804 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:51814 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49504 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49938 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45626 - "GET / HTTP/1.0" 200 OK 2026-03-15 09:55:53,339 - lava_callback - INFO - Received callback for node 69b3df1d1727ff69d6f22a39 INFO: 172.21.0.1:56912 - "POST /node/69b3df1d1727ff69d6f22a39 HTTP/1.0" 202 Accepted 2026-03-15 09:55:53,344 - lava_callback - INFO - Starting async job submit for node 69b3df1d1727ff69d6f22a39 2026-03-15 09:55:53,345 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 09:55:53,359 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b3df1d1727ff69d6f22a39 HTTP/1.1" 200 None 2026-03-15 09:55:53,360 - lava_callback - DEBUG - Processing node 69b3df1d1727ff69d6f22a39: baseline-arm64-baylibre 2026-03-15 09:55:53,361 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b3df1d1727ff69d6f22a39 2026-03-15 09:55:53,361 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 09:55:53,374 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b3df1d1727ff69d6f22a39 HTTP/1.1" 200 None 2026-03-15 09:55:53,376 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 09:55:53,400 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69abdf3340deb775998f3bb5 HTTP/1.1" 200 None 2026-03-15 09:55:53,402 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 09:55:53,423 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b3df1d1727ff69d6f22a39 HTTP/1.1" 200 None 2026-03-15 09:55:53,424 - lava_callback - ERROR - Error processing callback for node 69b3df1d1727ff69d6f22a39: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:56926 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45798 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45800 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33084 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:33088 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46892 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55680 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58746 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51340 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37716 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37720 - "GET / HTTP/1.0" 200 OK 2026-03-15 09:57:13,332 - lava_callback - INFO - Received callback for node 69b3df6f1727ff69d6f22a46 INFO: 172.21.0.1:36430 - "POST /node/69b3df6f1727ff69d6f22a46 HTTP/1.0" 202 Accepted 2026-03-15 09:57:13,338 - lava_callback - INFO - Starting async job submit for node 69b3df6f1727ff69d6f22a46 2026-03-15 09:57:13,339 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 09:57:13,353 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b3df6f1727ff69d6f22a46 HTTP/1.1" 200 None 2026-03-15 09:57:13,354 - lava_callback - DEBUG - Processing node 69b3df6f1727ff69d6f22a46: baseline-arm64-baylibre 2026-03-15 09:57:13,354 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b3df6f1727ff69d6f22a46 2026-03-15 09:57:13,355 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 09:57:13,371 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b3df6f1727ff69d6f22a46 HTTP/1.1" 200 None 2026-03-15 09:57:13,373 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 09:57:13,408 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69abdf3340deb775998f3bb5 HTTP/1.1" 200 None 2026-03-15 09:57:13,409 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 09:57:13,464 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b3df6f1727ff69d6f22a46 HTTP/1.1" 200 None 2026-03-15 09:57:13,465 - lava_callback - ERROR - Error processing callback for node 69b3df6f1727ff69d6f22a46: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:36446 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:36456 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55816 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40982 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58110 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34272 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39500 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39516 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42454 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:42468 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50958 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50008 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59428 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41544 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50800 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50804 - "GET / HTTP/1.0" 200 OK 2026-03-15 09:59:13,413 - lava_callback - INFO - Received callback for node 69b3dfe51727ff69d6f22a74 INFO: 172.21.0.1:50350 - "POST /node/69b3dfe51727ff69d6f22a74 HTTP/1.0" 202 Accepted 2026-03-15 09:59:13,418 - lava_callback - INFO - Starting async job submit for node 69b3dfe51727ff69d6f22a74 2026-03-15 09:59:13,419 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 09:59:13,434 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b3dfe51727ff69d6f22a74 HTTP/1.1" 200 None 2026-03-15 09:59:13,435 - lava_callback - DEBUG - Processing node 69b3dfe51727ff69d6f22a74: baseline-arm64-baylibre 2026-03-15 09:59:13,435 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b3dfe51727ff69d6f22a74 2026-03-15 09:59:13,436 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 09:59:13,449 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b3dfe51727ff69d6f22a74 HTTP/1.1" 200 None 2026-03-15 09:59:13,451 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 09:59:13,473 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69abdf3340deb775998f3bb5 HTTP/1.1" 200 None 2026-03-15 09:59:13,474 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 09:59:13,497 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b3dfe51727ff69d6f22a74 HTTP/1.1" 200 None 2026-03-15 09:59:13,505 - lava_callback - ERROR - Error processing callback for node 69b3dfe51727ff69d6f22a74: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:50356 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:50370 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57544 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43282 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41726 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40508 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50134 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50142 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57914 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:57922 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41100 - "GET / HTTP/1.0" 200 OK 2026-03-15 10:00:33,475 - lava_callback - INFO - Received callback for node 69b3e0371727ff69d6f22a7e INFO: 172.21.0.1:37094 - "POST /node/69b3e0371727ff69d6f22a7e HTTP/1.0" 202 Accepted 2026-03-15 10:00:33,481 - lava_callback - INFO - Starting async job submit for node 69b3e0371727ff69d6f22a7e 2026-03-15 10:00:33,482 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 10:00:33,506 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b3e0371727ff69d6f22a7e HTTP/1.1" 200 None 2026-03-15 10:00:33,506 - lava_callback - DEBUG - Processing node 69b3e0371727ff69d6f22a7e: baseline-arm64-baylibre 2026-03-15 10:00:33,507 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b3e0371727ff69d6f22a7e 2026-03-15 10:00:33,507 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 10:00:33,521 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b3e0371727ff69d6f22a7e HTTP/1.1" 200 None 2026-03-15 10:00:33,522 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 10:00:33,541 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69abdf3340deb775998f3bb5 HTTP/1.1" 200 None 2026-03-15 10:00:33,543 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 10:00:33,565 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b3e0371727ff69d6f22a7e HTTP/1.1" 200 None 2026-03-15 10:00:33,566 - lava_callback - ERROR - Error processing callback for node 69b3e0371727ff69d6f22a7e: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:37106 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47950 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33208 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39762 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39768 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42202 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:42218 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51958 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42558 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50612 - "GET / HTTP/1.0" 200 OK 2026-03-15 10:01:53,624 - lava_callback - INFO - Received callback for node 69b3e0891727ff69d6f22a87 INFO: 172.21.0.1:49396 - "POST /node/69b3e0891727ff69d6f22a87 HTTP/1.0" 202 Accepted 2026-03-15 10:01:53,629 - lava_callback - INFO - Starting async job submit for node 69b3e0891727ff69d6f22a87 2026-03-15 10:01:53,630 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 10:01:53,645 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b3e0891727ff69d6f22a87 HTTP/1.1" 200 None 2026-03-15 10:01:53,646 - lava_callback - DEBUG - Processing node 69b3e0891727ff69d6f22a87: baseline-arm64-baylibre 2026-03-15 10:01:53,646 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b3e0891727ff69d6f22a87 2026-03-15 10:01:53,647 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 10:01:53,664 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b3e0891727ff69d6f22a87 HTTP/1.1" 200 None 2026-03-15 10:01:53,666 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 10:01:53,685 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69abdf3340deb775998f3bb5 HTTP/1.1" 200 None 2026-03-15 10:01:53,686 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 10:01:53,707 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b3e0891727ff69d6f22a87 HTTP/1.1" 200 None 2026-03-15 10:01:53,708 - lava_callback - ERROR - Error processing callback for node 69b3e0891727ff69d6f22a87: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:49402 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57752 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57762 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46248 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:46260 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51788 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56310 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54882 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42534 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52914 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52926 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34974 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:34976 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37436 - "GET / HTTP/1.0" 200 OK 2026-03-15 10:03:33,140 - lava_callback - INFO - Received callback for node 69b3e0e41727ff69d6f22a93 INFO: 172.21.0.1:44000 - "POST /node/69b3e0e41727ff69d6f22a93 HTTP/1.0" 202 Accepted 2026-03-15 10:03:33,145 - lava_callback - INFO - Starting async job submit for node 69b3e0e41727ff69d6f22a93 2026-03-15 10:03:33,146 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 10:03:33,168 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b3e0e41727ff69d6f22a93 HTTP/1.1" 200 None 2026-03-15 10:03:33,168 - lava_callback - DEBUG - Processing node 69b3e0e41727ff69d6f22a93: baseline-arm64-clabbe 2026-03-15 10:03:33,169 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b3e0e41727ff69d6f22a93 2026-03-15 10:03:33,169 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 10:03:33,183 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b3e0e41727ff69d6f22a93 HTTP/1.1" 200 None 2026-03-15 10:03:33,185 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 10:03:33,200 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69abdf3340deb775998f3bb5 HTTP/1.1" 200 None 2026-03-15 10:03:33,202 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 10:03:33,226 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b3e0e41727ff69d6f22a93 HTTP/1.1" 200 None 2026-03-15 10:03:33,232 - lava_callback - ERROR - Error processing callback for node 69b3e0e41727ff69d6f22a93: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:44010 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55884 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37178 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38548 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38556 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33220 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:33224 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53954 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57364 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49328 - "GET / HTTP/1.0" 200 OK 2026-03-15 10:04:53,198 - lava_callback - INFO - Received callback for node 69b3e1391727ff69d6f22a9d INFO: 172.21.0.1:44848 - "POST /node/69b3e1391727ff69d6f22a9d HTTP/1.0" 202 Accepted 2026-03-15 10:04:53,203 - lava_callback - INFO - Starting async job submit for node 69b3e1391727ff69d6f22a9d 2026-03-15 10:04:53,204 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 10:04:53,219 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b3e1391727ff69d6f22a9d HTTP/1.1" 200 None 2026-03-15 10:04:53,220 - lava_callback - DEBUG - Processing node 69b3e1391727ff69d6f22a9d: baseline-arm64-clabbe 2026-03-15 10:04:53,220 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b3e1391727ff69d6f22a9d 2026-03-15 10:04:53,221 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 10:04:53,234 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b3e1391727ff69d6f22a9d HTTP/1.1" 200 None 2026-03-15 10:04:53,235 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 10:04:53,248 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69abdf3340deb775998f3bb5 HTTP/1.1" 200 None 2026-03-15 10:04:53,250 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 10:04:53,272 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b3e1391727ff69d6f22a9d HTTP/1.1" 200 None 2026-03-15 10:04:53,273 - lava_callback - ERROR - Error processing callback for node 69b3e1391727ff69d6f22a9d: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:44856 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54004 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54006 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43386 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:43390 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33162 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45578 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55578 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55252 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50574 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50584 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35180 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:35190 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50750 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38688 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57024 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52048 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60336 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60350 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43442 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:43452 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60262 - "GET / HTTP/1.0" 200 OK 2026-03-15 10:07:34,096 - lava_callback - INFO - Received callback for node 69b3e1d71727ff69d6f22ab2 INFO: 172.21.0.1:45954 - "POST /node/69b3e1d71727ff69d6f22ab2 HTTP/1.0" 202 Accepted 2026-03-15 10:07:34,101 - lava_callback - INFO - Starting async job submit for node 69b3e1d71727ff69d6f22ab2 2026-03-15 10:07:34,102 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 10:07:34,117 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b3e1d71727ff69d6f22ab2 HTTP/1.1" 200 None 2026-03-15 10:07:34,118 - lava_callback - DEBUG - Processing node 69b3e1d71727ff69d6f22ab2: baseline-arm64-baylibre 2026-03-15 10:07:34,118 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b3e1d71727ff69d6f22ab2 2026-03-15 10:07:34,119 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 10:07:34,133 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b3e1d71727ff69d6f22ab2 HTTP/1.1" 200 None 2026-03-15 10:07:34,134 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 10:07:34,152 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b125a3a870a1dc3343ba94 HTTP/1.1" 200 None 2026-03-15 10:07:34,154 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 10:07:34,176 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b3e1d71727ff69d6f22ab2 HTTP/1.1" 200 None 2026-03-15 10:07:34,177 - lava_callback - ERROR - Error processing callback for node 69b3e1d71727ff69d6f22ab2: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:45958 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47492 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42438 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58626 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58640 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49516 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:49528 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34016 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39674 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60804 - "GET / HTTP/1.0" 200 OK 2026-03-15 10:08:54,180 - lava_callback - INFO - Received callback for node 69b3e22d1727ff69d6f22abc INFO: 172.21.0.1:58688 - "POST /node/69b3e22d1727ff69d6f22abc HTTP/1.0" 202 Accepted 2026-03-15 10:08:54,185 - lava_callback - INFO - Starting async job submit for node 69b3e22d1727ff69d6f22abc 2026-03-15 10:08:54,186 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 10:08:54,201 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b3e22d1727ff69d6f22abc HTTP/1.1" 200 None 2026-03-15 10:08:54,202 - lava_callback - DEBUG - Processing node 69b3e22d1727ff69d6f22abc: baseline-arm64-baylibre 2026-03-15 10:08:54,202 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b3e22d1727ff69d6f22abc 2026-03-15 10:08:54,202 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 10:08:54,221 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b3e22d1727ff69d6f22abc HTTP/1.1" 200 None 2026-03-15 10:08:54,222 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 10:08:54,235 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b125a3a870a1dc3343ba94 HTTP/1.1" 200 None 2026-03-15 10:08:54,237 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 10:08:54,257 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b3e22d1727ff69d6f22abc HTTP/1.1" 200 None 2026-03-15 10:08:54,268 - lava_callback - ERROR - Error processing callback for node 69b3e22d1727ff69d6f22abc: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:58694 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49084 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49094 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43054 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:43068 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43392 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35376 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40910 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34272 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49924 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49930 - "GET / HTTP/1.0" 200 OK 2026-03-15 10:10:14,053 - lava_callback - INFO - Received callback for node 69b3e27f1727ff69d6f22ac9 INFO: 172.21.0.1:34278 - "POST /node/69b3e27f1727ff69d6f22ac9 HTTP/1.0" 202 Accepted 2026-03-15 10:10:14,059 - lava_callback - INFO - Starting async job submit for node 69b3e27f1727ff69d6f22ac9 2026-03-15 10:10:14,060 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 10:10:14,076 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b3e27f1727ff69d6f22ac9 HTTP/1.1" 200 None 2026-03-15 10:10:14,077 - lava_callback - DEBUG - Processing node 69b3e27f1727ff69d6f22ac9: baseline-arm64-baylibre 2026-03-15 10:10:14,077 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b3e27f1727ff69d6f22ac9 2026-03-15 10:10:14,078 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 10:10:14,091 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b3e27f1727ff69d6f22ac9 HTTP/1.1" 200 None 2026-03-15 10:10:14,092 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 10:10:14,106 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b125a3a870a1dc3343ba94 HTTP/1.1" 200 None 2026-03-15 10:10:14,107 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 10:10:14,127 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b3e27f1727ff69d6f22ac9 HTTP/1.1" 200 None 2026-03-15 10:10:14,137 - lava_callback - ERROR - Error processing callback for node 69b3e27f1727ff69d6f22ac9: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:34282 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:34284 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54940 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48558 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34654 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41192 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60230 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60236 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41886 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:41902 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51390 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50820 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41424 - "GET / HTTP/1.0" 200 OK 2026-03-15 10:11:53,695 - lava_callback - INFO - Received callback for node 69b3e2d71727ff69d6f22adc INFO: 172.21.0.1:36164 - "POST /node/69b3e2d71727ff69d6f22adc HTTP/1.0" 202 Accepted 2026-03-15 10:11:53,701 - lava_callback - INFO - Starting async job submit for node 69b3e2d71727ff69d6f22adc 2026-03-15 10:11:53,701 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 10:11:53,716 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b3e2d71727ff69d6f22adc HTTP/1.1" 200 None 2026-03-15 10:11:53,717 - lava_callback - DEBUG - Processing node 69b3e2d71727ff69d6f22adc: baseline-arm64-clabbe 2026-03-15 10:11:53,718 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b3e2d71727ff69d6f22adc 2026-03-15 10:11:53,718 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 10:11:53,745 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b3e2d71727ff69d6f22adc HTTP/1.1" 200 None 2026-03-15 10:11:53,747 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 10:11:53,780 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b125a3a870a1dc3343ba94 HTTP/1.1" 200 None 2026-03-15 10:11:53,782 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 10:11:53,825 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b3e2d71727ff69d6f22adc HTTP/1.1" 200 None 2026-03-15 10:11:53,826 - lava_callback - ERROR - Error processing callback for node 69b3e2d71727ff69d6f22adc: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:36170 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40672 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40684 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48406 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:48412 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43140 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52446 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55166 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58928 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49058 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49062 - "GET / HTTP/1.0" 200 OK 2026-03-15 10:13:13,771 - lava_callback - INFO - Received callback for node 69b3e32a1727ff69d6f22ae4 INFO: 172.21.0.1:51350 - "POST /node/69b3e32a1727ff69d6f22ae4 HTTP/1.0" 202 Accepted 2026-03-15 10:13:13,777 - lava_callback - INFO - Starting async job submit for node 69b3e32a1727ff69d6f22ae4 2026-03-15 10:13:13,778 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 10:13:13,793 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b3e32a1727ff69d6f22ae4 HTTP/1.1" 200 None 2026-03-15 10:13:13,794 - lava_callback - DEBUG - Processing node 69b3e32a1727ff69d6f22ae4: baseline-arm64-clabbe 2026-03-15 10:13:13,794 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b3e32a1727ff69d6f22ae4 2026-03-15 10:13:13,795 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 10:13:13,808 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b3e32a1727ff69d6f22ae4 HTTP/1.1" 200 None 2026-03-15 10:13:13,811 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 10:13:13,827 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b125a3a870a1dc3343ba94 HTTP/1.1" 200 None 2026-03-15 10:13:13,829 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 10:13:13,852 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b3e32a1727ff69d6f22ae4 HTTP/1.1" 200 None 2026-03-15 10:13:13,853 - lava_callback - ERROR - Error processing callback for node 69b3e32a1727ff69d6f22ae4: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:51352 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:51360 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52426 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55932 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51920 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44094 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51942 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51958 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43792 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:43808 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36190 - "GET / HTTP/1.0" 200 OK 2026-03-15 10:14:33,757 - lava_callback - INFO - Received callback for node 69b3e37d1727ff69d6f22ae9 INFO: 172.21.0.1:49000 - "POST /node/69b3e37d1727ff69d6f22ae9 HTTP/1.0" 202 Accepted 2026-03-15 10:14:33,763 - lava_callback - INFO - Starting async job submit for node 69b3e37d1727ff69d6f22ae9 2026-03-15 10:14:33,764 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 10:14:33,779 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b3e37d1727ff69d6f22ae9 HTTP/1.1" 200 None 2026-03-15 10:14:33,779 - lava_callback - DEBUG - Processing node 69b3e37d1727ff69d6f22ae9: baseline-arm64-clabbe 2026-03-15 10:14:33,780 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b3e37d1727ff69d6f22ae9 2026-03-15 10:14:33,780 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 10:14:33,807 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b3e37d1727ff69d6f22ae9 HTTP/1.1" 200 None 2026-03-15 10:14:33,808 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 10:14:33,829 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b125a3a870a1dc3343ba94 HTTP/1.1" 200 None 2026-03-15 10:14:33,830 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 10:14:33,851 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b3e37d1727ff69d6f22ae9 HTTP/1.1" 200 None 2026-03-15 10:14:33,852 - lava_callback - ERROR - Error processing callback for node 69b3e37d1727ff69d6f22ae9: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:49016 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41386 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47362 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41472 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41474 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46932 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:46946 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51970 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53478 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54460 - "GET / HTTP/1.0" 200 OK 2026-03-15 10:15:53,886 - lava_callback - INFO - Received callback for node 69b3e3cf1727ff69d6f22af3 INFO: 172.21.0.1:51034 - "POST /node/69b3e3cf1727ff69d6f22af3 HTTP/1.0" 202 Accepted 2026-03-15 10:15:53,892 - lava_callback - INFO - Starting async job submit for node 69b3e3cf1727ff69d6f22af3 2026-03-15 10:15:53,893 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 10:15:53,913 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b3e3cf1727ff69d6f22af3 HTTP/1.1" 200 None 2026-03-15 10:15:53,913 - lava_callback - DEBUG - Processing node 69b3e3cf1727ff69d6f22af3: baseline-arm64-clabbe 2026-03-15 10:15:53,914 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b3e3cf1727ff69d6f22af3 2026-03-15 10:15:53,914 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 10:15:53,937 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b3e3cf1727ff69d6f22af3 HTTP/1.1" 200 None 2026-03-15 10:15:53,939 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 10:15:53,952 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b125a3a870a1dc3343ba94 HTTP/1.1" 200 None 2026-03-15 10:15:53,953 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 10:15:53,982 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b3e3cf1727ff69d6f22af3 HTTP/1.1" 200 None 2026-03-15 10:15:53,983 - lava_callback - ERROR - Error processing callback for node 69b3e3cf1727ff69d6f22af3: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:51046 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51904 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51916 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37120 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:37134 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36250 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54010 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60858 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33560 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34944 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34960 - "GET / HTTP/1.0" 200 OK 2026-03-15 10:17:13,812 - lava_callback - INFO - Received callback for node 69b3e4211727ff69d6f22afc INFO: 172.21.0.1:33996 - "POST /node/69b3e4211727ff69d6f22afc HTTP/1.0" 202 Accepted 2026-03-15 10:17:13,818 - lava_callback - INFO - Starting async job submit for node 69b3e4211727ff69d6f22afc 2026-03-15 10:17:13,819 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 10:17:13,852 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b3e4211727ff69d6f22afc HTTP/1.1" 200 None 2026-03-15 10:17:13,852 - lava_callback - DEBUG - Processing node 69b3e4211727ff69d6f22afc: baseline-arm64-clabbe 2026-03-15 10:17:13,853 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b3e4211727ff69d6f22afc 2026-03-15 10:17:13,853 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 10:17:13,867 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b3e4211727ff69d6f22afc HTTP/1.1" 200 None 2026-03-15 10:17:13,869 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 10:17:13,882 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b125a3a870a1dc3343ba94 HTTP/1.1" 200 None 2026-03-15 10:17:13,884 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 10:17:13,904 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b3e4211727ff69d6f22afc HTTP/1.1" 200 None 2026-03-15 10:17:13,905 - lava_callback - ERROR - Error processing callback for node 69b3e4211727ff69d6f22afc: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:34008 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:34018 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59598 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33488 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57992 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33580 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59880 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59886 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58942 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:58950 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40228 - "GET / HTTP/1.0" 200 OK 2026-03-15 10:18:33,860 - lava_callback - INFO - Received callback for node 69b3e4721727ff69d6f22b07 INFO: 172.21.0.1:56754 - "POST /node/69b3e4721727ff69d6f22b07 HTTP/1.0" 202 Accepted 2026-03-15 10:18:33,866 - lava_callback - INFO - Starting async job submit for node 69b3e4721727ff69d6f22b07 2026-03-15 10:18:33,867 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 10:18:33,893 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b3e4721727ff69d6f22b07 HTTP/1.1" 200 None 2026-03-15 10:18:33,894 - lava_callback - DEBUG - Processing node 69b3e4721727ff69d6f22b07: baseline-arm64-clabbe 2026-03-15 10:18:33,894 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b3e4721727ff69d6f22b07 2026-03-15 10:18:33,895 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 10:18:33,909 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b3e4721727ff69d6f22b07 HTTP/1.1" 200 None 2026-03-15 10:18:33,911 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 10:18:33,924 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b125a3a870a1dc3343ba94 HTTP/1.1" 200 None 2026-03-15 10:18:33,926 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 10:18:33,946 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b3e4721727ff69d6f22b07 HTTP/1.1" 200 None 2026-03-15 10:18:33,947 - lava_callback - ERROR - Error processing callback for node 69b3e4721727ff69d6f22b07: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:56764 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58930 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56066 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39852 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39860 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36602 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:36610 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57506 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34984 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44354 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50540 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33456 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33472 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46392 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:46400 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50738 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43716 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51006 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44276 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44122 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44136 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44374 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:44380 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43694 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33662 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58374 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43040 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37262 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37266 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60176 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:60180 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47716 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36562 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43770 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53576 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58750 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58762 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38024 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:38026 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44102 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50344 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58170 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59184 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42558 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42562 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38206 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:38214 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48632 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44434 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41880 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57210 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57292 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57304 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58146 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:58150 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48212 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55780 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44642 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56492 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46266 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46272 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43132 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:43134 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44954 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56840 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60048 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41650 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53626 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53634 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49644 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:49654 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44480 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35780 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45426 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60518 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39236 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39248 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43578 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:43588 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52576 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34278 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58462 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41336 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52344 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52348 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34728 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:34742 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41780 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47504 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43894 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33848 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49736 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49752 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57476 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:57490 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48756 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37338 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52608 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51142 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57620 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57626 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38880 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:38890 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36202 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54236 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51932 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52308 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43968 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43984 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40584 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:40600 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46454 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55380 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33194 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38930 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57048 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57056 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47418 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:47426 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57070 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38034 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58204 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41972 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38412 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38424 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35274 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:35276 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50526 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52288 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34104 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38350 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54352 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54364 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53118 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:53126 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42916 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49276 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58758 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44940 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47436 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47452 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53550 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:53564 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55696 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59246 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55328 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49024 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39494 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39508 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56450 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:56466 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60016 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:32936 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45454 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34140 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58238 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58254 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34430 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:34440 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49956 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45746 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46914 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:32770 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55024 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55038 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48786 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:48788 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36362 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57372 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42924 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60206 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33030 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33042 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41536 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:41544 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58346 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40142 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34794 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49374 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48618 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48626 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45998 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:46002 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56276 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47698 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58056 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50608 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38866 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38876 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40570 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:40586 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45930 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36052 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57378 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52482 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57162 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57176 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45494 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:45498 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36858 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60920 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57714 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53986 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33794 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33796 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43738 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:43744 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57114 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40418 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46182 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49836 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55734 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55740 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37202 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:37210 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47260 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59354 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44500 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45996 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50688 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50692 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39036 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:39050 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:32880 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48626 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35772 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49466 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51518 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51520 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52362 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:52364 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37752 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53390 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36800 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42920 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38232 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38242 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56292 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:56298 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48514 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45444 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52654 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42064 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54644 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54656 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43346 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:43348 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37496 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50536 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59642 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35222 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48112 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48128 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48700 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:48706 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41018 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43872 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36898 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45592 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51788 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51796 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42082 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:42094 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49124 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47248 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33068 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46310 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35290 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35306 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33140 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:33152 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41534 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58400 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46208 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34872 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36554 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36570 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39282 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:39288 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57004 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55534 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49098 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45370 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54306 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54318 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55462 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:55470 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39270 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40772 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57784 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54072 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35616 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35620 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34024 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:34036 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55300 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50996 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34022 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51104 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58276 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58278 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33142 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:33156 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40364 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49186 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33380 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54174 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60550 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60556 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33416 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:33430 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41604 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59066 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48754 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53536 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38184 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38200 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58682 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:58686 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56812 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40640 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50560 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58690 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47230 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47244 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47100 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:47104 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44148 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51044 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45634 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55888 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56140 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56148 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46542 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:46558 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50918 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42684 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39286 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56174 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51304 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51314 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37910 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:37918 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40092 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37464 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53426 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45844 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41280 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41288 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46214 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:46224 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59100 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48218 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54238 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44902 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40760 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40768 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45920 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:45922 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50624 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57034 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50018 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36018 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44132 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44134 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53844 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:53850 - "GET / HTTP/1.0" 200 OK 2026-03-15 11:04:17,094 - lava_callback - INFO - Received callback for node 69b3ef1f1727ff69d6f22b8a INFO: 172.21.0.1:53858 - "POST /node/69b3ef1f1727ff69d6f22b8a HTTP/1.0" 202 Accepted 2026-03-15 11:04:17,100 - lava_callback - INFO - Starting async job submit for node 69b3ef1f1727ff69d6f22b8a 2026-03-15 11:04:17,101 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 11:04:17,115 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b3ef1f1727ff69d6f22b8a HTTP/1.1" 200 None 2026-03-15 11:04:17,116 - lava_callback - DEBUG - Processing node 69b3ef1f1727ff69d6f22b8a: baseline-arm64-baylibre 2026-03-15 11:04:17,116 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b3ef1f1727ff69d6f22b8a 2026-03-15 11:04:17,117 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 11:04:17,148 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b3ef1f1727ff69d6f22b8a HTTP/1.1" 200 None 2026-03-15 11:04:17,149 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 11:04:17,191 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b2e73e6267e2e450f02132 HTTP/1.1" 200 None 2026-03-15 11:04:17,192 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 11:04:17,246 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b3ef1f1727ff69d6f22b8a HTTP/1.1" 200 None 2026-03-15 11:04:17,247 - lava_callback - ERROR - Error processing callback for node 69b3ef1f1727ff69d6f22b8a: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:35280 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48126 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47638 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55728 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51134 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51150 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44232 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:44242 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47730 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34234 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50156 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53382 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37018 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37032 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56128 - "GET /api/metrics HTTP/1.0" 200 OK 2026-03-15 11:06:16,118 - lava_callback - INFO - Received callback for node 69b3ef9c1727ff69d6f22b96 INFO: 172.21.0.1:56144 - "POST /node/69b3ef9c1727ff69d6f22b96 HTTP/1.0" 202 Accepted 2026-03-15 11:06:16,124 - lava_callback - INFO - Starting async job submit for node 69b3ef9c1727ff69d6f22b96 2026-03-15 11:06:16,125 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 11:06:16,140 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b3ef9c1727ff69d6f22b96 HTTP/1.1" 200 None 2026-03-15 11:06:16,141 - lava_callback - DEBUG - Processing node 69b3ef9c1727ff69d6f22b96: baseline-arm64-clabbe 2026-03-15 11:06:16,141 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b3ef9c1727ff69d6f22b96 2026-03-15 11:06:16,142 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 11:06:16,154 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b3ef9c1727ff69d6f22b96 HTTP/1.1" 200 None 2026-03-15 11:06:16,156 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 11:06:16,169 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b2e73e6267e2e450f02132 HTTP/1.1" 200 None 2026-03-15 11:06:16,171 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 11:06:16,200 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b3ef9c1727ff69d6f22b96 HTTP/1.1" 200 None 2026-03-15 11:06:16,201 - lava_callback - ERROR - Error processing callback for node 69b3ef9c1727ff69d6f22b96: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:56154 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60992 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38876 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50632 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50254 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33220 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33236 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55094 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:55110 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50752 - "GET / HTTP/1.0" 200 OK 2026-03-15 11:07:36,150 - lava_callback - INFO - Received callback for node 69b3efee1727ff69d6f22b9e INFO: 172.21.0.1:40014 - "POST /node/69b3efee1727ff69d6f22b9e HTTP/1.0" 202 Accepted 2026-03-15 11:07:36,156 - lava_callback - INFO - Starting async job submit for node 69b3efee1727ff69d6f22b9e 2026-03-15 11:07:36,157 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 11:07:36,172 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b3efee1727ff69d6f22b9e HTTP/1.1" 200 None 2026-03-15 11:07:36,173 - lava_callback - DEBUG - Processing node 69b3efee1727ff69d6f22b9e: baseline-arm64-clabbe 2026-03-15 11:07:36,173 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b3efee1727ff69d6f22b9e 2026-03-15 11:07:36,173 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 11:07:36,187 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b3efee1727ff69d6f22b9e HTTP/1.1" 200 None 2026-03-15 11:07:36,188 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 11:07:36,223 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b2e73e6267e2e450f02132 HTTP/1.1" 200 None 2026-03-15 11:07:36,225 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 11:07:36,245 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b3efee1727ff69d6f22b9e HTTP/1.1" 200 None 2026-03-15 11:07:36,250 - lava_callback - ERROR - Error processing callback for node 69b3efee1727ff69d6f22b9e: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:40024 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39280 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36702 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50164 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50172 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45956 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:45958 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58792 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35074 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42484 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35724 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33020 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33036 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44862 - "GET /api/metrics HTTP/1.0" 200 OK 2026-03-15 11:09:16,486 - lava_callback - INFO - Received callback for node 69b3f0501727ff69d6f22bac INFO: 172.21.0.1:44870 - "POST /node/69b3f0501727ff69d6f22bac HTTP/1.0" 202 Accepted 2026-03-15 11:09:16,492 - lava_callback - INFO - Starting async job submit for node 69b3f0501727ff69d6f22bac 2026-03-15 11:09:16,493 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 11:09:16,507 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b3f0501727ff69d6f22bac HTTP/1.1" 200 None 2026-03-15 11:09:16,508 - lava_callback - DEBUG - Processing node 69b3f0501727ff69d6f22bac: baseline-arm64-clabbe 2026-03-15 11:09:16,509 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b3f0501727ff69d6f22bac 2026-03-15 11:09:16,509 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 INFO: 172.21.0.1:44880 - "GET / HTTP/1.0" 200 OK 2026-03-15 11:09:16,563 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b3f0501727ff69d6f22bac HTTP/1.1" 200 None 2026-03-15 11:09:16,565 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 11:09:16,586 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b2e73e6267e2e450f02132 HTTP/1.1" 200 None 2026-03-15 11:09:16,588 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 11:09:16,624 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b3f0501727ff69d6f22bac HTTP/1.1" 200 None 2026-03-15 11:09:16,626 - lava_callback - ERROR - Error processing callback for node 69b3f0501727ff69d6f22bac: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:45850 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48900 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54700 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44298 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45946 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45954 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36018 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:36022 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56296 - "GET / HTTP/1.0" 200 OK 2026-03-15 11:10:36,289 - lava_callback - INFO - Received callback for node 69b3f0a21727ff69d6f22bb4 INFO: 172.21.0.1:49368 - "POST /node/69b3f0a21727ff69d6f22bb4 HTTP/1.0" 202 Accepted 2026-03-15 11:10:36,295 - lava_callback - INFO - Starting async job submit for node 69b3f0a21727ff69d6f22bb4 2026-03-15 11:10:36,296 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 11:10:36,312 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b3f0a21727ff69d6f22bb4 HTTP/1.1" 200 None 2026-03-15 11:10:36,313 - lava_callback - DEBUG - Processing node 69b3f0a21727ff69d6f22bb4: baseline-arm64-clabbe 2026-03-15 11:10:36,313 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b3f0a21727ff69d6f22bb4 2026-03-15 11:10:36,314 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 11:10:36,334 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b3f0a21727ff69d6f22bb4 HTTP/1.1" 200 None 2026-03-15 11:10:36,336 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 11:10:36,350 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b2e73e6267e2e450f02132 HTTP/1.1" 200 None 2026-03-15 11:10:36,351 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 11:10:36,377 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b3f0a21727ff69d6f22bb4 HTTP/1.1" 200 None 2026-03-15 11:10:36,378 - lava_callback - ERROR - Error processing callback for node 69b3f0a21727ff69d6f22bb4: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:49370 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50856 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37198 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39384 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39400 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53026 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:53036 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51240 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51076 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55362 - "GET / HTTP/1.0" 200 OK 2026-03-15 11:11:56,342 - lava_callback - INFO - Received callback for node 69b3f0f41727ff69d6f22bc0 INFO: 172.21.0.1:37908 - "POST /node/69b3f0f41727ff69d6f22bc0 HTTP/1.0" 202 Accepted 2026-03-15 11:11:56,347 - lava_callback - INFO - Starting async job submit for node 69b3f0f41727ff69d6f22bc0 2026-03-15 11:11:56,348 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 11:11:56,367 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b3f0f41727ff69d6f22bc0 HTTP/1.1" 200 None 2026-03-15 11:11:56,368 - lava_callback - DEBUG - Processing node 69b3f0f41727ff69d6f22bc0: baseline-arm64-clabbe 2026-03-15 11:11:56,368 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b3f0f41727ff69d6f22bc0 2026-03-15 11:11:56,369 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 11:11:56,395 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b3f0f41727ff69d6f22bc0 HTTP/1.1" 200 None 2026-03-15 11:11:56,397 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 11:11:56,410 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b2e73e6267e2e450f02132 HTTP/1.1" 200 None 2026-03-15 11:11:56,412 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 11:11:56,454 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b3f0f41727ff69d6f22bc0 HTTP/1.1" 200 None 2026-03-15 11:11:56,455 - lava_callback - ERROR - Error processing callback for node 69b3f0f41727ff69d6f22bc0: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:37924 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60482 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60494 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35316 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:35330 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55346 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55362 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34878 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34658 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37940 - "GET /favicon.ico HTTP/1.0" 404 Not Found INFO: 172.21.0.1:37950 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34110 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34124 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40748 - "GET /api/metrics HTTP/1.0" 200 OK 2026-03-15 11:13:16,388 - lava_callback - INFO - Received callback for node 69b3f1461727ff69d6f22bce INFO: 172.21.0.1:40758 - "POST /node/69b3f1461727ff69d6f22bce HTTP/1.0" 202 Accepted 2026-03-15 11:13:16,393 - lava_callback - INFO - Starting async job submit for node 69b3f1461727ff69d6f22bce 2026-03-15 11:13:16,394 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 11:13:16,426 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b3f1461727ff69d6f22bce HTTP/1.1" 200 None 2026-03-15 11:13:16,427 - lava_callback - DEBUG - Processing node 69b3f1461727ff69d6f22bce: baseline-arm64-clabbe 2026-03-15 11:13:16,427 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b3f1461727ff69d6f22bce 2026-03-15 11:13:16,428 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 11:13:16,450 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b3f1461727ff69d6f22bce HTTP/1.1" 200 None 2026-03-15 11:13:16,452 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 11:13:16,466 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b2e73e6267e2e450f02132 HTTP/1.1" 200 None 2026-03-15 11:13:16,467 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 11:13:16,513 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b3f1461727ff69d6f22bce HTTP/1.1" 200 None 2026-03-15 11:13:16,521 - lava_callback - ERROR - Error processing callback for node 69b3f1461727ff69d6f22bce: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:40760 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56814 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54220 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55464 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40890 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47738 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47744 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51444 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:51456 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48448 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39364 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54954 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39880 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56202 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56218 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57306 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:57320 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41008 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37854 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58244 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39610 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38016 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38028 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55384 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:55392 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41352 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33598 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53156 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43096 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52448 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52456 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60924 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:60932 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60142 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34140 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35290 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55960 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38202 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38208 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40960 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:40970 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35898 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49628 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39290 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43998 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46124 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46132 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37232 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:37234 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43408 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44406 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55194 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47542 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33288 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33298 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53292 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:53302 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35092 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34300 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39550 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52322 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46434 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46440 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57448 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:57460 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56832 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44358 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45190 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37782 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41476 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41482 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40324 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:40330 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50938 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36334 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52450 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34758 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51658 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51674 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54208 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:54218 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57324 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56306 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34158 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46218 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57118 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57124 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55024 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:55034 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56178 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53602 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42160 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51530 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60864 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60868 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59536 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:59546 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47062 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39494 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36096 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50478 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46860 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46862 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59614 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:59620 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38664 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41234 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48172 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44354 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36590 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36592 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35644 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:35646 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33836 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38440 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43014 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59778 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59982 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59996 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53214 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:53228 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33100 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43090 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41686 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36964 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39786 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39796 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42156 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:42168 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56834 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51450 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33052 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34812 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35498 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35504 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60032 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:60038 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44100 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55478 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52622 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37874 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:32902 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:32908 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33588 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:33600 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41108 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50236 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55298 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35686 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53276 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53288 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54328 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:54344 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33910 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37112 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51060 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40446 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53366 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53368 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55736 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:55738 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57116 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49692 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45314 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50986 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39254 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39264 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48416 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:48418 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33660 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47838 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47488 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52446 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57498 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57502 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53978 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:53994 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53834 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56482 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49148 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48126 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57552 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57558 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57770 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:57776 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41678 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57902 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49962 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49430 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48976 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48990 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45636 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:45650 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39330 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38050 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57126 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42680 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33878 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33890 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46634 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:46636 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43606 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52428 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36398 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39096 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42864 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42868 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42916 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:42930 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40820 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48488 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39866 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57850 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52620 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52626 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50426 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:50434 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47822 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56180 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44154 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49260 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58396 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58400 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40808 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:40822 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60934 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43856 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56922 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35880 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55354 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55364 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33538 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:33554 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48102 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39692 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39332 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33256 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59248 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59250 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45724 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:45740 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45316 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46644 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38806 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47044 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37346 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37352 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47074 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:47080 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48210 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46688 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34644 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38558 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39962 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39974 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35606 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:35614 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41060 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40146 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41894 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48242 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37270 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37272 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37990 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:38000 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57028 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38822 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47262 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53578 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56994 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57002 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34826 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:34840 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47940 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37130 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56866 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37194 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58960 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58966 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38230 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:38232 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58196 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53948 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49128 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43410 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52590 - "GET /robots.txt HTTP/1.0" 404 Not Found INFO: 172.21.0.1:52606 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52614 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52622 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50780 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:50792 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36688 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53682 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47484 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43538 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52610 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52618 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57100 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:57112 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53326 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33310 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51060 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42160 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51196 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51204 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56460 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:56466 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45988 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52288 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52614 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43482 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48720 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48722 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55278 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:55290 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58548 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51812 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39692 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58546 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38324 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38336 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59536 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:59540 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50804 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40864 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60044 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57326 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56900 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56908 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54692 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:54694 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50754 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58398 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53740 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47574 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35106 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35114 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44838 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:44848 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36496 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52732 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51354 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51116 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50546 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50558 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39900 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:39912 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50414 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44494 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50076 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54824 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53772 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53780 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56662 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:56668 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47480 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43724 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45802 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46390 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33024 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33036 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39444 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:39456 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37254 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56724 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:32940 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33774 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37684 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37692 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38852 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:38862 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46298 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55832 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45518 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60424 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55778 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55782 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56646 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:56660 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44724 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45608 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47916 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45586 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60520 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60530 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35780 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:35784 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56544 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47812 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53652 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50624 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42522 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42534 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60098 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:60102 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50926 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35556 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50468 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39862 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47216 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47228 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57246 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:57262 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35126 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33068 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33596 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48810 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37200 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37212 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48428 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:48434 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53102 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36636 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58664 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46146 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57892 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57902 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55918 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:55930 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39758 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44504 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54774 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59570 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35816 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35824 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36100 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:36116 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38180 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48078 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49534 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35158 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40790 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40792 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42082 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:42090 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50110 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53974 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44078 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56022 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36552 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36554 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50106 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:50120 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53514 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55330 - "GET / HTTP/1.0" 200 OK 2026-03-15 12:08:38,883 - lava_callback - INFO - Received callback for node 69b3fe3e1727ff69d6f22c22 INFO: 172.21.0.1:55340 - "POST /node/69b3fe3e1727ff69d6f22c22 HTTP/1.0" 202 Accepted 2026-03-15 12:08:38,888 - lava_callback - INFO - Starting async job submit for node 69b3fe3e1727ff69d6f22c22 2026-03-15 12:08:38,889 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 12:08:38,924 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b3fe3e1727ff69d6f22c22 HTTP/1.1" 200 None 2026-03-15 12:08:38,925 - lava_callback - DEBUG - Processing node 69b3fe3e1727ff69d6f22c22: baseline-arm-clabbe 2026-03-15 12:08:38,925 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b3fe3e1727ff69d6f22c22 2026-03-15 12:08:38,926 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 12:08:38,940 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b3fe3e1727ff69d6f22c22 HTTP/1.1" 200 None 2026-03-15 12:08:38,941 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 12:08:38,955 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b2e72a6267e2e450f0211d HTTP/1.1" 200 None 2026-03-15 12:08:38,957 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 12:08:38,979 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b3fe3e1727ff69d6f22c22 HTTP/1.1" 200 None 2026-03-15 12:08:38,985 - lava_callback - ERROR - Error processing callback for node 69b3fe3e1727ff69d6f22c22: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:41458 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44568 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48992 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49002 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38926 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:38942 - "GET / HTTP/1.0" 200 OK 2026-03-15 12:09:18,856 - lava_callback - INFO - Received callback for node 69b3fe631727ff69d6f22c2c INFO: 172.21.0.1:38952 - "POST /node/69b3fe631727ff69d6f22c2c HTTP/1.0" 202 Accepted 2026-03-15 12:09:18,862 - lava_callback - INFO - Starting async job submit for node 69b3fe631727ff69d6f22c2c 2026-03-15 12:09:18,863 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 12:09:18,888 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b3fe631727ff69d6f22c2c HTTP/1.1" 200 None 2026-03-15 12:09:18,888 - lava_callback - DEBUG - Processing node 69b3fe631727ff69d6f22c2c: baseline-arm-clabbe 2026-03-15 12:09:18,889 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b3fe631727ff69d6f22c2c 2026-03-15 12:09:18,889 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 12:09:18,903 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b3fe631727ff69d6f22c2c HTTP/1.1" 200 None 2026-03-15 12:09:18,904 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 12:09:18,918 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b2e72a6267e2e450f0211d HTTP/1.1" 200 None 2026-03-15 12:09:18,919 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 12:09:18,939 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b3fe631727ff69d6f22c2c HTTP/1.1" 200 None 2026-03-15 12:09:18,941 - lava_callback - ERROR - Error processing callback for node 69b3fe631727ff69d6f22c2c: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:59890 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37246 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38442 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39454 - "GET / HTTP/1.0" 200 OK 2026-03-15 12:09:58,900 - lava_callback - INFO - Received callback for node 69b3fe921727ff69d6f22c3b INFO: 172.21.0.1:39466 - "POST /node/69b3fe921727ff69d6f22c3b HTTP/1.0" 202 Accepted 2026-03-15 12:09:58,906 - lava_callback - INFO - Starting async job submit for node 69b3fe921727ff69d6f22c3b 2026-03-15 12:09:58,906 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 12:09:58,921 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b3fe921727ff69d6f22c3b HTTP/1.1" 200 None 2026-03-15 12:09:58,922 - lava_callback - DEBUG - Processing node 69b3fe921727ff69d6f22c3b: baseline-arm-clabbe 2026-03-15 12:09:58,922 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b3fe921727ff69d6f22c3b 2026-03-15 12:09:58,923 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 12:09:58,936 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b3fe921727ff69d6f22c3b HTTP/1.1" 200 None 2026-03-15 12:09:58,937 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 12:09:58,954 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b2e72a6267e2e450f0211d HTTP/1.1" 200 None 2026-03-15 12:09:58,955 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 12:09:58,978 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b3fe921727ff69d6f22c3b HTTP/1.1" 200 None 2026-03-15 12:09:58,979 - lava_callback - ERROR - Error processing callback for node 69b3fe921727ff69d6f22c3b: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:45784 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45800 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57738 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:57750 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39766 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39310 - "GET / HTTP/1.0" 200 OK 2026-03-15 12:10:38,873 - lava_callback - INFO - Received callback for node 69b3feb61727ff69d6f22c46 INFO: 172.21.0.1:39314 - "POST /node/69b3feb61727ff69d6f22c46 HTTP/1.0" 202 Accepted 2026-03-15 12:10:38,879 - lava_callback - INFO - Starting async job submit for node 69b3feb61727ff69d6f22c46 2026-03-15 12:10:38,880 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 12:10:38,901 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b3feb61727ff69d6f22c46 HTTP/1.1" 200 None 2026-03-15 12:10:38,902 - lava_callback - DEBUG - Processing node 69b3feb61727ff69d6f22c46: baseline-arm-clabbe 2026-03-15 12:10:38,903 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b3feb61727ff69d6f22c46 2026-03-15 12:10:38,903 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 12:10:38,927 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b3feb61727ff69d6f22c46 HTTP/1.1" 200 None 2026-03-15 12:10:38,928 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 12:10:38,942 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b2e72a6267e2e450f0211d HTTP/1.1" 200 None 2026-03-15 12:10:38,944 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 12:10:38,964 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b3feb61727ff69d6f22c46 HTTP/1.1" 200 None 2026-03-15 12:10:38,965 - lava_callback - ERROR - Error processing callback for node 69b3feb61727ff69d6f22c46: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:59546 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37836 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40358 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40364 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54968 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:54972 - "GET / HTTP/1.0" 200 OK 2026-03-15 12:11:18,952 - lava_callback - INFO - Received callback for node 69b3fedc1727ff69d6f22c50 INFO: 172.21.0.1:54978 - "POST /node/69b3fedc1727ff69d6f22c50 HTTP/1.0" 202 Accepted 2026-03-15 12:11:18,958 - lava_callback - INFO - Starting async job submit for node 69b3fedc1727ff69d6f22c50 2026-03-15 12:11:18,958 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 12:11:19,004 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b3fedc1727ff69d6f22c50 HTTP/1.1" 200 None 2026-03-15 12:11:19,005 - lava_callback - DEBUG - Processing node 69b3fedc1727ff69d6f22c50: baseline-arm-clabbe 2026-03-15 12:11:19,005 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b3fedc1727ff69d6f22c50 2026-03-15 12:11:19,006 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 12:11:19,019 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b3fedc1727ff69d6f22c50 HTTP/1.1" 200 None 2026-03-15 12:11:19,021 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 12:11:19,060 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b2e72a6267e2e450f0211d HTTP/1.1" 200 None 2026-03-15 12:11:19,062 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 12:11:19,083 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b3fedc1727ff69d6f22c50 HTTP/1.1" 200 None 2026-03-15 12:11:19,084 - lava_callback - ERROR - Error processing callback for node 69b3fedc1727ff69d6f22c50: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:52708 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60840 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48112 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45950 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54412 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54428 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44306 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:44316 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45006 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51442 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36868 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60474 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52942 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52952 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53850 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:53862 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51756 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43986 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51714 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36880 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47472 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47482 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59002 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:59004 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44060 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43576 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49524 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44308 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41460 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41474 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40552 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:40558 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51850 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39388 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34108 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40582 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36704 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36718 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42292 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:42300 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42450 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59014 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47688 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60718 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41770 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41776 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:32972 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:32974 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36328 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39864 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35230 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48858 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35398 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35402 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52510 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:52514 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39438 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57866 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51872 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48864 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34600 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34608 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44184 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:44198 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56568 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52656 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38132 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40614 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53212 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53228 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42726 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:42740 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52244 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55692 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60688 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45006 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33354 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33362 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51876 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:51878 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55840 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53754 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38658 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42358 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40288 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40292 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57356 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:57358 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46586 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59838 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40228 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41266 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55424 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55440 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51350 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:51364 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39086 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52782 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51640 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36850 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37860 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37862 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42416 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:42426 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35854 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44022 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54638 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46690 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34804 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34816 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59162 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:59166 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34204 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42900 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54484 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55136 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54372 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54382 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48360 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:48362 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43330 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39232 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45432 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57026 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45126 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45140 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47394 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:47406 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42890 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44446 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59794 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49456 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38172 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38186 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59538 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:59552 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58762 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39294 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34834 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55652 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47418 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47432 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50624 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:50632 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49410 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58432 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59498 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48322 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36478 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36494 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46206 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:46222 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48522 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46196 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57272 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56438 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58038 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58042 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58714 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:58730 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54892 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33960 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45108 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59184 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53026 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53038 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45172 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:45188 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56880 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47708 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43170 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55496 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49846 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49856 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47962 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:47966 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42122 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42494 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39248 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59618 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39622 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39634 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56538 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:56548 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58806 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36448 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42442 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34796 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43344 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43350 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57466 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:57468 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54310 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37026 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56568 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54326 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57306 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57320 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45220 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:45226 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60306 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58630 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34132 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47406 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33754 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33760 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41800 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:41806 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37850 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46772 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52958 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34988 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38524 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38540 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39014 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:39024 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41222 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34424 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50526 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39416 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47498 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47514 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34434 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:34442 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54796 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34540 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49740 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53378 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53700 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53702 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44152 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:44158 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48960 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40610 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35422 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40772 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57252 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57262 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42454 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:42464 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34484 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50194 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35392 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58800 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58524 - "GET / HTTP/1.0" 200 OK 2026-03-15 12:42:02,831 - lava_callback - INFO - Received callback for node 69b406101727ff69d6f22c5c INFO: 172.21.0.1:58538 - "POST /node/69b406101727ff69d6f22c5c HTTP/1.0" 202 Accepted 2026-03-15 12:42:02,836 - lava_callback - INFO - Starting async job submit for node 69b406101727ff69d6f22c5c 2026-03-15 12:42:02,837 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 12:42:02,872 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b406101727ff69d6f22c5c HTTP/1.1" 200 None 2026-03-15 12:42:02,873 - lava_callback - DEBUG - Processing node 69b406101727ff69d6f22c5c: baseline-arm-baylibre 2026-03-15 12:42:02,873 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b406101727ff69d6f22c5c 2026-03-15 12:42:02,874 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 12:42:02,915 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b406101727ff69d6f22c5c HTTP/1.1" 200 None 2026-03-15 12:42:02,917 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 12:42:02,947 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b0b4fc9d19175818251fd6 HTTP/1.1" 200 None 2026-03-15 12:42:02,948 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 12:42:02,968 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b406101727ff69d6f22c5c HTTP/1.1" 200 None 2026-03-15 12:42:02,970 - lava_callback - ERROR - Error processing callback for node 69b406101727ff69d6f22c5c: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:58548 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35418 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:35420 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46298 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59416 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33030 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41132 - "GET / HTTP/1.0" 200 OK 2026-03-15 12:43:02,547 - lava_callback - INFO - Received callback for node 69b406481727ff69d6f22c67 INFO: 172.21.0.1:59476 - "POST /node/69b406481727ff69d6f22c67 HTTP/1.0" 202 Accepted 2026-03-15 12:43:02,552 - lava_callback - INFO - Starting async job submit for node 69b406481727ff69d6f22c67 2026-03-15 12:43:02,553 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 12:43:02,568 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b406481727ff69d6f22c67 HTTP/1.1" 200 None 2026-03-15 12:43:02,568 - lava_callback - DEBUG - Processing node 69b406481727ff69d6f22c67: baseline-arm-baylibre 2026-03-15 12:43:02,569 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b406481727ff69d6f22c67 2026-03-15 12:43:02,569 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 12:43:02,584 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b406481727ff69d6f22c67 HTTP/1.1" 200 None 2026-03-15 12:43:02,586 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 12:43:02,603 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b0b4fc9d19175818251fd6 HTTP/1.1" 200 None 2026-03-15 12:43:02,604 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 INFO: 172.21.0.1:59482 - "GET / HTTP/1.0" 200 OK 2026-03-15 12:43:02,626 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b406481727ff69d6f22c67 HTTP/1.1" 200 None 2026-03-15 12:43:02,627 - lava_callback - ERROR - Error processing callback for node 69b406481727ff69d6f22c67: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:59490 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38292 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:38296 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52300 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45612 - "GET / HTTP/1.0" 200 OK 2026-03-15 12:43:40,263 - lava_callback - INFO - Received callback for node 69b406711727ff69d6f22c79 INFO: 172.21.0.1:58428 - "POST /node/69b406711727ff69d6f22c79 HTTP/1.0" 202 Accepted 2026-03-15 12:43:40,269 - lava_callback - INFO - Starting async job submit for node 69b406711727ff69d6f22c79 2026-03-15 12:43:40,270 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 12:43:40,284 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b406711727ff69d6f22c79 HTTP/1.1" 200 None 2026-03-15 12:43:40,284 - lava_callback - DEBUG - Processing node 69b406711727ff69d6f22c79: baseline-arm-clabbe 2026-03-15 12:43:40,285 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b406711727ff69d6f22c79 2026-03-15 12:43:40,285 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 12:43:40,308 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b406711727ff69d6f22c79 HTTP/1.1" 200 None 2026-03-15 12:43:40,310 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 12:43:40,326 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b0b4fc9d19175818251fd6 HTTP/1.1" 200 None 2026-03-15 12:43:40,327 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 12:43:40,347 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b406711727ff69d6f22c79 HTTP/1.1" 200 None 2026-03-15 12:43:40,349 - lava_callback - ERROR - Error processing callback for node 69b406711727ff69d6f22c79: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:58432 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60768 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39032 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39034 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55122 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:55130 - "GET / HTTP/1.0" 200 OK 2026-03-15 12:44:20,236 - lava_callback - INFO - Received callback for node 69b406961727ff69d6f22c87 INFO: 172.21.0.1:38194 - "POST /node/69b406961727ff69d6f22c87 HTTP/1.0" 202 Accepted 2026-03-15 12:44:20,242 - lava_callback - INFO - Starting async job submit for node 69b406961727ff69d6f22c87 2026-03-15 12:44:20,243 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 12:44:20,258 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b406961727ff69d6f22c87 HTTP/1.1" 200 None 2026-03-15 12:44:20,258 - lava_callback - DEBUG - Processing node 69b406961727ff69d6f22c87: baseline-arm-clabbe 2026-03-15 12:44:20,259 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b406961727ff69d6f22c87 2026-03-15 12:44:20,259 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 12:44:20,273 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b406961727ff69d6f22c87 HTTP/1.1" 200 None 2026-03-15 12:44:20,274 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 12:44:20,308 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b0b4fc9d19175818251fd6 HTTP/1.1" 200 None 2026-03-15 12:44:20,310 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 12:44:20,331 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b406961727ff69d6f22c87 HTTP/1.1" 200 None 2026-03-15 12:44:20,332 - lava_callback - ERROR - Error processing callback for node 69b406961727ff69d6f22c87: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:38206 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44286 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55538 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56370 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36232 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36242 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38318 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:38328 - "GET / HTTP/1.0" 200 OK 2026-03-15 12:45:20,299 - lava_callback - INFO - Received callback for node 69b406dd1727ff69d6f22c9b INFO: 172.21.0.1:54434 - "POST /node/69b406dd1727ff69d6f22c9b HTTP/1.0" 202 Accepted 2026-03-15 12:45:20,308 - lava_callback - INFO - Starting async job submit for node 69b406dd1727ff69d6f22c9b 2026-03-15 12:45:20,309 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 12:45:20,324 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b406dd1727ff69d6f22c9b HTTP/1.1" 200 None 2026-03-15 12:45:20,325 - lava_callback - DEBUG - Processing node 69b406dd1727ff69d6f22c9b: baseline-arm-clabbe 2026-03-15 12:45:20,325 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b406dd1727ff69d6f22c9b 2026-03-15 12:45:20,325 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 12:45:20,372 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b406dd1727ff69d6f22c9b HTTP/1.1" 200 None 2026-03-15 12:45:20,374 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 12:45:20,387 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b0b4fc9d19175818251fd6 HTTP/1.1" 200 None 2026-03-15 12:45:20,389 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 12:45:20,409 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b406dd1727ff69d6f22c9b HTTP/1.1" 200 None 2026-03-15 12:45:20,410 - lava_callback - ERROR - Error processing callback for node 69b406dd1727ff69d6f22c9b: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:54436 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34094 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60492 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50716 - "GET / HTTP/1.0" 200 OK 2026-03-15 12:46:00,289 - lava_callback - INFO - Received callback for node 69b407031727ff69d6f22cad INFO: 172.21.0.1:56666 - "POST /node/69b407031727ff69d6f22cad HTTP/1.0" 202 Accepted 2026-03-15 12:46:00,295 - lava_callback - INFO - Starting async job submit for node 69b407031727ff69d6f22cad 2026-03-15 12:46:00,296 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 12:46:00,312 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b407031727ff69d6f22cad HTTP/1.1" 200 None 2026-03-15 12:46:00,313 - lava_callback - DEBUG - Processing node 69b407031727ff69d6f22cad: baseline-arm-clabbe 2026-03-15 12:46:00,313 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b407031727ff69d6f22cad 2026-03-15 12:46:00,314 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 12:46:00,336 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b407031727ff69d6f22cad HTTP/1.1" 200 None 2026-03-15 12:46:00,338 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 12:46:00,352 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b0b4fc9d19175818251fd6 HTTP/1.1" 200 None 2026-03-15 12:46:00,354 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 12:46:00,375 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b407031727ff69d6f22cad HTTP/1.1" 200 None 2026-03-15 12:46:00,382 - lava_callback - ERROR - Error processing callback for node 69b407031727ff69d6f22cad: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:56668 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56682 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41094 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:41100 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58820 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58176 - "GET / HTTP/1.0" 200 OK 2026-03-15 12:46:40,349 - lava_callback - INFO - Received callback for node 69b407281727ff69d6f22cbc INFO: 172.21.0.1:43996 - "POST /node/69b407281727ff69d6f22cbc HTTP/1.0" 202 Accepted 2026-03-15 12:46:40,359 - lava_callback - INFO - Starting async job submit for node 69b407281727ff69d6f22cbc 2026-03-15 12:46:40,360 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 12:46:40,406 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b407281727ff69d6f22cbc HTTP/1.1" 200 None 2026-03-15 12:46:40,408 - lava_callback - DEBUG - Processing node 69b407281727ff69d6f22cbc: baseline-arm-clabbe 2026-03-15 12:46:40,408 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b407281727ff69d6f22cbc 2026-03-15 12:46:40,409 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 12:46:40,452 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b407281727ff69d6f22cbc HTTP/1.1" 200 None 2026-03-15 12:46:40,456 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 12:46:40,480 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b0b4fc9d19175818251fd6 HTTP/1.1" 200 None 2026-03-15 12:46:40,482 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 12:46:40,513 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b407281727ff69d6f22cbc HTTP/1.1" 200 None 2026-03-15 12:46:40,514 - lava_callback - ERROR - Error processing callback for node 69b407281727ff69d6f22cbc: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:44002 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35306 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56034 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56042 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43560 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:43572 - "GET / HTTP/1.0" 200 OK 2026-03-15 12:47:20,376 - lava_callback - INFO - Received callback for node 69b4074c1727ff69d6f22ccb INFO: 172.21.0.1:53772 - "POST /node/69b4074c1727ff69d6f22ccb HTTP/1.0" 202 Accepted 2026-03-15 12:47:20,381 - lava_callback - INFO - Starting async job submit for node 69b4074c1727ff69d6f22ccb 2026-03-15 12:47:20,382 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 12:47:20,435 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b4074c1727ff69d6f22ccb HTTP/1.1" 200 None 2026-03-15 12:47:20,436 - lava_callback - DEBUG - Processing node 69b4074c1727ff69d6f22ccb: baseline-arm-clabbe 2026-03-15 12:47:20,436 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b4074c1727ff69d6f22ccb 2026-03-15 12:47:20,437 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 12:47:20,476 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b4074c1727ff69d6f22ccb HTTP/1.1" 200 None 2026-03-15 12:47:20,477 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 12:47:20,491 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b0b4fc9d19175818251fd6 HTTP/1.1" 200 None 2026-03-15 12:47:20,492 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 12:47:20,513 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b4074c1727ff69d6f22ccb HTTP/1.1" 200 None 2026-03-15 12:47:20,514 - lava_callback - ERROR - Error processing callback for node 69b4074c1727ff69d6f22ccb: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:53784 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56598 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49478 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33750 - "GET / HTTP/1.0" 200 OK 2026-03-15 12:48:00,396 - lava_callback - INFO - Received callback for node 69b407711727ff69d6f22cd7 INFO: 172.21.0.1:37972 - "POST /node/69b407711727ff69d6f22cd7 HTTP/1.0" 202 Accepted 2026-03-15 12:48:00,402 - lava_callback - INFO - Starting async job submit for node 69b407711727ff69d6f22cd7 2026-03-15 12:48:00,403 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 12:48:00,457 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b407711727ff69d6f22cd7 HTTP/1.1" 200 None 2026-03-15 12:48:00,458 - lava_callback - DEBUG - Processing node 69b407711727ff69d6f22cd7: baseline-arm-clabbe 2026-03-15 12:48:00,458 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b407711727ff69d6f22cd7 2026-03-15 12:48:00,459 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 12:48:00,494 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b407711727ff69d6f22cd7 HTTP/1.1" 200 None 2026-03-15 12:48:00,495 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 12:48:00,510 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b0b4fc9d19175818251fd6 HTTP/1.1" 200 None 2026-03-15 12:48:00,511 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 12:48:00,532 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b407711727ff69d6f22cd7 HTTP/1.1" 200 None 2026-03-15 12:48:00,533 - lava_callback - ERROR - Error processing callback for node 69b407711727ff69d6f22cd7: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:37980 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37992 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48418 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:48426 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37990 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55618 - "GET / HTTP/1.0" 200 OK 2026-03-15 12:48:40,393 - lava_callback - INFO - Received callback for node 69b407961727ff69d6f22ce5 INFO: 172.21.0.1:46622 - "POST /node/69b407961727ff69d6f22ce5 HTTP/1.0" 202 Accepted 2026-03-15 12:48:40,399 - lava_callback - INFO - Starting async job submit for node 69b407961727ff69d6f22ce5 2026-03-15 12:48:40,400 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 12:48:40,424 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b407961727ff69d6f22ce5 HTTP/1.1" 200 None 2026-03-15 12:48:40,425 - lava_callback - DEBUG - Processing node 69b407961727ff69d6f22ce5: baseline-arm-clabbe 2026-03-15 12:48:40,425 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b407961727ff69d6f22ce5 2026-03-15 12:48:40,426 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 12:48:40,446 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b407961727ff69d6f22ce5 HTTP/1.1" 200 None 2026-03-15 12:48:40,448 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 12:48:40,461 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b0b4fc9d19175818251fd6 HTTP/1.1" 200 None 2026-03-15 12:48:40,462 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 12:48:40,503 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b407961727ff69d6f22ce5 HTTP/1.1" 200 None 2026-03-15 12:48:40,505 - lava_callback - ERROR - Error processing callback for node 69b407961727ff69d6f22ce5: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:46626 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52932 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36408 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36414 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35778 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:35782 - "GET / HTTP/1.0" 200 OK 2026-03-15 12:49:20,453 - lava_callback - INFO - Received callback for node 69b407ba1727ff69d6f22cf4 INFO: 172.21.0.1:54158 - "POST /node/69b407ba1727ff69d6f22cf4 HTTP/1.0" 202 Accepted 2026-03-15 12:49:20,458 - lava_callback - INFO - Starting async job submit for node 69b407ba1727ff69d6f22cf4 2026-03-15 12:49:20,459 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 12:49:20,490 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b407ba1727ff69d6f22cf4 HTTP/1.1" 200 None 2026-03-15 12:49:20,491 - lava_callback - DEBUG - Processing node 69b407ba1727ff69d6f22cf4: baseline-arm-clabbe 2026-03-15 12:49:20,491 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b407ba1727ff69d6f22cf4 2026-03-15 12:49:20,492 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 12:49:20,505 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b407ba1727ff69d6f22cf4 HTTP/1.1" 200 None 2026-03-15 12:49:20,506 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 12:49:20,523 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b0b4fc9d19175818251fd6 HTTP/1.1" 200 None 2026-03-15 12:49:20,525 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 12:49:20,545 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b407ba1727ff69d6f22cf4 HTTP/1.1" 200 None 2026-03-15 12:49:20,546 - lava_callback - ERROR - Error processing callback for node 69b407ba1727ff69d6f22cf4: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:54172 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53560 - "GET / HTTP/1.0" 200 OK 2026-03-15 12:49:40,427 - lava_callback - INFO - Received callback for node 69b407de1727ff69d6f22d00 INFO: 172.21.0.1:55440 - "POST /node/69b407de1727ff69d6f22d00 HTTP/1.0" 202 Accepted 2026-03-15 12:49:40,432 - lava_callback - INFO - Starting async job submit for node 69b407de1727ff69d6f22d00 2026-03-15 12:49:40,433 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 12:49:40,455 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b407de1727ff69d6f22d00 HTTP/1.1" 200 None 2026-03-15 12:49:40,456 - lava_callback - DEBUG - Processing node 69b407de1727ff69d6f22d00: baseline-arm-clabbe 2026-03-15 12:49:40,456 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b407de1727ff69d6f22d00 2026-03-15 12:49:40,457 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 12:49:40,470 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b407de1727ff69d6f22d00 HTTP/1.1" 200 None 2026-03-15 12:49:40,472 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 12:49:40,485 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b0b4fc9d19175818251fd6 HTTP/1.1" 200 None 2026-03-15 12:49:40,486 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 12:49:40,517 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b407de1727ff69d6f22d00 HTTP/1.1" 200 None 2026-03-15 12:49:40,519 - lava_callback - ERROR - Error processing callback for node 69b407de1727ff69d6f22d00: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:55444 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33064 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49396 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49412 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48878 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:48880 - "GET / HTTP/1.0" 200 OK 2026-03-15 12:50:20,441 - lava_callback - INFO - Received callback for node 69b408021727ff69d6f22d0e INFO: 172.21.0.1:56894 - "POST /node/69b408021727ff69d6f22d0e HTTP/1.0" 202 Accepted 2026-03-15 12:50:20,446 - lava_callback - INFO - Starting async job submit for node 69b408021727ff69d6f22d0e 2026-03-15 12:50:20,447 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 12:50:20,464 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b408021727ff69d6f22d0e HTTP/1.1" 200 None 2026-03-15 12:50:20,465 - lava_callback - DEBUG - Processing node 69b408021727ff69d6f22d0e: baseline-arm-clabbe 2026-03-15 12:50:20,465 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b408021727ff69d6f22d0e 2026-03-15 12:50:20,466 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 12:50:20,479 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b408021727ff69d6f22d0e HTTP/1.1" 200 None 2026-03-15 12:50:20,480 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 12:50:20,493 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b0b4fc9d19175818251fd6 HTTP/1.1" 200 None 2026-03-15 12:50:20,495 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 12:50:20,515 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b408021727ff69d6f22d0e HTTP/1.1" 200 None 2026-03-15 12:50:20,516 - lava_callback - ERROR - Error processing callback for node 69b408021727ff69d6f22d0e: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:56908 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40862 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:32922 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52440 - "GET / HTTP/1.0" 200 OK 2026-03-15 12:51:00,444 - lava_callback - INFO - Received callback for node 69b408271727ff69d6f22d1a INFO: 172.21.0.1:57222 - "POST /node/69b408271727ff69d6f22d1a HTTP/1.0" 202 Accepted 2026-03-15 12:51:00,449 - lava_callback - INFO - Starting async job submit for node 69b408271727ff69d6f22d1a 2026-03-15 12:51:00,450 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 12:51:00,464 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b408271727ff69d6f22d1a HTTP/1.1" 200 None 2026-03-15 12:51:00,465 - lava_callback - DEBUG - Processing node 69b408271727ff69d6f22d1a: baseline-arm-clabbe 2026-03-15 12:51:00,465 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b408271727ff69d6f22d1a 2026-03-15 12:51:00,466 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 12:51:00,505 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b408271727ff69d6f22d1a HTTP/1.1" 200 None 2026-03-15 12:51:00,507 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 12:51:00,520 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b0b4fc9d19175818251fd6 HTTP/1.1" 200 None 2026-03-15 12:51:00,521 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 12:51:00,545 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b408271727ff69d6f22d1a HTTP/1.1" 200 None 2026-03-15 12:51:00,547 - lava_callback - ERROR - Error processing callback for node 69b408271727ff69d6f22d1a: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:57232 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57244 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51554 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:51566 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35200 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54092 - "GET / HTTP/1.0" 200 OK 2026-03-15 12:51:40,505 - lava_callback - INFO - Received callback for node 69b4084c1727ff69d6f22d28 INFO: 172.21.0.1:36528 - "POST /node/69b4084c1727ff69d6f22d28 HTTP/1.0" 202 Accepted 2026-03-15 12:51:40,511 - lava_callback - INFO - Starting async job submit for node 69b4084c1727ff69d6f22d28 2026-03-15 12:51:40,512 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 12:51:40,529 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b4084c1727ff69d6f22d28 HTTP/1.1" 200 None 2026-03-15 12:51:40,530 - lava_callback - DEBUG - Processing node 69b4084c1727ff69d6f22d28: baseline-arm-clabbe 2026-03-15 12:51:40,530 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b4084c1727ff69d6f22d28 2026-03-15 12:51:40,531 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 12:51:40,552 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b4084c1727ff69d6f22d28 HTTP/1.1" 200 None 2026-03-15 12:51:40,554 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 12:51:40,576 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b0b4fc9d19175818251fd6 HTTP/1.1" 200 None 2026-03-15 12:51:40,578 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 12:51:40,606 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b4084c1727ff69d6f22d28 HTTP/1.1" 200 None 2026-03-15 12:51:40,609 - lava_callback - ERROR - Error processing callback for node 69b4084c1727ff69d6f22d28: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:36536 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34692 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37408 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37410 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59960 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:59970 - "GET / HTTP/1.0" 200 OK 2026-03-15 12:52:20,527 - lava_callback - INFO - Received callback for node 69b408701727ff69d6f22d3a INFO: 172.21.0.1:38054 - "POST /node/69b408701727ff69d6f22d3a HTTP/1.0" 202 Accepted 2026-03-15 12:52:20,533 - lava_callback - INFO - Starting async job submit for node 69b408701727ff69d6f22d3a 2026-03-15 12:52:20,534 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 12:52:20,548 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b408701727ff69d6f22d3a HTTP/1.1" 200 None 2026-03-15 12:52:20,549 - lava_callback - DEBUG - Processing node 69b408701727ff69d6f22d3a: baseline-arm-clabbe 2026-03-15 12:52:20,549 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b408701727ff69d6f22d3a 2026-03-15 12:52:20,550 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 12:52:20,563 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b408701727ff69d6f22d3a HTTP/1.1" 200 None 2026-03-15 12:52:20,564 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 12:52:20,578 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b0b4fc9d19175818251fd6 HTTP/1.1" 200 None 2026-03-15 12:52:20,579 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 12:52:20,601 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b408701727ff69d6f22d3a HTTP/1.1" 200 None 2026-03-15 12:52:20,611 - lava_callback - ERROR - Error processing callback for node 69b408701727ff69d6f22d3a: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:38058 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54570 - "GET / HTTP/1.0" 200 OK 2026-03-15 12:52:40,572 - lava_callback - INFO - Received callback for node 69b408951727ff69d6f22d43 INFO: 172.21.0.1:47724 - "POST /node/69b408951727ff69d6f22d43 HTTP/1.0" 202 Accepted 2026-03-15 12:52:40,578 - lava_callback - INFO - Starting async job submit for node 69b408951727ff69d6f22d43 2026-03-15 12:52:40,579 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 12:52:40,594 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b408951727ff69d6f22d43 HTTP/1.1" 200 None 2026-03-15 12:52:40,595 - lava_callback - DEBUG - Processing node 69b408951727ff69d6f22d43: baseline-arm-clabbe 2026-03-15 12:52:40,595 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b408951727ff69d6f22d43 2026-03-15 12:52:40,596 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 12:52:40,611 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b408951727ff69d6f22d43 HTTP/1.1" 200 None 2026-03-15 12:52:40,612 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 12:52:40,625 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b0b4fc9d19175818251fd6 HTTP/1.1" 200 None 2026-03-15 12:52:40,627 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 12:52:40,647 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b408951727ff69d6f22d43 HTTP/1.1" 200 None 2026-03-15 12:52:40,652 - lava_callback - ERROR - Error processing callback for node 69b408951727ff69d6f22d43: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:47730 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58844 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45614 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45618 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34160 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:34172 - "GET / HTTP/1.0" 200 OK 2026-03-15 12:53:23,196 - lava_callback - INFO - Received callback for node 69b408b41727ff69d6f22d52 INFO: 172.21.0.1:44380 - "POST /node/69b408b41727ff69d6f22d52 HTTP/1.0" 202 Accepted 2026-03-15 12:53:23,201 - lava_callback - INFO - Starting async job submit for node 69b408b41727ff69d6f22d52 2026-03-15 12:53:23,202 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 12:53:23,216 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b408b41727ff69d6f22d52 HTTP/1.1" 200 None 2026-03-15 12:53:23,217 - lava_callback - DEBUG - Processing node 69b408b41727ff69d6f22d52: baseline-arm-baylibre 2026-03-15 12:53:23,217 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b408b41727ff69d6f22d52 2026-03-15 12:53:23,218 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 12:53:23,236 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b408b41727ff69d6f22d52 HTTP/1.1" 200 None 2026-03-15 12:53:23,238 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 12:53:23,250 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aeba33feb96b28aa34a775 HTTP/1.1" 200 None 2026-03-15 12:53:23,252 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 12:53:23,272 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b408b41727ff69d6f22d52 HTTP/1.1" 200 None 2026-03-15 12:53:23,274 - lava_callback - ERROR - Error processing callback for node 69b408b41727ff69d6f22d52: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:44388 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43202 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54270 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42160 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39568 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39584 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43530 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:43538 - "GET / HTTP/1.0" 200 OK 2026-03-15 12:54:23,150 - lava_callback - INFO - Received callback for node 69b408fc1727ff69d6f22d6c INFO: 172.21.0.1:41420 - "POST /node/69b408fc1727ff69d6f22d6c HTTP/1.0" 202 Accepted 2026-03-15 12:54:23,155 - lava_callback - INFO - Starting async job submit for node 69b408fc1727ff69d6f22d6c 2026-03-15 12:54:23,156 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 12:54:23,171 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b408fc1727ff69d6f22d6c HTTP/1.1" 200 None 2026-03-15 12:54:23,172 - lava_callback - DEBUG - Processing node 69b408fc1727ff69d6f22d6c: baseline-arm-baylibre 2026-03-15 12:54:23,172 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b408fc1727ff69d6f22d6c 2026-03-15 12:54:23,173 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 12:54:23,188 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b408fc1727ff69d6f22d6c HTTP/1.1" 200 None 2026-03-15 12:54:23,190 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 12:54:23,204 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aeba33feb96b28aa34a775 HTTP/1.1" 200 None 2026-03-15 12:54:23,206 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 12:54:23,228 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b408fc1727ff69d6f22d6c HTTP/1.1" 200 None 2026-03-15 12:54:23,229 - lava_callback - ERROR - Error processing callback for node 69b408fc1727ff69d6f22d6c: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:41436 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45362 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43612 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52682 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43438 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43444 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50936 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:50950 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52710 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48624 - "GET / HTTP/1.0" 200 OK 2026-03-15 12:55:43,289 - lava_callback - INFO - Received callback for node 69b409431727ff69d6f22d87 INFO: 172.21.0.1:38622 - "POST /node/69b409431727ff69d6f22d87 HTTP/1.0" 202 Accepted 2026-03-15 12:55:43,295 - lava_callback - INFO - Starting async job submit for node 69b409431727ff69d6f22d87 2026-03-15 12:55:43,296 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 12:55:43,311 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b409431727ff69d6f22d87 HTTP/1.1" 200 None 2026-03-15 12:55:43,312 - lava_callback - DEBUG - Processing node 69b409431727ff69d6f22d87: baseline-arm-baylibre 2026-03-15 12:55:43,312 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b409431727ff69d6f22d87 2026-03-15 12:55:43,313 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 12:55:43,330 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b409431727ff69d6f22d87 HTTP/1.1" 200 None 2026-03-15 12:55:43,332 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 12:55:43,347 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aeba33feb96b28aa34a775 HTTP/1.1" 200 None 2026-03-15 12:55:43,349 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 12:55:43,373 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b409431727ff69d6f22d87 HTTP/1.1" 200 None 2026-03-15 12:55:43,375 - lava_callback - ERROR - Error processing callback for node 69b409431727ff69d6f22d87: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:38632 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44150 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36832 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36842 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40390 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:40400 - "GET / HTTP/1.0" 200 OK 2026-03-15 12:56:23,289 - lava_callback - INFO - Received callback for node 69b409671727ff69d6f22d97 INFO: 172.21.0.1:44032 - "POST /node/69b409671727ff69d6f22d97 HTTP/1.0" 202 Accepted 2026-03-15 12:56:23,295 - lava_callback - INFO - Starting async job submit for node 69b409671727ff69d6f22d97 2026-03-15 12:56:23,296 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 12:56:23,310 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b409671727ff69d6f22d97 HTTP/1.1" 200 None 2026-03-15 12:56:23,311 - lava_callback - DEBUG - Processing node 69b409671727ff69d6f22d97: baseline-arm-baylibre 2026-03-15 12:56:23,312 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b409671727ff69d6f22d97 2026-03-15 12:56:23,312 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 12:56:23,333 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b409671727ff69d6f22d97 HTTP/1.1" 200 None 2026-03-15 12:56:23,334 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 12:56:23,348 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aeba33feb96b28aa34a775 HTTP/1.1" 200 None 2026-03-15 12:56:23,349 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 12:56:23,369 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b409671727ff69d6f22d97 HTTP/1.1" 200 None 2026-03-15 12:56:23,374 - lava_callback - ERROR - Error processing callback for node 69b409671727ff69d6f22d97: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:44048 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38944 - "GET / HTTP/1.0" 200 OK 2026-03-15 12:56:43,287 - lava_callback - INFO - Received callback for node 69b409881727ff69d6f22da0 INFO: 172.21.0.1:52744 - "POST /node/69b409881727ff69d6f22da0 HTTP/1.0" 202 Accepted 2026-03-15 12:56:43,293 - lava_callback - INFO - Starting async job submit for node 69b409881727ff69d6f22da0 2026-03-15 12:56:43,294 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 12:56:43,318 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b409881727ff69d6f22da0 HTTP/1.1" 200 None 2026-03-15 12:56:43,318 - lava_callback - DEBUG - Processing node 69b409881727ff69d6f22da0: baseline-arm-baylibre 2026-03-15 12:56:43,319 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b409881727ff69d6f22da0 2026-03-15 12:56:43,319 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 12:56:43,333 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b409881727ff69d6f22da0 HTTP/1.1" 200 None 2026-03-15 12:56:43,334 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 12:56:43,354 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b35934974c91e64560e49d HTTP/1.1" 200 None 2026-03-15 12:56:43,355 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 12:56:43,383 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b409881727ff69d6f22da0 HTTP/1.1" 200 None 2026-03-15 12:56:43,385 - lava_callback - ERROR - Error processing callback for node 69b409881727ff69d6f22da0: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:52758 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43070 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42740 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42744 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49054 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:49060 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46958 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58504 - "GET / HTTP/1.0" 200 OK 2026-03-15 12:57:40,738 - lava_callback - INFO - Received callback for node 69b409b21727ff69d6f22daf INFO: 172.21.0.1:54204 - "POST /node/69b409b21727ff69d6f22daf HTTP/1.0" 202 Accepted 2026-03-15 12:57:40,743 - lava_callback - INFO - Starting async job submit for node 69b409b21727ff69d6f22daf 2026-03-15 12:57:40,744 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 12:57:40,768 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b409b21727ff69d6f22daf HTTP/1.1" 200 None 2026-03-15 12:57:40,769 - lava_callback - DEBUG - Processing node 69b409b21727ff69d6f22daf: baseline-arm-clabbe 2026-03-15 12:57:40,770 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b409b21727ff69d6f22daf 2026-03-15 12:57:40,770 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 12:57:40,784 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b409b21727ff69d6f22daf HTTP/1.1" 200 None 2026-03-15 12:57:40,785 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 12:57:40,802 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aeba33feb96b28aa34a775 HTTP/1.1" 200 None 2026-03-15 12:57:40,803 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 12:57:40,824 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b409b21727ff69d6f22daf HTTP/1.1" 200 None 2026-03-15 12:57:40,826 - lava_callback - ERROR - Error processing callback for node 69b409b21727ff69d6f22daf: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:54216 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51102 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34794 - "GET / HTTP/1.0" 200 OK 2026-03-15 12:58:03,468 - lava_callback - INFO - Received callback for node 69b409d61727ff69d6f22dbb INFO: 172.21.0.1:34796 - "POST /node/69b409d61727ff69d6f22dbb HTTP/1.0" 202 Accepted 2026-03-15 12:58:03,473 - lava_callback - INFO - Starting async job submit for node 69b409d61727ff69d6f22dbb 2026-03-15 12:58:03,474 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 12:58:03,488 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b409d61727ff69d6f22dbb HTTP/1.1" 200 None 2026-03-15 12:58:03,489 - lava_callback - DEBUG - Processing node 69b409d61727ff69d6f22dbb: baseline-arm-baylibre 2026-03-15 12:58:03,490 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b409d61727ff69d6f22dbb 2026-03-15 12:58:03,490 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 12:58:03,503 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b409d61727ff69d6f22dbb HTTP/1.1" 200 None 2026-03-15 12:58:03,505 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 12:58:03,537 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aeba33feb96b28aa34a775 HTTP/1.1" 200 None 2026-03-15 12:58:03,538 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 12:58:03,567 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b409d61727ff69d6f22dbb HTTP/1.1" 200 None 2026-03-15 12:58:03,568 - lava_callback - ERROR - Error processing callback for node 69b409d61727ff69d6f22dbb: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:34798 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51794 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:51802 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35634 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53154 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55928 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44216 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38272 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38284 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38974 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:38988 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41708 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55868 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53644 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48968 - "GET / HTTP/1.0" 200 OK 2026-03-15 13:00:00,879 - lava_callback - INFO - Received callback for node 69b40a491727ff69d6f22ddf INFO: 172.21.0.1:57756 - "POST /node/69b40a491727ff69d6f22ddf HTTP/1.0" 202 Accepted 2026-03-15 13:00:00,885 - lava_callback - INFO - Starting async job submit for node 69b40a491727ff69d6f22ddf 2026-03-15 13:00:00,886 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 13:00:00,913 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b40a491727ff69d6f22ddf HTTP/1.1" 200 None 2026-03-15 13:00:00,914 - lava_callback - DEBUG - Processing node 69b40a491727ff69d6f22ddf: baseline-arm-clabbe 2026-03-15 13:00:00,914 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b40a491727ff69d6f22ddf 2026-03-15 13:00:00,915 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 13:00:00,930 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b40a491727ff69d6f22ddf HTTP/1.1" 200 None 2026-03-15 13:00:00,932 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 13:00:00,946 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b35934974c91e64560e49d HTTP/1.1" 200 None 2026-03-15 13:00:00,947 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 13:00:00,978 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b40a491727ff69d6f22ddf HTTP/1.1" 200 None 2026-03-15 13:00:00,982 - lava_callback - ERROR - Error processing callback for node 69b40a491727ff69d6f22ddf: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:57770 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57772 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42932 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:42934 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46914 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33082 - "GET / HTTP/1.0" 200 OK 2026-03-15 13:00:40,835 - lava_callback - INFO - Received callback for node 69b40a701727ff69d6f22deb INFO: 172.21.0.1:52976 - "POST /node/69b40a701727ff69d6f22deb HTTP/1.0" 202 Accepted 2026-03-15 13:00:40,840 - lava_callback - INFO - Starting async job submit for node 69b40a701727ff69d6f22deb 2026-03-15 13:00:40,841 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 13:00:40,856 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b40a701727ff69d6f22deb HTTP/1.1" 200 None 2026-03-15 13:00:40,856 - lava_callback - DEBUG - Processing node 69b40a701727ff69d6f22deb: baseline-arm-clabbe 2026-03-15 13:00:40,857 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b40a701727ff69d6f22deb 2026-03-15 13:00:40,857 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 13:00:40,871 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b40a701727ff69d6f22deb HTTP/1.1" 200 None 2026-03-15 13:00:40,873 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 13:00:40,888 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aeba33feb96b28aa34a775 HTTP/1.1" 200 None 2026-03-15 13:00:40,890 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 13:00:40,910 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b40a701727ff69d6f22deb HTTP/1.1" 200 None 2026-03-15 13:00:40,911 - lava_callback - ERROR - Error processing callback for node 69b40a701727ff69d6f22deb: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:52982 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40408 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53202 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53218 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36020 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:36024 - "GET / HTTP/1.0" 200 OK 2026-03-15 13:01:20,917 - lava_callback - INFO - Received callback for node 69b40a961727ff69d6f22df5 INFO: 172.21.0.1:32814 - "POST /node/69b40a961727ff69d6f22df5 HTTP/1.0" 202 Accepted 2026-03-15 13:01:20,922 - lava_callback - INFO - Starting async job submit for node 69b40a961727ff69d6f22df5 2026-03-15 13:01:20,923 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 13:01:20,937 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b40a961727ff69d6f22df5 HTTP/1.1" 200 None 2026-03-15 13:01:20,938 - lava_callback - DEBUG - Processing node 69b40a961727ff69d6f22df5: baseline-arm-clabbe 2026-03-15 13:01:20,938 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b40a961727ff69d6f22df5 2026-03-15 13:01:20,939 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 13:01:20,959 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b40a961727ff69d6f22df5 HTTP/1.1" 200 None 2026-03-15 13:01:20,961 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 13:01:20,975 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aeba33feb96b28aa34a775 HTTP/1.1" 200 None 2026-03-15 13:01:20,977 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 13:01:20,998 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b40a961727ff69d6f22df5 HTTP/1.1" 200 None 2026-03-15 13:01:20,999 - lava_callback - ERROR - Error processing callback for node 69b40a961727ff69d6f22df5: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:32820 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56876 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46240 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41080 - "GET / HTTP/1.0" 200 OK 2026-03-15 13:02:00,901 - lava_callback - INFO - Received callback for node 69b40abd1727ff69d6f22e03 INFO: 172.21.0.1:33952 - "POST /node/69b40abd1727ff69d6f22e03 HTTP/1.0" 202 Accepted 2026-03-15 13:02:00,907 - lava_callback - INFO - Starting async job submit for node 69b40abd1727ff69d6f22e03 2026-03-15 13:02:00,908 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 13:02:00,923 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b40abd1727ff69d6f22e03 HTTP/1.1" 200 None 2026-03-15 13:02:00,923 - lava_callback - DEBUG - Processing node 69b40abd1727ff69d6f22e03: baseline-arm-clabbe 2026-03-15 13:02:00,924 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b40abd1727ff69d6f22e03 2026-03-15 13:02:00,924 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 13:02:00,938 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b40abd1727ff69d6f22e03 HTTP/1.1" 200 None 2026-03-15 13:02:00,940 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 13:02:00,953 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b35934974c91e64560e49d HTTP/1.1" 200 None 2026-03-15 13:02:00,954 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 13:02:00,974 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b40abd1727ff69d6f22e03 HTTP/1.1" 200 None 2026-03-15 13:02:00,980 - lava_callback - ERROR - Error processing callback for node 69b40abd1727ff69d6f22e03: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:33964 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33968 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46502 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:46508 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41874 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54338 - "GET / HTTP/1.0" 200 OK 2026-03-15 13:02:40,958 - lava_callback - INFO - Received callback for node 69b40ae41727ff69d6f22e14 INFO: 172.21.0.1:39422 - "POST /node/69b40ae41727ff69d6f22e14 HTTP/1.0" 202 Accepted 2026-03-15 13:02:40,964 - lava_callback - INFO - Starting async job submit for node 69b40ae41727ff69d6f22e14 2026-03-15 13:02:40,964 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 13:02:40,978 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b40ae41727ff69d6f22e14 HTTP/1.1" 200 None 2026-03-15 13:02:40,979 - lava_callback - DEBUG - Processing node 69b40ae41727ff69d6f22e14: baseline-arm-clabbe 2026-03-15 13:02:40,979 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b40ae41727ff69d6f22e14 2026-03-15 13:02:40,980 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 13:02:40,993 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b40ae41727ff69d6f22e14 HTTP/1.1" 200 None 2026-03-15 13:02:40,994 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 13:02:41,009 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aeba33feb96b28aa34a775 HTTP/1.1" 200 None 2026-03-15 13:02:41,011 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 13:02:41,032 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b40ae41727ff69d6f22e14 HTTP/1.1" 200 None 2026-03-15 13:02:41,037 - lava_callback - ERROR - Error processing callback for node 69b40ae41727ff69d6f22e14: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:39428 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48640 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50276 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50290 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42794 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:42804 - "GET / HTTP/1.0" 200 OK 2026-03-15 13:03:21,028 - lava_callback - INFO - Received callback for node 69b40b0c1727ff69d6f22e22 INFO: 172.21.0.1:36820 - "POST /node/69b40b0c1727ff69d6f22e22 HTTP/1.0" 202 Accepted 2026-03-15 13:03:21,033 - lava_callback - INFO - Starting async job submit for node 69b40b0c1727ff69d6f22e22 2026-03-15 13:03:21,034 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 13:03:21,056 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b40b0c1727ff69d6f22e22 HTTP/1.1" 200 None 2026-03-15 13:03:21,057 - lava_callback - DEBUG - Processing node 69b40b0c1727ff69d6f22e22: baseline-arm-clabbe 2026-03-15 13:03:21,058 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b40b0c1727ff69d6f22e22 2026-03-15 13:03:21,058 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 13:03:21,082 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b40b0c1727ff69d6f22e22 HTTP/1.1" 200 None 2026-03-15 13:03:21,084 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 13:03:21,130 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aeba33feb96b28aa34a775 HTTP/1.1" 200 None 2026-03-15 13:03:21,132 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 13:03:21,152 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b40b0c1727ff69d6f22e22 HTTP/1.1" 200 None 2026-03-15 13:03:21,163 - lava_callback - ERROR - Error processing callback for node 69b40b0c1727ff69d6f22e22: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:36822 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37406 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58588 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53210 - "GET / HTTP/1.0" 200 OK 2026-03-15 13:04:01,068 - lava_callback - INFO - Received callback for node 69b40b331727ff69d6f22e2c INFO: 172.21.0.1:60046 - "POST /node/69b40b331727ff69d6f22e2c HTTP/1.0" 202 Accepted 2026-03-15 13:04:01,073 - lava_callback - INFO - Starting async job submit for node 69b40b331727ff69d6f22e2c 2026-03-15 13:04:01,074 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 13:04:01,092 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b40b331727ff69d6f22e2c HTTP/1.1" 200 None 2026-03-15 13:04:01,093 - lava_callback - DEBUG - Processing node 69b40b331727ff69d6f22e2c: baseline-arm-clabbe 2026-03-15 13:04:01,094 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b40b331727ff69d6f22e2c 2026-03-15 13:04:01,094 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 13:04:01,113 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b40b331727ff69d6f22e2c HTTP/1.1" 200 None 2026-03-15 13:04:01,114 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 13:04:01,129 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b35934974c91e64560e49d HTTP/1.1" 200 None 2026-03-15 13:04:01,130 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 13:04:01,180 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b40b331727ff69d6f22e2c HTTP/1.1" 200 None 2026-03-15 13:04:01,182 - lava_callback - ERROR - Error processing callback for node 69b40b331727ff69d6f22e2c: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:60048 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60062 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50348 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:50356 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51332 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43298 - "GET / HTTP/1.0" 200 OK 2026-03-15 13:04:41,016 - lava_callback - INFO - Received callback for node 69b40b591727ff69d6f22e38 INFO: 172.21.0.1:43314 - "POST /node/69b40b591727ff69d6f22e38 HTTP/1.0" 202 Accepted 2026-03-15 13:04:41,021 - lava_callback - INFO - Starting async job submit for node 69b40b591727ff69d6f22e38 2026-03-15 13:04:41,022 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 13:04:41,036 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b40b591727ff69d6f22e38 HTTP/1.1" 200 None 2026-03-15 13:04:41,037 - lava_callback - DEBUG - Processing node 69b40b591727ff69d6f22e38: baseline-arm-clabbe 2026-03-15 13:04:41,037 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b40b591727ff69d6f22e38 2026-03-15 13:04:41,038 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 13:04:41,053 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b40b591727ff69d6f22e38 HTTP/1.1" 200 None 2026-03-15 13:04:41,054 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 13:04:41,069 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b35934974c91e64560e49d HTTP/1.1" 200 None 2026-03-15 13:04:41,070 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 13:04:41,091 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b40b591727ff69d6f22e38 HTTP/1.1" 200 None 2026-03-15 13:04:41,100 - lava_callback - ERROR - Error processing callback for node 69b40b591727ff69d6f22e38: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:43320 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51742 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50166 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50180 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36812 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:36820 - "GET / HTTP/1.0" 200 OK 2026-03-15 13:05:21,091 - lava_callback - INFO - Received callback for node 69b40b7f1727ff69d6f22e48 INFO: 172.21.0.1:55814 - "POST /node/69b40b7f1727ff69d6f22e48 HTTP/1.0" 202 Accepted 2026-03-15 13:05:21,097 - lava_callback - INFO - Starting async job submit for node 69b40b7f1727ff69d6f22e48 2026-03-15 13:05:21,098 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 13:05:21,111 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b40b7f1727ff69d6f22e48 HTTP/1.1" 200 None 2026-03-15 13:05:21,112 - lava_callback - DEBUG - Processing node 69b40b7f1727ff69d6f22e48: baseline-arm-clabbe 2026-03-15 13:05:21,112 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b40b7f1727ff69d6f22e48 2026-03-15 13:05:21,113 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 13:05:21,126 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b40b7f1727ff69d6f22e48 HTTP/1.1" 200 None 2026-03-15 13:05:21,128 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 13:05:21,146 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b35934974c91e64560e49d HTTP/1.1" 200 None 2026-03-15 13:05:21,148 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 13:05:21,168 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b40b7f1727ff69d6f22e48 HTTP/1.1" 200 None 2026-03-15 13:05:21,173 - lava_callback - ERROR - Error processing callback for node 69b40b7f1727ff69d6f22e48: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:55828 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52298 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41046 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41886 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43578 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43594 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45104 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:45120 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56196 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56936 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47916 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50814 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49796 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49804 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57230 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:57244 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34548 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39264 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33906 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42190 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57802 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57810 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33300 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:33306 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36018 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48638 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37502 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33804 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56648 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56662 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56588 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:56590 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60206 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42032 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59130 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51826 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40066 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40072 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39660 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:39666 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48470 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35004 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57378 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38580 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38698 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38714 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57978 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:57992 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49192 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60356 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40938 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60082 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56110 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56118 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42710 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:42726 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48054 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35174 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38258 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50444 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60934 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60942 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56090 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:56102 - "GET / HTTP/1.0" 200 OK 2026-03-15 13:13:24,359 - lava_callback - INFO - Received callback for node 69b40d641727ff69d6f22e71 INFO: 172.21.0.1:45256 - "POST /node/69b40d641727ff69d6f22e71 HTTP/1.0" 202 Accepted 2026-03-15 13:13:24,364 - lava_callback - INFO - Starting async job submit for node 69b40d641727ff69d6f22e71 2026-03-15 13:13:24,365 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 13:13:24,379 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b40d641727ff69d6f22e71 HTTP/1.1" 200 None 2026-03-15 13:13:24,380 - lava_callback - DEBUG - Processing node 69b40d641727ff69d6f22e71: baseline-arm64-baylibre 2026-03-15 13:13:24,380 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b40d641727ff69d6f22e71 2026-03-15 13:13:24,381 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 13:13:24,394 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b40d641727ff69d6f22e71 HTTP/1.1" 200 None 2026-03-15 13:13:24,396 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 13:13:24,414 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b0b5149d19175818251feb HTTP/1.1" 200 None 2026-03-15 13:13:24,415 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 13:13:24,435 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b40d641727ff69d6f22e71 HTTP/1.1" 200 None 2026-03-15 13:13:24,436 - lava_callback - ERROR - Error processing callback for node 69b40d641727ff69d6f22e71: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:45262 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58474 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59052 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46396 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34684 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34690 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39240 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:39252 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48990 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59490 - "GET / HTTP/1.0" 200 OK 2026-03-15 13:14:44,330 - lava_callback - INFO - Received callback for node 69b40db51727ff69d6f22e80 INFO: 172.21.0.1:40684 - "POST /node/69b40db51727ff69d6f22e80 HTTP/1.0" 202 Accepted 2026-03-15 13:14:44,336 - lava_callback - INFO - Starting async job submit for node 69b40db51727ff69d6f22e80 2026-03-15 13:14:44,337 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 13:14:44,355 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b40db51727ff69d6f22e80 HTTP/1.1" 200 None 2026-03-15 13:14:44,356 - lava_callback - DEBUG - Processing node 69b40db51727ff69d6f22e80: baseline-arm64-baylibre 2026-03-15 13:14:44,356 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b40db51727ff69d6f22e80 2026-03-15 13:14:44,357 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 13:14:44,370 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b40db51727ff69d6f22e80 HTTP/1.1" 200 None 2026-03-15 13:14:44,371 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 13:14:44,384 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b0b5149d19175818251feb HTTP/1.1" 200 None 2026-03-15 13:14:44,386 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 13:14:44,407 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b40db51727ff69d6f22e80 HTTP/1.1" 200 None 2026-03-15 13:14:44,408 - lava_callback - ERROR - Error processing callback for node 69b40db51727ff69d6f22e80: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:40686 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34850 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51668 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51670 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43772 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:43788 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45334 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60252 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51778 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58042 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33010 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33014 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45588 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:45596 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45324 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46394 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34958 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47990 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36312 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36324 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60744 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:60750 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55906 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33940 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59260 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59006 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35646 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35654 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56450 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:56456 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50118 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34166 - "GET / HTTP/1.0" 200 OK 2026-03-15 13:18:44,729 - lava_callback - INFO - Received callback for node 69b40ea61727ff69d6f22ead INFO: 172.21.0.1:41892 - "POST /node/69b40ea61727ff69d6f22ead HTTP/1.0" 202 Accepted 2026-03-15 13:18:44,735 - lava_callback - INFO - Starting async job submit for node 69b40ea61727ff69d6f22ead 2026-03-15 13:18:44,736 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 13:18:44,766 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b40ea61727ff69d6f22ead HTTP/1.1" 200 None 2026-03-15 13:18:44,767 - lava_callback - DEBUG - Processing node 69b40ea61727ff69d6f22ead: baseline-arm64-baylibre 2026-03-15 13:18:44,767 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b40ea61727ff69d6f22ead 2026-03-15 13:18:44,768 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 13:18:44,788 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b40ea61727ff69d6f22ead HTTP/1.1" 200 None 2026-03-15 13:18:44,790 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 13:18:44,804 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b0b5149d19175818251feb HTTP/1.1" 200 None 2026-03-15 13:18:44,805 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 13:18:44,826 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b40ea61727ff69d6f22ead HTTP/1.1" 200 None 2026-03-15 13:18:44,831 - lava_callback - ERROR - Error processing callback for node 69b40ea61727ff69d6f22ead: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:41894 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51244 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56706 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56712 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38616 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:38628 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42920 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60972 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46294 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37044 - "GET / HTTP/1.0" 200 OK 2026-03-15 13:20:01,920 - lava_callback - INFO - Received callback for node 69b40efe1727ff69d6f22eb7 INFO: 172.21.0.1:44112 - "POST /node/69b40efe1727ff69d6f22eb7 HTTP/1.0" 202 Accepted 2026-03-15 13:20:01,925 - lava_callback - INFO - Starting async job submit for node 69b40efe1727ff69d6f22eb7 2026-03-15 13:20:01,926 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 13:20:01,944 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b40efe1727ff69d6f22eb7 HTTP/1.1" 200 None 2026-03-15 13:20:01,945 - lava_callback - DEBUG - Processing node 69b40efe1727ff69d6f22eb7: baseline-arm64-clabbe 2026-03-15 13:20:01,945 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b40efe1727ff69d6f22eb7 2026-03-15 13:20:01,945 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 13:20:01,959 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b40efe1727ff69d6f22eb7 HTTP/1.1" 200 None 2026-03-15 13:20:01,960 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 13:20:01,974 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b0b5149d19175818251feb HTTP/1.1" 200 None 2026-03-15 13:20:01,975 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 13:20:02,017 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b40efe1727ff69d6f22eb7 HTTP/1.1" 200 None 2026-03-15 13:20:02,018 - lava_callback - ERROR - Error processing callback for node 69b40efe1727ff69d6f22eb7: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:44128 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44132 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39382 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:39386 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45280 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34166 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46372 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54430 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45846 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45854 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42306 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:42310 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51592 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52192 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44736 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47198 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42374 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42390 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48562 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:48566 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43150 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46154 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:32790 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49188 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41106 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41118 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40036 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:40046 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55338 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59482 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60082 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40254 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55990 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55994 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34716 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:34730 - "GET / HTTP/1.0" 200 OK 2026-03-15 13:24:21,933 - lava_callback - INFO - Received callback for node 69b40ff21727ff69d6f22ee4 INFO: 172.21.0.1:47198 - "POST /node/69b40ff21727ff69d6f22ee4 HTTP/1.0" 202 Accepted 2026-03-15 13:24:21,939 - lava_callback - INFO - Starting async job submit for node 69b40ff21727ff69d6f22ee4 2026-03-15 13:24:21,939 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 13:24:21,953 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b40ff21727ff69d6f22ee4 HTTP/1.1" 200 None 2026-03-15 13:24:21,954 - lava_callback - DEBUG - Processing node 69b40ff21727ff69d6f22ee4: baseline-arm64-clabbe 2026-03-15 13:24:21,955 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b40ff21727ff69d6f22ee4 2026-03-15 13:24:21,955 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 13:24:21,968 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b40ff21727ff69d6f22ee4 HTTP/1.1" 200 None 2026-03-15 13:24:21,970 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 13:24:21,983 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b0b5149d19175818251feb HTTP/1.1" 200 None 2026-03-15 13:24:21,984 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 13:24:22,012 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b40ff21727ff69d6f22ee4 HTTP/1.1" 200 None 2026-03-15 13:24:22,014 - lava_callback - ERROR - Error processing callback for node 69b40ff21727ff69d6f22ee4: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:47200 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58454 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37732 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41334 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42778 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42792 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54852 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:54856 - "GET / HTTP/1.0" 200 OK 2026-03-15 13:25:25,030 - lava_callback - INFO - Received callback for node 69b4103b1727ff69d6f22eee INFO: 172.21.0.1:37192 - "POST /node/69b4103b1727ff69d6f22eee HTTP/1.0" 202 Accepted 2026-03-15 13:25:25,036 - lava_callback - INFO - Starting async job submit for node 69b4103b1727ff69d6f22eee 2026-03-15 13:25:25,037 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 13:25:25,056 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b4103b1727ff69d6f22eee HTTP/1.1" 200 None 2026-03-15 13:25:25,057 - lava_callback - DEBUG - Processing node 69b4103b1727ff69d6f22eee: baseline-arm64-baylibre 2026-03-15 13:25:25,057 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b4103b1727ff69d6f22eee 2026-03-15 13:25:25,057 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 13:25:25,071 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b4103b1727ff69d6f22eee HTTP/1.1" 200 None 2026-03-15 13:25:25,072 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 13:25:25,091 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aeba41feb96b28aa34a78b HTTP/1.1" 200 None 2026-03-15 13:25:25,092 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 13:25:25,114 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b4103b1727ff69d6f22eee HTTP/1.1" 200 None 2026-03-15 13:25:25,115 - lava_callback - ERROR - Error processing callback for node 69b4103b1727ff69d6f22eee: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:37202 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37258 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38150 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57338 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42956 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42972 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33414 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:33420 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47982 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47392 - "GET / HTTP/1.0" 200 OK 2026-03-15 13:26:45,053 - lava_callback - INFO - Received callback for node 69b4108c1727ff69d6f22efb INFO: 172.21.0.1:36446 - "POST /node/69b4108c1727ff69d6f22efb HTTP/1.0" 202 Accepted 2026-03-15 13:26:45,058 - lava_callback - INFO - Starting async job submit for node 69b4108c1727ff69d6f22efb 2026-03-15 13:26:45,059 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 13:26:45,074 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b4108c1727ff69d6f22efb HTTP/1.1" 200 None 2026-03-15 13:26:45,075 - lava_callback - DEBUG - Processing node 69b4108c1727ff69d6f22efb: baseline-arm64-baylibre 2026-03-15 13:26:45,075 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b4108c1727ff69d6f22efb 2026-03-15 13:26:45,076 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 13:26:45,089 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b4108c1727ff69d6f22efb HTTP/1.1" 200 None 2026-03-15 13:26:45,091 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 13:26:45,106 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b3594d974c91e64560e4b2 HTTP/1.1" 200 None 2026-03-15 13:26:45,108 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 13:26:45,129 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b4108c1727ff69d6f22efb HTTP/1.1" 200 None 2026-03-15 13:26:45,134 - lava_callback - ERROR - Error processing callback for node 69b4108c1727ff69d6f22efb: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:36458 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53106 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38844 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38858 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55602 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:55618 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44960 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51696 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58294 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50160 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39990 - "GET / HTTP/1.0" 200 OK 2026-03-15 13:28:05,224 - lava_callback - INFO - Received callback for node 69b410d81727ff69d6f22f01 INFO: 172.21.0.1:39998 - "POST /node/69b410d81727ff69d6f22f01 HTTP/1.0" 202 Accepted 2026-03-15 13:28:05,229 - lava_callback - INFO - Starting async job submit for node 69b410d81727ff69d6f22f01 2026-03-15 13:28:05,230 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 13:28:05,245 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b410d81727ff69d6f22f01 HTTP/1.1" 200 None 2026-03-15 13:28:05,246 - lava_callback - DEBUG - Processing node 69b410d81727ff69d6f22f01: baseline-arm64-baylibre 2026-03-15 13:28:05,246 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b410d81727ff69d6f22f01 2026-03-15 13:28:05,246 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 13:28:05,259 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b410d81727ff69d6f22f01 HTTP/1.1" 200 None 2026-03-15 13:28:05,261 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 13:28:05,274 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aeba41feb96b28aa34a78b HTTP/1.1" 200 None 2026-03-15 13:28:05,275 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 13:28:05,309 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b410d81727ff69d6f22f01 HTTP/1.1" 200 None 2026-03-15 13:28:05,314 - lava_callback - ERROR - Error processing callback for node 69b410d81727ff69d6f22f01: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:40006 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58762 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:58774 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43654 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45814 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59098 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57336 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51134 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51150 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60206 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:60216 - "GET / HTTP/1.0" 200 OK 2026-03-15 13:29:25,162 - lava_callback - INFO - Received callback for node 69b411291727ff69d6f22f11 INFO: 172.21.0.1:46426 - "POST /node/69b411291727ff69d6f22f11 HTTP/1.0" 202 Accepted 2026-03-15 13:29:25,167 - lava_callback - INFO - Starting async job submit for node 69b411291727ff69d6f22f11 2026-03-15 13:29:25,168 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 13:29:25,182 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b411291727ff69d6f22f11 HTTP/1.1" 200 None 2026-03-15 13:29:25,183 - lava_callback - DEBUG - Processing node 69b411291727ff69d6f22f11: baseline-arm64-baylibre 2026-03-15 13:29:25,183 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b411291727ff69d6f22f11 2026-03-15 13:29:25,184 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 13:29:25,197 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b411291727ff69d6f22f11 HTTP/1.1" 200 None 2026-03-15 13:29:25,198 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 13:29:25,211 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b3594d974c91e64560e4b2 HTTP/1.1" 200 None 2026-03-15 13:29:25,212 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 13:29:25,242 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b411291727ff69d6f22f11 HTTP/1.1" 200 None 2026-03-15 13:29:25,243 - lava_callback - ERROR - Error processing callback for node 69b411291727ff69d6f22f11: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:46436 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37832 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45288 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:32794 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44952 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44954 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49168 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:49176 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52700 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42636 - "GET / HTTP/1.0" 200 OK 2026-03-15 13:30:45,208 - lava_callback - INFO - Received callback for node 69b411761727ff69d6f22f1a INFO: 172.21.0.1:43318 - "POST /node/69b411761727ff69d6f22f1a HTTP/1.0" 202 Accepted 2026-03-15 13:30:45,214 - lava_callback - INFO - Starting async job submit for node 69b411761727ff69d6f22f1a 2026-03-15 13:30:45,215 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 13:30:45,229 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b411761727ff69d6f22f1a HTTP/1.1" 200 None 2026-03-15 13:30:45,230 - lava_callback - DEBUG - Processing node 69b411761727ff69d6f22f1a: baseline-arm64-baylibre 2026-03-15 13:30:45,230 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b411761727ff69d6f22f1a 2026-03-15 13:30:45,231 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 13:30:45,244 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b411761727ff69d6f22f1a HTTP/1.1" 200 None 2026-03-15 13:30:45,245 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 13:30:45,258 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aeba41feb96b28aa34a78b HTTP/1.1" 200 None 2026-03-15 13:30:45,259 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 13:30:45,279 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b411761727ff69d6f22f1a HTTP/1.1" 200 None 2026-03-15 13:30:45,281 - lava_callback - ERROR - Error processing callback for node 69b411761727ff69d6f22f1a: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:43332 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60546 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49272 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49276 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39998 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:40004 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54108 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60608 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60584 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59372 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50294 - "GET / HTTP/1.0" 200 OK 2026-03-15 13:32:05,290 - lava_callback - INFO - Received callback for node 69b411c41727ff69d6f22f2a INFO: 172.21.0.1:50310 - "POST /node/69b411c41727ff69d6f22f2a HTTP/1.0" 202 Accepted 2026-03-15 13:32:05,296 - lava_callback - INFO - Starting async job submit for node 69b411c41727ff69d6f22f2a 2026-03-15 13:32:05,297 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 13:32:05,314 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b411c41727ff69d6f22f2a HTTP/1.1" 200 None 2026-03-15 13:32:05,315 - lava_callback - DEBUG - Processing node 69b411c41727ff69d6f22f2a: baseline-arm64-baylibre 2026-03-15 13:32:05,315 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b411c41727ff69d6f22f2a 2026-03-15 13:32:05,316 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 13:32:05,330 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b411c41727ff69d6f22f2a HTTP/1.1" 200 None 2026-03-15 13:32:05,332 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 13:32:05,345 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aeba41feb96b28aa34a78b HTTP/1.1" 200 None 2026-03-15 13:32:05,346 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 13:32:05,371 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b411c41727ff69d6f22f2a HTTP/1.1" 200 None 2026-03-15 13:32:05,372 - lava_callback - ERROR - Error processing callback for node 69b411c41727ff69d6f22f2a: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:50326 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51820 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:51824 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39260 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47116 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46828 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57004 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35330 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35338 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38442 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:38446 - "GET / HTTP/1.0" 200 OK 2026-03-15 13:33:25,493 - lava_callback - INFO - Received callback for node 69b412121727ff69d6f22f3d INFO: 172.21.0.1:59324 - "POST /node/69b412121727ff69d6f22f3d HTTP/1.0" 202 Accepted 2026-03-15 13:33:25,499 - lava_callback - INFO - Starting async job submit for node 69b412121727ff69d6f22f3d 2026-03-15 13:33:25,500 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 13:33:25,524 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b412121727ff69d6f22f3d HTTP/1.1" 200 None 2026-03-15 13:33:25,525 - lava_callback - DEBUG - Processing node 69b412121727ff69d6f22f3d: baseline-arm64-baylibre 2026-03-15 13:33:25,525 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b412121727ff69d6f22f3d 2026-03-15 13:33:25,526 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 13:33:25,540 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b412121727ff69d6f22f3d HTTP/1.1" 200 None 2026-03-15 13:33:25,541 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 13:33:25,560 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b3594d974c91e64560e4b2 HTTP/1.1" 200 None 2026-03-15 13:33:25,562 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 13:33:25,584 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b412121727ff69d6f22f3d HTTP/1.1" 200 None 2026-03-15 13:33:25,586 - lava_callback - ERROR - Error processing callback for node 69b412121727ff69d6f22f3d: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:59334 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53312 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56954 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36766 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37764 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37766 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46676 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:46682 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55876 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51266 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59524 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58234 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54874 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54880 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58252 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:58264 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35288 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41306 - "GET / HTTP/1.0" 200 OK 2026-03-15 13:35:45,560 - lava_callback - INFO - Received callback for node 69b412ad1727ff69d6f22f56 INFO: 172.21.0.1:40110 - "POST /node/69b412ad1727ff69d6f22f56 HTTP/1.0" 202 Accepted 2026-03-15 13:35:45,566 - lava_callback - INFO - Starting async job submit for node 69b412ad1727ff69d6f22f56 2026-03-15 13:35:45,567 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 13:35:45,582 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b412ad1727ff69d6f22f56 HTTP/1.1" 200 None 2026-03-15 13:35:45,583 - lava_callback - DEBUG - Processing node 69b412ad1727ff69d6f22f56: baseline-arm64-baylibre 2026-03-15 13:35:45,583 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b412ad1727ff69d6f22f56 2026-03-15 13:35:45,584 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 13:35:45,597 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b412ad1727ff69d6f22f56 HTTP/1.1" 200 None 2026-03-15 13:35:45,598 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 13:35:45,612 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aeba41feb96b28aa34a78b HTTP/1.1" 200 None 2026-03-15 13:35:45,614 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 13:35:45,635 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b412ad1727ff69d6f22f56 HTTP/1.1" 200 None 2026-03-15 13:35:45,636 - lava_callback - ERROR - Error processing callback for node 69b412ad1727ff69d6f22f56: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:40124 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54112 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51418 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51420 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51428 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37946 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:37958 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57448 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34836 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46476 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39550 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54806 - "GET / HTTP/1.0" 200 OK 2026-03-15 13:37:05,532 - lava_callback - INFO - Received callback for node 69b412fc1727ff69d6f22f63 INFO: 172.21.0.1:54816 - "POST /node/69b412fc1727ff69d6f22f63 HTTP/1.0" 202 Accepted 2026-03-15 13:37:05,537 - lava_callback - INFO - Starting async job submit for node 69b412fc1727ff69d6f22f63 2026-03-15 13:37:05,538 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 13:37:05,554 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b412fc1727ff69d6f22f63 HTTP/1.1" 200 None 2026-03-15 13:37:05,555 - lava_callback - DEBUG - Processing node 69b412fc1727ff69d6f22f63: baseline-arm64-baylibre 2026-03-15 13:37:05,555 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b412fc1727ff69d6f22f63 2026-03-15 13:37:05,556 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 13:37:05,568 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b412fc1727ff69d6f22f63 HTTP/1.1" 200 None 2026-03-15 13:37:05,570 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 13:37:05,583 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aeba41feb96b28aa34a78b HTTP/1.1" 200 None 2026-03-15 13:37:05,584 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 13:37:05,629 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b412fc1727ff69d6f22f63 HTTP/1.1" 200 None 2026-03-15 13:37:05,634 - lava_callback - ERROR - Error processing callback for node 69b412fc1727ff69d6f22f63: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:54828 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34220 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:34228 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36776 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54310 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46278 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56582 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44944 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44958 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47058 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:47060 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41624 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53244 - "GET / HTTP/1.0" 200 OK 2026-03-15 13:38:42,539 - lava_callback - INFO - Received callback for node 69b413531727ff69d6f22f71 INFO: 172.21.0.1:53992 - "POST /node/69b413531727ff69d6f22f71 HTTP/1.0" 202 Accepted 2026-03-15 13:38:42,545 - lava_callback - INFO - Starting async job submit for node 69b413531727ff69d6f22f71 2026-03-15 13:38:42,545 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 13:38:42,560 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b413531727ff69d6f22f71 HTTP/1.1" 200 None 2026-03-15 13:38:42,561 - lava_callback - DEBUG - Processing node 69b413531727ff69d6f22f71: baseline-arm64-clabbe 2026-03-15 13:38:42,562 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b413531727ff69d6f22f71 2026-03-15 13:38:42,562 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 13:38:42,586 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b413531727ff69d6f22f71 HTTP/1.1" 200 None 2026-03-15 13:38:42,588 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 13:38:42,601 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b3594d974c91e64560e4b2 HTTP/1.1" 200 None 2026-03-15 13:38:42,602 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 13:38:42,627 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b413531727ff69d6f22f71 HTTP/1.1" 200 None 2026-03-15 13:38:42,637 - lava_callback - ERROR - Error processing callback for node 69b413531727ff69d6f22f71: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:54002 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60690 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45116 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45132 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57412 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:57426 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57600 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38134 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36940 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39426 - "GET / HTTP/1.0" 200 OK 2026-03-15 13:40:02,649 - lava_callback - INFO - Received callback for node 69b413a41727ff69d6f22f82 INFO: 172.21.0.1:40686 - "POST /node/69b413a41727ff69d6f22f82 HTTP/1.0" 202 Accepted 2026-03-15 13:40:02,655 - lava_callback - INFO - Starting async job submit for node 69b413a41727ff69d6f22f82 2026-03-15 13:40:02,656 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 13:40:02,670 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b413a41727ff69d6f22f82 HTTP/1.1" 200 None 2026-03-15 13:40:02,671 - lava_callback - DEBUG - Processing node 69b413a41727ff69d6f22f82: baseline-arm64-clabbe 2026-03-15 13:40:02,671 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b413a41727ff69d6f22f82 2026-03-15 13:40:02,672 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 13:40:02,691 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b413a41727ff69d6f22f82 HTTP/1.1" 200 None 2026-03-15 13:40:02,692 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 13:40:02,706 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aeba41feb96b28aa34a78b HTTP/1.1" 200 None 2026-03-15 13:40:02,707 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 13:40:02,728 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b413a41727ff69d6f22f82 HTTP/1.1" 200 None 2026-03-15 13:40:02,729 - lava_callback - ERROR - Error processing callback for node 69b413a41727ff69d6f22f82: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:40700 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40714 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46516 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:46524 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55518 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50550 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41998 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54274 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54502 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54506 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55694 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:55702 - "GET / HTTP/1.0" 200 OK 2026-03-15 13:41:22,760 - lava_callback - INFO - Received callback for node 69b413f51727ff69d6f22f94 INFO: 172.21.0.1:35118 - "POST /node/69b413f51727ff69d6f22f94 HTTP/1.0" 202 Accepted 2026-03-15 13:41:22,765 - lava_callback - INFO - Starting async job submit for node 69b413f51727ff69d6f22f94 2026-03-15 13:41:22,766 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 13:41:22,781 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b413f51727ff69d6f22f94 HTTP/1.1" 200 None 2026-03-15 13:41:22,782 - lava_callback - DEBUG - Processing node 69b413f51727ff69d6f22f94: baseline-arm64-clabbe 2026-03-15 13:41:22,782 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b413f51727ff69d6f22f94 2026-03-15 13:41:22,783 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 13:41:22,796 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b413f51727ff69d6f22f94 HTTP/1.1" 200 None 2026-03-15 13:41:22,798 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 13:41:22,811 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b3594d974c91e64560e4b2 HTTP/1.1" 200 None 2026-03-15 13:41:22,812 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 13:41:22,837 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b413f51727ff69d6f22f94 HTTP/1.1" 200 None 2026-03-15 13:41:22,842 - lava_callback - ERROR - Error processing callback for node 69b413f51727ff69d6f22f94: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:35122 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36806 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55168 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49724 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35690 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35694 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:32936 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:32940 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53510 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60130 - "GET / HTTP/1.0" 200 OK 2026-03-15 13:42:42,712 - lava_callback - INFO - Received callback for node 69b414451727ff69d6f22f9c INFO: 172.21.0.1:37872 - "POST /node/69b414451727ff69d6f22f9c HTTP/1.0" 202 Accepted 2026-03-15 13:42:42,717 - lava_callback - INFO - Starting async job submit for node 69b414451727ff69d6f22f9c 2026-03-15 13:42:42,718 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 13:42:42,732 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b414451727ff69d6f22f9c HTTP/1.1" 200 None 2026-03-15 13:42:42,732 - lava_callback - DEBUG - Processing node 69b414451727ff69d6f22f9c: baseline-arm64-clabbe 2026-03-15 13:42:42,733 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b414451727ff69d6f22f9c 2026-03-15 13:42:42,733 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 13:42:42,747 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b414451727ff69d6f22f9c HTTP/1.1" 200 None 2026-03-15 13:42:42,748 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 13:42:42,763 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aeba41feb96b28aa34a78b HTTP/1.1" 200 None 2026-03-15 13:42:42,764 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 13:42:42,789 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b414451727ff69d6f22f9c HTTP/1.1" 200 None 2026-03-15 13:42:42,790 - lava_callback - ERROR - Error processing callback for node 69b414451727ff69d6f22f9c: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:37882 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49540 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57898 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57914 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55556 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:55560 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56634 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34988 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49338 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38984 - "GET / HTTP/1.0" 200 OK 2026-03-15 13:44:02,827 - lava_callback - INFO - Received callback for node 69b414951727ff69d6f22fab INFO: 172.21.0.1:59400 - "POST /node/69b414951727ff69d6f22fab HTTP/1.0" 202 Accepted 2026-03-15 13:44:02,832 - lava_callback - INFO - Starting async job submit for node 69b414951727ff69d6f22fab 2026-03-15 13:44:02,833 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 13:44:02,848 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b414951727ff69d6f22fab HTTP/1.1" 200 None 2026-03-15 13:44:02,849 - lava_callback - DEBUG - Processing node 69b414951727ff69d6f22fab: baseline-arm64-clabbe 2026-03-15 13:44:02,850 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b414951727ff69d6f22fab 2026-03-15 13:44:02,850 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 13:44:02,882 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b414951727ff69d6f22fab HTTP/1.1" 200 None 2026-03-15 13:44:02,884 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 13:44:02,909 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aeba41feb96b28aa34a78b HTTP/1.1" 200 None 2026-03-15 13:44:02,911 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 13:44:02,941 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b414951727ff69d6f22fab HTTP/1.1" 200 None 2026-03-15 13:44:02,945 - lava_callback - ERROR - Error processing callback for node 69b414951727ff69d6f22fab: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:59404 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59418 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59126 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:59128 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55246 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43128 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35732 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53868 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38054 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38066 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57186 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:57202 - "GET / HTTP/1.0" 200 OK 2026-03-15 13:45:22,845 - lava_callback - INFO - Received callback for node 69b414e61727ff69d6f22fbd INFO: 172.21.0.1:43440 - "POST /node/69b414e61727ff69d6f22fbd HTTP/1.0" 202 Accepted 2026-03-15 13:45:22,850 - lava_callback - INFO - Starting async job submit for node 69b414e61727ff69d6f22fbd 2026-03-15 13:45:22,851 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 13:45:22,865 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b414e61727ff69d6f22fbd HTTP/1.1" 200 None 2026-03-15 13:45:22,866 - lava_callback - DEBUG - Processing node 69b414e61727ff69d6f22fbd: baseline-arm64-clabbe 2026-03-15 13:45:22,866 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b414e61727ff69d6f22fbd 2026-03-15 13:45:22,867 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 13:45:22,884 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b414e61727ff69d6f22fbd HTTP/1.1" 200 None 2026-03-15 13:45:22,885 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 13:45:22,899 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b3594d974c91e64560e4b2 HTTP/1.1" 200 None 2026-03-15 13:45:22,901 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 13:45:22,928 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b414e61727ff69d6f22fbd HTTP/1.1" 200 None 2026-03-15 13:45:22,930 - lava_callback - ERROR - Error processing callback for node 69b414e61727ff69d6f22fbd: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:43444 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50566 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51978 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43348 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60284 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60296 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39714 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:39722 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33698 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36644 - "GET / HTTP/1.0" 200 OK 2026-03-15 13:46:42,970 - lava_callback - INFO - Received callback for node 69b415371727ff69d6f22fc7 INFO: 172.21.0.1:51242 - "POST /node/69b415371727ff69d6f22fc7 HTTP/1.0" 202 Accepted 2026-03-15 13:46:42,975 - lava_callback - INFO - Starting async job submit for node 69b415371727ff69d6f22fc7 2026-03-15 13:46:42,977 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 13:46:42,991 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b415371727ff69d6f22fc7 HTTP/1.1" 200 None 2026-03-15 13:46:42,992 - lava_callback - DEBUG - Processing node 69b415371727ff69d6f22fc7: baseline-arm64-clabbe 2026-03-15 13:46:42,992 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b415371727ff69d6f22fc7 2026-03-15 13:46:42,993 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 13:46:43,007 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b415371727ff69d6f22fc7 HTTP/1.1" 200 None 2026-03-15 13:46:43,008 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 13:46:43,028 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aeba41feb96b28aa34a78b HTTP/1.1" 200 None 2026-03-15 13:46:43,029 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 13:46:43,051 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b415371727ff69d6f22fc7 HTTP/1.1" 200 None 2026-03-15 13:46:43,052 - lava_callback - ERROR - Error processing callback for node 69b415371727ff69d6f22fc7: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:51248 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43694 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54824 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54840 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53730 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:53740 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56020 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:32990 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51852 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51690 - "GET / HTTP/1.0" 200 OK 2026-03-15 13:48:02,941 - lava_callback - INFO - Received callback for node 69b415881727ff69d6f22fd1 INFO: 172.21.0.1:43852 - "POST /node/69b415881727ff69d6f22fd1 HTTP/1.0" 202 Accepted 2026-03-15 13:48:02,946 - lava_callback - INFO - Starting async job submit for node 69b415881727ff69d6f22fd1 2026-03-15 13:48:02,947 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 13:48:02,961 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b415881727ff69d6f22fd1 HTTP/1.1" 200 None 2026-03-15 13:48:02,962 - lava_callback - DEBUG - Processing node 69b415881727ff69d6f22fd1: baseline-arm64-clabbe 2026-03-15 13:48:02,962 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b415881727ff69d6f22fd1 2026-03-15 13:48:02,963 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 13:48:02,976 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b415881727ff69d6f22fd1 HTTP/1.1" 200 None 2026-03-15 13:48:02,978 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 13:48:03,000 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b3594d974c91e64560e4b2 HTTP/1.1" 200 None 2026-03-15 13:48:03,002 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 13:48:03,023 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b415881727ff69d6f22fd1 HTTP/1.1" 200 None 2026-03-15 13:48:03,029 - lava_callback - ERROR - Error processing callback for node 69b415881727ff69d6f22fd1: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:43864 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43870 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35970 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:35978 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43680 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50312 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44314 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48580 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35522 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35538 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41190 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:41198 - "GET / HTTP/1.0" 200 OK 2026-03-15 13:49:23,042 - lava_callback - INFO - Received callback for node 69b415d91727ff69d6f22fdf INFO: 172.21.0.1:55156 - "POST /node/69b415d91727ff69d6f22fdf HTTP/1.0" 202 Accepted 2026-03-15 13:49:23,047 - lava_callback - INFO - Starting async job submit for node 69b415d91727ff69d6f22fdf 2026-03-15 13:49:23,048 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 13:49:23,061 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b415d91727ff69d6f22fdf HTTP/1.1" 200 None 2026-03-15 13:49:23,062 - lava_callback - DEBUG - Processing node 69b415d91727ff69d6f22fdf: baseline-arm64-clabbe 2026-03-15 13:49:23,062 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b415d91727ff69d6f22fdf 2026-03-15 13:49:23,063 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 13:49:23,109 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b415d91727ff69d6f22fdf HTTP/1.1" 200 None 2026-03-15 13:49:23,110 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 13:49:23,129 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b3594d974c91e64560e4b2 HTTP/1.1" 200 None 2026-03-15 13:49:23,130 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 13:49:23,162 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b415d91727ff69d6f22fdf HTTP/1.1" 200 None 2026-03-15 13:49:23,163 - lava_callback - ERROR - Error processing callback for node 69b415d91727ff69d6f22fdf: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:55170 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49262 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49084 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36668 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56970 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56972 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41264 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:41276 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35802 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43224 - "GET / HTTP/1.0" 200 OK 2026-03-15 13:50:43,188 - lava_callback - INFO - Received callback for node 69b4162c1727ff69d6f22feb INFO: 172.21.0.1:55248 - "POST /node/69b4162c1727ff69d6f22feb HTTP/1.0" 202 Accepted 2026-03-15 13:50:43,193 - lava_callback - INFO - Starting async job submit for node 69b4162c1727ff69d6f22feb 2026-03-15 13:50:43,194 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 13:50:43,209 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b4162c1727ff69d6f22feb HTTP/1.1" 200 None 2026-03-15 13:50:43,210 - lava_callback - DEBUG - Processing node 69b4162c1727ff69d6f22feb: baseline-arm64-clabbe 2026-03-15 13:50:43,210 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b4162c1727ff69d6f22feb 2026-03-15 13:50:43,211 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 13:50:43,245 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b4162c1727ff69d6f22feb HTTP/1.1" 200 None 2026-03-15 13:50:43,246 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 13:50:43,264 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aeba41feb96b28aa34a78b HTTP/1.1" 200 None 2026-03-15 13:50:43,265 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 13:50:43,299 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b4162c1727ff69d6f22feb HTTP/1.1" 200 None 2026-03-15 13:50:43,301 - lava_callback - ERROR - Error processing callback for node 69b4162c1727ff69d6f22feb: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:55258 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45148 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35774 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35786 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48876 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:48880 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35084 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35440 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42068 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41056 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41010 - "GET / HTTP/1.0" 200 OK 2026-03-15 13:52:05,358 - lava_callback - INFO - Received callback for node 69b4167e1727ff69d6f22ff6 INFO: 172.21.0.1:41016 - "POST /node/69b4167e1727ff69d6f22ff6 HTTP/1.0" 202 Accepted 2026-03-15 13:52:05,363 - lava_callback - INFO - Starting async job submit for node 69b4167e1727ff69d6f22ff6 2026-03-15 13:52:05,364 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 13:52:05,378 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b4167e1727ff69d6f22ff6 HTTP/1.1" 200 None 2026-03-15 13:52:05,379 - lava_callback - DEBUG - Processing node 69b4167e1727ff69d6f22ff6: baseline-arm64-clabbe 2026-03-15 13:52:05,379 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b4167e1727ff69d6f22ff6 2026-03-15 13:52:05,380 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 13:52:05,401 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b4167e1727ff69d6f22ff6 HTTP/1.1" 200 None 2026-03-15 13:52:05,403 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 13:52:05,416 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aeba41feb96b28aa34a78b HTTP/1.1" 200 None 2026-03-15 13:52:05,418 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 13:52:05,440 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b4167e1727ff69d6f22ff6 HTTP/1.1" 200 None 2026-03-15 13:52:05,441 - lava_callback - ERROR - Error processing callback for node 69b4167e1727ff69d6f22ff6: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:41026 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45584 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:45594 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59206 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59488 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57256 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58134 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44558 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44564 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40902 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:40916 - "GET / HTTP/1.0" 200 OK 2026-03-15 13:53:23,235 - lava_callback - INFO - Received callback for node 69b416cd1727ff69d6f23003 INFO: 172.21.0.1:54658 - "POST /node/69b416cd1727ff69d6f23003 HTTP/1.0" 202 Accepted 2026-03-15 13:53:23,240 - lava_callback - INFO - Starting async job submit for node 69b416cd1727ff69d6f23003 2026-03-15 13:53:23,241 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 13:53:23,256 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b416cd1727ff69d6f23003 HTTP/1.1" 200 None 2026-03-15 13:53:23,257 - lava_callback - DEBUG - Processing node 69b416cd1727ff69d6f23003: baseline-arm64-clabbe 2026-03-15 13:53:23,257 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b416cd1727ff69d6f23003 2026-03-15 13:53:23,257 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 13:53:23,275 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b416cd1727ff69d6f23003 HTTP/1.1" 200 None 2026-03-15 13:53:23,276 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 13:53:23,290 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b3594d974c91e64560e4b2 HTTP/1.1" 200 None 2026-03-15 13:53:23,292 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 13:53:23,322 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b416cd1727ff69d6f23003 HTTP/1.1" 200 None 2026-03-15 13:53:23,323 - lava_callback - ERROR - Error processing callback for node 69b416cd1727ff69d6f23003: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:54672 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55038 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49748 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:32798 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34152 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34158 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36526 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:36542 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52728 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59334 - "GET / HTTP/1.0" 200 OK 2026-03-15 13:54:43,294 - lava_callback - INFO - Received callback for node 69b4171c1727ff69d6f23010 INFO: 172.21.0.1:41078 - "POST /node/69b4171c1727ff69d6f23010 HTTP/1.0" 202 Accepted 2026-03-15 13:54:43,299 - lava_callback - INFO - Starting async job submit for node 69b4171c1727ff69d6f23010 2026-03-15 13:54:43,300 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 13:54:43,314 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b4171c1727ff69d6f23010 HTTP/1.1" 200 None 2026-03-15 13:54:43,315 - lava_callback - DEBUG - Processing node 69b4171c1727ff69d6f23010: baseline-arm64-clabbe 2026-03-15 13:54:43,316 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b4171c1727ff69d6f23010 2026-03-15 13:54:43,316 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 13:54:43,329 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b4171c1727ff69d6f23010 HTTP/1.1" 200 None 2026-03-15 13:54:43,331 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 13:54:43,344 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b0b5149d19175818251feb HTTP/1.1" 200 None 2026-03-15 13:54:43,346 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 13:54:43,375 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b4171c1727ff69d6f23010 HTTP/1.1" 200 None 2026-03-15 13:54:43,376 - lava_callback - ERROR - Error processing callback for node 69b4171c1727ff69d6f23010: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:41084 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44672 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35288 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35290 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57252 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:57254 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:32964 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44672 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41412 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50898 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33320 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33324 - "GET / HTTP/1.0" 200 OK 2026-03-15 13:56:06,792 - lava_callback - INFO - Received callback for node 69b417651727ff69d6f23018 INFO: 172.21.0.1:33334 - "POST /node/69b417651727ff69d6f23018 HTTP/1.0" 202 Accepted 2026-03-15 13:56:06,797 - lava_callback - INFO - Starting async job submit for node 69b417651727ff69d6f23018 2026-03-15 13:56:06,798 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 13:56:06,812 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b417651727ff69d6f23018 HTTP/1.1" 200 None 2026-03-15 13:56:06,813 - lava_callback - DEBUG - Processing node 69b417651727ff69d6f23018: baseline-arm64-baylibre 2026-03-15 13:56:06,814 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b417651727ff69d6f23018 2026-03-15 13:56:06,814 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 13:56:06,828 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b417651727ff69d6f23018 HTTP/1.1" 200 None 2026-03-15 13:56:06,830 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 13:56:06,843 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b0b5149d19175818251feb HTTP/1.1" 200 None 2026-03-15 13:56:06,845 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 13:56:06,879 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b417651727ff69d6f23018 HTTP/1.1" 200 None 2026-03-15 13:56:06,881 - lava_callback - ERROR - Error processing callback for node 69b417651727ff69d6f23018: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:53648 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:53658 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34028 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48344 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59152 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36554 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34482 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34498 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36362 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:36364 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59952 - "GET / HTTP/1.0" 200 OK 2026-03-15 13:57:26,630 - lava_callback - INFO - Received callback for node 69b417b51727ff69d6f23025 INFO: 172.21.0.1:59966 - "POST /node/69b417b51727ff69d6f23025 HTTP/1.0" 202 Accepted 2026-03-15 13:57:26,636 - lava_callback - INFO - Starting async job submit for node 69b417b51727ff69d6f23025 2026-03-15 13:57:26,636 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 13:57:26,650 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b417b51727ff69d6f23025 HTTP/1.1" 200 None 2026-03-15 13:57:26,651 - lava_callback - DEBUG - Processing node 69b417b51727ff69d6f23025: baseline-arm64-baylibre 2026-03-15 13:57:26,651 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b417b51727ff69d6f23025 2026-03-15 13:57:26,652 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 13:57:26,668 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b417b51727ff69d6f23025 HTTP/1.1" 200 None 2026-03-15 13:57:26,669 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 13:57:26,683 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b0b5149d19175818251feb HTTP/1.1" 200 None 2026-03-15 13:57:26,685 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 13:57:26,711 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b417b51727ff69d6f23025 HTTP/1.1" 200 None 2026-03-15 13:57:26,712 - lava_callback - ERROR - Error processing callback for node 69b417b51727ff69d6f23025: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:42754 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41892 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44488 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59678 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59684 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42390 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:42392 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60732 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55234 - "GET / HTTP/1.0" 200 OK 2026-03-15 13:58:43,423 - lava_callback - INFO - Received callback for node 69b4180a1727ff69d6f23031 INFO: 172.21.0.1:54810 - "POST /node/69b4180a1727ff69d6f23031 HTTP/1.0" 202 Accepted 2026-03-15 13:58:43,428 - lava_callback - INFO - Starting async job submit for node 69b4180a1727ff69d6f23031 2026-03-15 13:58:43,430 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 13:58:43,448 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b4180a1727ff69d6f23031 HTTP/1.1" 200 None 2026-03-15 13:58:43,449 - lava_callback - DEBUG - Processing node 69b4180a1727ff69d6f23031: baseline-arm64-clabbe 2026-03-15 13:58:43,449 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b4180a1727ff69d6f23031 2026-03-15 13:58:43,450 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 13:58:43,463 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b4180a1727ff69d6f23031 HTTP/1.1" 200 None 2026-03-15 13:58:43,464 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 13:58:43,478 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b0b5149d19175818251feb HTTP/1.1" 200 None 2026-03-15 13:58:43,479 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 13:58:43,501 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b4180a1727ff69d6f23031 HTTP/1.1" 200 None 2026-03-15 13:58:43,503 - lava_callback - ERROR - Error processing callback for node 69b4180a1727ff69d6f23031: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:54814 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47264 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38028 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38038 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50148 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:50156 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34020 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58366 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40754 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52638 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43878 - "GET / HTTP/1.0" 200 OK 2026-03-15 14:00:03,746 - lava_callback - INFO - Received callback for node 69b4185a1727ff69d6f23039 INFO: 172.21.0.1:43894 - "POST /node/69b4185a1727ff69d6f23039 HTTP/1.0" 202 Accepted 2026-03-15 14:00:03,752 - lava_callback - INFO - Starting async job submit for node 69b4185a1727ff69d6f23039 2026-03-15 14:00:03,753 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 14:00:03,771 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b4185a1727ff69d6f23039 HTTP/1.1" 200 None 2026-03-15 14:00:03,772 - lava_callback - DEBUG - Processing node 69b4185a1727ff69d6f23039: baseline-arm64-clabbe 2026-03-15 14:00:03,772 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b4185a1727ff69d6f23039 2026-03-15 14:00:03,772 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 14:00:03,799 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b4185a1727ff69d6f23039 HTTP/1.1" 200 None 2026-03-15 14:00:03,801 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 14:00:03,815 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b0b5149d19175818251feb HTTP/1.1" 200 None 2026-03-15 14:00:03,816 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 14:00:03,839 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b4185a1727ff69d6f23039 HTTP/1.1" 200 None 2026-03-15 14:00:03,843 - lava_callback - ERROR - Error processing callback for node 69b4185a1727ff69d6f23039: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:43902 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46714 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:46724 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46646 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37330 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43706 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46788 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43820 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43826 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45974 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:45980 - "GET / HTTP/1.0" 200 OK 2026-03-15 14:01:23,575 - lava_callback - INFO - Received callback for node 69b418ae1727ff69d6f23046 INFO: 172.21.0.1:53634 - "POST /node/69b418ae1727ff69d6f23046 HTTP/1.0" 202 Accepted 2026-03-15 14:01:23,581 - lava_callback - INFO - Starting async job submit for node 69b418ae1727ff69d6f23046 2026-03-15 14:01:23,582 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 14:01:23,619 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b418ae1727ff69d6f23046 HTTP/1.1" 200 None 2026-03-15 14:01:23,620 - lava_callback - DEBUG - Processing node 69b418ae1727ff69d6f23046: baseline-arm64-clabbe 2026-03-15 14:01:23,620 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b418ae1727ff69d6f23046 2026-03-15 14:01:23,621 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 14:01:23,633 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b418ae1727ff69d6f23046 HTTP/1.1" 200 None 2026-03-15 14:01:23,635 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 14:01:23,648 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b0b5149d19175818251feb HTTP/1.1" 200 None 2026-03-15 14:01:23,649 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 14:01:23,671 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b418ae1727ff69d6f23046 HTTP/1.1" 200 None 2026-03-15 14:01:23,681 - lava_callback - ERROR - Error processing callback for node 69b418ae1727ff69d6f23046: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:53644 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59020 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42220 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46400 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55222 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55232 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43124 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:43130 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50478 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44784 - "GET / HTTP/1.0" 200 OK 2026-03-15 14:02:43,615 - lava_callback - INFO - Received callback for node 69b418ff1727ff69d6f23051 INFO: 172.21.0.1:39716 - "POST /node/69b418ff1727ff69d6f23051 HTTP/1.0" 202 Accepted 2026-03-15 14:02:43,620 - lava_callback - INFO - Starting async job submit for node 69b418ff1727ff69d6f23051 2026-03-15 14:02:43,621 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 14:02:43,636 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b418ff1727ff69d6f23051 HTTP/1.1" 200 None 2026-03-15 14:02:43,637 - lava_callback - DEBUG - Processing node 69b418ff1727ff69d6f23051: baseline-arm64-clabbe 2026-03-15 14:02:43,637 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b418ff1727ff69d6f23051 2026-03-15 14:02:43,638 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 14:02:43,651 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b418ff1727ff69d6f23051 HTTP/1.1" 200 None 2026-03-15 14:02:43,652 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 14:02:43,672 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b0b5149d19175818251feb HTTP/1.1" 200 None 2026-03-15 14:02:43,674 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 14:02:43,696 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b418ff1727ff69d6f23051 HTTP/1.1" 200 None 2026-03-15 14:02:43,698 - lava_callback - ERROR - Error processing callback for node 69b418ff1727ff69d6f23051: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:39732 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41808 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60156 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60158 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45750 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:45756 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35262 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34742 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41526 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48168 - "GET / HTTP/1.0" 200 OK 2026-03-15 14:04:03,651 - lava_callback - INFO - Received callback for node 69b419501727ff69d6f23059 INFO: 172.21.0.1:55306 - "POST /node/69b419501727ff69d6f23059 HTTP/1.0" 202 Accepted 2026-03-15 14:04:03,656 - lava_callback - INFO - Starting async job submit for node 69b419501727ff69d6f23059 2026-03-15 14:04:03,657 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 14:04:03,689 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b419501727ff69d6f23059 HTTP/1.1" 200 None 2026-03-15 14:04:03,689 - lava_callback - DEBUG - Processing node 69b419501727ff69d6f23059: baseline-arm64-clabbe 2026-03-15 14:04:03,690 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b419501727ff69d6f23059 2026-03-15 14:04:03,690 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 14:04:03,704 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b419501727ff69d6f23059 HTTP/1.1" 200 None 2026-03-15 14:04:03,706 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 14:04:03,731 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b0b5149d19175818251feb HTTP/1.1" 200 None 2026-03-15 14:04:03,733 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 14:04:03,754 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b419501727ff69d6f23059 HTTP/1.1" 200 None 2026-03-15 14:04:03,755 - lava_callback - ERROR - Error processing callback for node 69b419501727ff69d6f23059: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:55320 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55328 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38930 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:38932 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46168 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37524 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47036 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41028 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53146 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53154 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58096 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:58110 - "GET / HTTP/1.0" 200 OK 2026-03-15 14:05:23,762 - lava_callback - INFO - Received callback for node 69b419a11727ff69d6f23064 INFO: 172.21.0.1:33612 - "POST /node/69b419a11727ff69d6f23064 HTTP/1.0" 202 Accepted 2026-03-15 14:05:23,768 - lava_callback - INFO - Starting async job submit for node 69b419a11727ff69d6f23064 2026-03-15 14:05:23,769 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 14:05:23,805 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b419a11727ff69d6f23064 HTTP/1.1" 200 None 2026-03-15 14:05:23,805 - lava_callback - DEBUG - Processing node 69b419a11727ff69d6f23064: baseline-arm64-clabbe 2026-03-15 14:05:23,806 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b419a11727ff69d6f23064 2026-03-15 14:05:23,806 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 14:05:23,820 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b419a11727ff69d6f23064 HTTP/1.1" 200 None 2026-03-15 14:05:23,821 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 14:05:23,859 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b0b5149d19175818251feb HTTP/1.1" 200 None 2026-03-15 14:05:23,860 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 14:05:23,891 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b419a11727ff69d6f23064 HTTP/1.1" 200 None 2026-03-15 14:05:23,893 - lava_callback - ERROR - Error processing callback for node 69b419a11727ff69d6f23064: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:33614 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52698 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40676 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49726 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44894 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44896 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51648 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:51654 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47158 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34604 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43232 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49204 - "GET / HTTP/1.0" 200 OK 2026-03-15 14:07:03,803 - lava_callback - INFO - Received callback for node 69b419f41727ff69d6f23070 INFO: 172.21.0.1:42570 - "POST /node/69b419f41727ff69d6f23070 HTTP/1.0" 202 Accepted 2026-03-15 14:07:03,808 - lava_callback - INFO - Starting async job submit for node 69b419f41727ff69d6f23070 2026-03-15 14:07:03,809 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 14:07:03,824 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b419f41727ff69d6f23070 HTTP/1.1" 200 None 2026-03-15 14:07:03,825 - lava_callback - DEBUG - Processing node 69b419f41727ff69d6f23070: baseline-arm64-clabbe 2026-03-15 14:07:03,825 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b419f41727ff69d6f23070 2026-03-15 14:07:03,825 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 14:07:03,839 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b419f41727ff69d6f23070 HTTP/1.1" 200 None INFO: 172.21.0.1:42582 - "GET / HTTP/1.0" 200 OK 2026-03-15 14:07:03,842 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 14:07:03,878 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b0b5149d19175818251feb HTTP/1.1" 200 None 2026-03-15 14:07:03,879 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 14:07:03,902 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b419f41727ff69d6f23070 HTTP/1.1" 200 None 2026-03-15 14:07:03,910 - lava_callback - ERROR - Error processing callback for node 69b419f41727ff69d6f23070: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:42598 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60300 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:60316 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48552 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57906 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40448 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:32918 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43358 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43366 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35430 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:35434 - "GET / HTTP/1.0" 200 OK 2026-03-15 14:08:23,854 - lava_callback - INFO - Received callback for node 69b41a451727ff69d6f2307c INFO: 172.21.0.1:60414 - "POST /node/69b41a451727ff69d6f2307c HTTP/1.0" 202 Accepted 2026-03-15 14:08:23,862 - lava_callback - INFO - Starting async job submit for node 69b41a451727ff69d6f2307c 2026-03-15 14:08:23,863 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 14:08:23,884 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b41a451727ff69d6f2307c HTTP/1.1" 200 None 2026-03-15 14:08:23,885 - lava_callback - DEBUG - Processing node 69b41a451727ff69d6f2307c: baseline-arm64-clabbe 2026-03-15 14:08:23,885 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b41a451727ff69d6f2307c 2026-03-15 14:08:23,886 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 14:08:23,921 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b41a451727ff69d6f2307c HTTP/1.1" 200 None 2026-03-15 14:08:23,922 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 14:08:23,957 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b0b5149d19175818251feb HTTP/1.1" 200 None 2026-03-15 14:08:23,958 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 14:08:23,989 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b41a451727ff69d6f2307c HTTP/1.1" 200 None 2026-03-15 14:08:23,995 - lava_callback - ERROR - Error processing callback for node 69b41a451727ff69d6f2307c: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:60428 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45742 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59710 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:32880 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35512 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35520 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51610 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:51614 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41312 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40066 - "GET / HTTP/1.0" 200 OK 2026-03-15 14:09:43,906 - lava_callback - INFO - Received callback for node 69b41a921727ff69d6f23083 INFO: 172.21.0.1:34742 - "POST /node/69b41a921727ff69d6f23083 HTTP/1.0" 202 Accepted 2026-03-15 14:09:43,912 - lava_callback - INFO - Starting async job submit for node 69b41a921727ff69d6f23083 2026-03-15 14:09:43,913 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 14:09:43,944 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b41a921727ff69d6f23083 HTTP/1.1" 200 None 2026-03-15 14:09:43,945 - lava_callback - DEBUG - Processing node 69b41a921727ff69d6f23083: baseline-arm64-clabbe 2026-03-15 14:09:43,945 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b41a921727ff69d6f23083 2026-03-15 14:09:43,946 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 14:09:43,968 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b41a921727ff69d6f23083 HTTP/1.1" 200 None 2026-03-15 14:09:43,969 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 14:09:43,994 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b0b5149d19175818251feb HTTP/1.1" 200 None 2026-03-15 14:09:43,996 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 14:09:44,017 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b41a921727ff69d6f23083 HTTP/1.1" 200 None 2026-03-15 14:09:44,022 - lava_callback - ERROR - Error processing callback for node 69b41a921727ff69d6f23083: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:34752 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46792 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46668 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46674 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45906 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:45914 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60688 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57562 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56242 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33816 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54156 - "GET / HTTP/1.0" 200 OK 2026-03-15 14:11:03,958 - lava_callback - INFO - Received callback for node 69b41ae31727ff69d6f23093 INFO: 172.21.0.1:54162 - "POST /node/69b41ae31727ff69d6f23093 HTTP/1.0" 202 Accepted 2026-03-15 14:11:03,964 - lava_callback - INFO - Starting async job submit for node 69b41ae31727ff69d6f23093 2026-03-15 14:11:03,965 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 14:11:03,979 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b41ae31727ff69d6f23093 HTTP/1.1" 200 None 2026-03-15 14:11:03,980 - lava_callback - DEBUG - Processing node 69b41ae31727ff69d6f23093: baseline-arm64-clabbe 2026-03-15 14:11:03,981 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b41ae31727ff69d6f23093 2026-03-15 14:11:03,981 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 14:11:04,004 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b41ae31727ff69d6f23093 HTTP/1.1" 200 None 2026-03-15 14:11:04,005 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 14:11:04,018 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b0b5149d19175818251feb HTTP/1.1" 200 None 2026-03-15 14:11:04,019 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 14:11:04,040 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b41ae31727ff69d6f23093 HTTP/1.1" 200 None 2026-03-15 14:11:04,046 - lava_callback - ERROR - Error processing callback for node 69b41ae31727ff69d6f23093: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:54172 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58444 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:58450 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55296 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53354 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33422 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38204 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47804 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47812 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48436 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:48438 - "GET / HTTP/1.0" 200 OK 2026-03-15 14:12:24,034 - lava_callback - INFO - Received callback for node 69b41b331727ff69d6f230a5 INFO: 172.21.0.1:35504 - "POST /node/69b41b331727ff69d6f230a5 HTTP/1.0" 202 Accepted 2026-03-15 14:12:24,039 - lava_callback - INFO - Starting async job submit for node 69b41b331727ff69d6f230a5 2026-03-15 14:12:24,040 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 14:12:24,065 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b41b331727ff69d6f230a5 HTTP/1.1" 200 None 2026-03-15 14:12:24,066 - lava_callback - DEBUG - Processing node 69b41b331727ff69d6f230a5: baseline-arm64-clabbe 2026-03-15 14:12:24,067 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b41b331727ff69d6f230a5 2026-03-15 14:12:24,067 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 14:12:24,081 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b41b331727ff69d6f230a5 HTTP/1.1" 200 None 2026-03-15 14:12:24,082 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 14:12:24,096 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b0b5149d19175818251feb HTTP/1.1" 200 None 2026-03-15 14:12:24,097 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 14:12:24,132 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b41b331727ff69d6f230a5 HTTP/1.1" 200 None 2026-03-15 14:12:24,139 - lava_callback - ERROR - Error processing callback for node 69b41b331727ff69d6f230a5: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:35508 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50162 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37888 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53674 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39740 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39744 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33402 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:33414 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41092 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43220 - "GET / HTTP/1.0" 200 OK 2026-03-15 14:13:44,097 - lava_callback - INFO - Received callback for node 69b41b851727ff69d6f230ad INFO: 172.21.0.1:40748 - "POST /node/69b41b851727ff69d6f230ad HTTP/1.0" 202 Accepted 2026-03-15 14:13:44,102 - lava_callback - INFO - Starting async job submit for node 69b41b851727ff69d6f230ad 2026-03-15 14:13:44,103 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 14:13:44,120 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b41b851727ff69d6f230ad HTTP/1.1" 200 None 2026-03-15 14:13:44,121 - lava_callback - DEBUG - Processing node 69b41b851727ff69d6f230ad: baseline-arm64-clabbe 2026-03-15 14:13:44,121 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b41b851727ff69d6f230ad 2026-03-15 14:13:44,122 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 14:13:44,147 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b41b851727ff69d6f230ad HTTP/1.1" 200 None 2026-03-15 14:13:44,149 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 14:13:44,163 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b0b5149d19175818251feb HTTP/1.1" 200 None 2026-03-15 14:13:44,164 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 14:13:44,204 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b41b851727ff69d6f230ad HTTP/1.1" 200 None 2026-03-15 14:13:44,205 - lava_callback - ERROR - Error processing callback for node 69b41b851727ff69d6f230ad: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:40756 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43634 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59398 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59400 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35974 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:35980 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58204 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55310 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52248 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33064 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60854 - "GET / HTTP/1.0" 200 OK 2026-03-15 14:15:04,130 - lava_callback - INFO - Received callback for node 69b41bd61727ff69d6f230b6 INFO: 172.21.0.1:60868 - "POST /node/69b41bd61727ff69d6f230b6 HTTP/1.0" 202 Accepted 2026-03-15 14:15:04,136 - lava_callback - INFO - Starting async job submit for node 69b41bd61727ff69d6f230b6 2026-03-15 14:15:04,137 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 14:15:04,171 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b41bd61727ff69d6f230b6 HTTP/1.1" 200 None 2026-03-15 14:15:04,171 - lava_callback - DEBUG - Processing node 69b41bd61727ff69d6f230b6: baseline-arm64-clabbe 2026-03-15 14:15:04,172 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b41bd61727ff69d6f230b6 2026-03-15 14:15:04,172 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 14:15:04,194 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b41bd61727ff69d6f230b6 HTTP/1.1" 200 None 2026-03-15 14:15:04,196 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 14:15:04,212 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b0b5149d19175818251feb HTTP/1.1" 200 None 2026-03-15 14:15:04,214 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 14:15:04,243 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b41bd61727ff69d6f230b6 HTTP/1.1" 200 None 2026-03-15 14:15:04,245 - lava_callback - ERROR - Error processing callback for node 69b41bd61727ff69d6f230b6: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:60878 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45622 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:45638 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52358 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:32786 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48464 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55910 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51862 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51872 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53002 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:53014 - "GET / HTTP/1.0" 200 OK 2026-03-15 14:16:24,159 - lava_callback - INFO - Received callback for node 69b41c271727ff69d6f230bf INFO: 172.21.0.1:59830 - "POST /node/69b41c271727ff69d6f230bf HTTP/1.0" 202 Accepted 2026-03-15 14:16:24,165 - lava_callback - INFO - Starting async job submit for node 69b41c271727ff69d6f230bf 2026-03-15 14:16:24,166 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 14:16:24,200 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b41c271727ff69d6f230bf HTTP/1.1" 200 None 2026-03-15 14:16:24,201 - lava_callback - DEBUG - Processing node 69b41c271727ff69d6f230bf: baseline-arm64-clabbe 2026-03-15 14:16:24,202 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b41c271727ff69d6f230bf 2026-03-15 14:16:24,202 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 14:16:24,223 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b41c271727ff69d6f230bf HTTP/1.1" 200 None 2026-03-15 14:16:24,224 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 14:16:24,262 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b0b5149d19175818251feb HTTP/1.1" 200 None 2026-03-15 14:16:24,263 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 14:16:24,302 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b41c271727ff69d6f230bf HTTP/1.1" 200 None 2026-03-15 14:16:24,303 - lava_callback - ERROR - Error processing callback for node 69b41c271727ff69d6f230bf: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:59844 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36502 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42530 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49938 - "GET /robots.txt HTTP/1.0" 404 Not Found INFO: 172.21.0.1:49950 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36696 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36698 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40224 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:40238 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53334 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43662 - "GET / HTTP/1.0" 200 OK 2026-03-15 14:17:44,227 - lava_callback - INFO - Received callback for node 69b41c7b1727ff69d6f230c6 INFO: 172.21.0.1:43780 - "POST /node/69b41c7b1727ff69d6f230c6 HTTP/1.0" 202 Accepted 2026-03-15 14:17:44,232 - lava_callback - INFO - Starting async job submit for node 69b41c7b1727ff69d6f230c6 2026-03-15 14:17:44,233 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 14:17:44,248 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b41c7b1727ff69d6f230c6 HTTP/1.1" 200 None 2026-03-15 14:17:44,249 - lava_callback - DEBUG - Processing node 69b41c7b1727ff69d6f230c6: baseline-arm64-clabbe 2026-03-15 14:17:44,249 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b41c7b1727ff69d6f230c6 2026-03-15 14:17:44,250 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 14:17:44,263 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b41c7b1727ff69d6f230c6 HTTP/1.1" 200 None 2026-03-15 14:17:44,264 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 14:17:44,277 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b0b5149d19175818251feb HTTP/1.1" 200 None 2026-03-15 14:17:44,279 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 14:17:44,300 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b41c7b1727ff69d6f230c6 HTTP/1.1" 200 None 2026-03-15 14:17:44,306 - lava_callback - ERROR - Error processing callback for node 69b41c7b1727ff69d6f230c6: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:43792 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36976 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47670 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47678 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38270 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:38284 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34840 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51878 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48646 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49070 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39238 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39248 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55910 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:55924 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40736 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52776 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56838 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40480 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54396 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54398 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34230 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:34238 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55852 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42410 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46042 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51250 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46840 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46848 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33366 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:33370 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58112 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46652 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60716 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43996 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45880 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45896 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49056 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:49062 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36144 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59538 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53238 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58330 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33306 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33312 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39230 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:39242 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51696 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60374 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41418 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36698 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55110 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55118 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41618 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:41634 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47016 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45220 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37838 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54130 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52282 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52290 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38700 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:38704 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59978 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33214 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60700 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33550 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35912 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35918 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37738 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:37746 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51320 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37832 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57942 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36814 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58024 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58036 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48760 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:48776 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33300 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44794 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54102 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54806 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53110 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53126 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39794 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:39800 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45872 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50220 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60104 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42346 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33122 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33126 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59622 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:59628 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50704 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33154 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54172 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41796 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54682 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54698 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36248 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:36258 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49314 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45810 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38070 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35480 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48140 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48146 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55720 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:55730 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47252 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44658 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36116 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55394 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48364 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48378 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50288 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:50296 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50482 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42336 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35098 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52470 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36600 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36614 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55574 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:55588 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58840 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38994 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48124 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46682 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39324 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39336 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38744 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:38758 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60818 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48386 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41162 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44876 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58430 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58434 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53892 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:53906 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60404 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48820 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39200 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55240 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49332 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49346 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55718 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:55734 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58592 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33580 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35472 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58996 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35272 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35282 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38286 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:38288 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59712 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45658 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51036 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50114 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37088 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37094 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35074 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:35076 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48958 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52518 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39370 - "GET / HTTP/1.0" 200 OK 2026-03-15 14:38:49,089 - lava_callback - INFO - Received callback for node 69b421661727ff69d6f23122 INFO: 172.21.0.1:39382 - "POST /node/69b421661727ff69d6f23122 HTTP/1.0" 202 Accepted 2026-03-15 14:38:49,095 - lava_callback - INFO - Starting async job submit for node 69b421661727ff69d6f23122 2026-03-15 14:38:49,096 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 14:38:49,115 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b421661727ff69d6f23122 HTTP/1.1" 200 None 2026-03-15 14:38:49,116 - lava_callback - DEBUG - Processing node 69b421661727ff69d6f23122: baseline-arm-baylibre 2026-03-15 14:38:49,116 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b421661727ff69d6f23122 2026-03-15 14:38:49,116 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 14:38:49,130 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b421661727ff69d6f23122 HTTP/1.1" 200 None 2026-03-15 14:38:49,131 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 14:38:49,153 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b3c7f91727ff69d6f21d89 HTTP/1.1" 200 None 2026-03-15 14:38:49,155 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 14:38:49,175 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b421661727ff69d6f23122 HTTP/1.1" 200 None 2026-03-15 14:38:49,181 - lava_callback - ERROR - Error processing callback for node 69b421661727ff69d6f23122: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:45108 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40164 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40174 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54156 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:54164 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41406 - "GET / HTTP/1.0" 200 OK 2026-03-15 14:39:28,982 - lava_callback - INFO - Received callback for node 69b4218d1727ff69d6f2312b INFO: 172.21.0.1:41410 - "POST /node/69b4218d1727ff69d6f2312b HTTP/1.0" 202 Accepted 2026-03-15 14:39:28,992 - lava_callback - INFO - Starting async job submit for node 69b4218d1727ff69d6f2312b 2026-03-15 14:39:28,993 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 14:39:29,013 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b4218d1727ff69d6f2312b HTTP/1.1" 200 None 2026-03-15 14:39:29,015 - lava_callback - DEBUG - Processing node 69b4218d1727ff69d6f2312b: baseline-arm-baylibre 2026-03-15 14:39:29,015 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b4218d1727ff69d6f2312b 2026-03-15 14:39:29,016 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 14:39:29,030 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b4218d1727ff69d6f2312b HTTP/1.1" 200 None 2026-03-15 14:39:29,032 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 14:39:29,058 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b3c7f91727ff69d6f21d89 HTTP/1.1" 200 None 2026-03-15 14:39:29,061 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 14:39:29,085 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b4218d1727ff69d6f2312b HTTP/1.1" 200 None 2026-03-15 14:39:29,087 - lava_callback - ERROR - Error processing callback for node 69b4218d1727ff69d6f2312b: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:39528 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44230 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37848 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39670 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39680 - "GET / HTTP/1.0" 200 OK 2026-03-15 14:40:09,056 - lava_callback - INFO - Received callback for node 69b421b41727ff69d6f23135 INFO: 172.21.0.1:39694 - "POST /node/69b421b41727ff69d6f23135 HTTP/1.0" 202 Accepted 2026-03-15 14:40:09,061 - lava_callback - INFO - Starting async job submit for node 69b421b41727ff69d6f23135 2026-03-15 14:40:09,062 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 14:40:09,076 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b421b41727ff69d6f23135 HTTP/1.1" 200 None 2026-03-15 14:40:09,077 - lava_callback - DEBUG - Processing node 69b421b41727ff69d6f23135: baseline-arm-baylibre 2026-03-15 14:40:09,077 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b421b41727ff69d6f23135 2026-03-15 14:40:09,078 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 14:40:09,101 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b421b41727ff69d6f23135 HTTP/1.1" 200 None 2026-03-15 14:40:09,103 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 14:40:09,116 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b3c7f91727ff69d6f21d89 HTTP/1.1" 200 None 2026-03-15 14:40:09,118 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 14:40:09,142 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b421b41727ff69d6f23135 HTTP/1.1" 200 None 2026-03-15 14:40:09,144 - lava_callback - ERROR - Error processing callback for node 69b421b41727ff69d6f23135: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:40008 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:40018 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60398 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56006 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60620 - "GET / HTTP/1.0" 200 OK 2026-03-15 14:40:49,039 - lava_callback - INFO - Received callback for node 69b421de1727ff69d6f2313e INFO: 172.21.0.1:60626 - "POST /node/69b421de1727ff69d6f2313e HTTP/1.0" 202 Accepted 2026-03-15 14:40:49,045 - lava_callback - INFO - Starting async job submit for node 69b421de1727ff69d6f2313e 2026-03-15 14:40:49,045 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 14:40:49,061 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b421de1727ff69d6f2313e HTTP/1.1" 200 None 2026-03-15 14:40:49,062 - lava_callback - DEBUG - Processing node 69b421de1727ff69d6f2313e: baseline-arm-baylibre 2026-03-15 14:40:49,062 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b421de1727ff69d6f2313e 2026-03-15 14:40:49,063 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 14:40:49,077 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b421de1727ff69d6f2313e HTTP/1.1" 200 None 2026-03-15 14:40:49,078 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 14:40:49,095 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b3c7f91727ff69d6f21d89 HTTP/1.1" 200 None 2026-03-15 14:40:49,096 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 14:40:49,116 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b421de1727ff69d6f2313e HTTP/1.1" 200 None 2026-03-15 14:40:49,122 - lava_callback - ERROR - Error processing callback for node 69b421de1727ff69d6f2313e: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:49162 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43824 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43834 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48406 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:48416 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40184 - "GET / HTTP/1.0" 200 OK 2026-03-15 14:41:29,128 - lava_callback - INFO - Received callback for node 69b422061727ff69d6f23147 INFO: 172.21.0.1:40200 - "POST /node/69b422061727ff69d6f23147 HTTP/1.0" 202 Accepted 2026-03-15 14:41:29,134 - lava_callback - INFO - Starting async job submit for node 69b422061727ff69d6f23147 2026-03-15 14:41:29,135 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 14:41:29,149 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b422061727ff69d6f23147 HTTP/1.1" 200 None 2026-03-15 14:41:29,150 - lava_callback - DEBUG - Processing node 69b422061727ff69d6f23147: baseline-arm-baylibre 2026-03-15 14:41:29,150 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b422061727ff69d6f23147 2026-03-15 14:41:29,151 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 14:41:29,173 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b422061727ff69d6f23147 HTTP/1.1" 200 None 2026-03-15 14:41:29,175 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 14:41:29,188 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b3c7f91727ff69d6f21d89 HTTP/1.1" 200 None 2026-03-15 14:41:29,189 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 14:41:29,215 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b422061727ff69d6f23147 HTTP/1.1" 200 None 2026-03-15 14:41:29,218 - lava_callback - ERROR - Error processing callback for node 69b422061727ff69d6f23147: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:52298 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49424 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55350 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55388 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55400 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49566 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:49582 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34050 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36100 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38224 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50850 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40364 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40372 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36110 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:36126 - "GET / HTTP/1.0" 200 OK 2026-03-15 14:43:25,401 - lava_callback - INFO - Received callback for node 69b4227d1727ff69d6f23163 INFO: 172.21.0.1:41572 - "POST /node/69b4227d1727ff69d6f23163 HTTP/1.0" 202 Accepted 2026-03-15 14:43:25,407 - lava_callback - INFO - Starting async job submit for node 69b4227d1727ff69d6f23163 2026-03-15 14:43:25,408 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 14:43:25,427 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b4227d1727ff69d6f23163 HTTP/1.1" 200 None 2026-03-15 14:43:25,428 - lava_callback - DEBUG - Processing node 69b4227d1727ff69d6f23163: baseline-arm-clabbe 2026-03-15 14:43:25,428 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b4227d1727ff69d6f23163 2026-03-15 14:43:25,429 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 14:43:25,443 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b4227d1727ff69d6f23163 HTTP/1.1" 200 None 2026-03-15 14:43:25,445 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 14:43:25,469 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b3c7f91727ff69d6f21d89 HTTP/1.1" 200 None 2026-03-15 14:43:25,470 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 14:43:25,491 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b4227d1727ff69d6f23163 HTTP/1.1" 200 None 2026-03-15 14:43:25,493 - lava_callback - ERROR - Error processing callback for node 69b4227d1727ff69d6f23163: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:41574 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34798 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43130 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34158 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51524 - "GET / HTTP/1.0" 200 OK 2026-03-15 14:44:05,388 - lava_callback - INFO - Received callback for node 69b422a41727ff69d6f2316b INFO: 172.21.0.1:51536 - "POST /node/69b422a41727ff69d6f2316b HTTP/1.0" 202 Accepted 2026-03-15 14:44:05,394 - lava_callback - INFO - Starting async job submit for node 69b422a41727ff69d6f2316b 2026-03-15 14:44:05,395 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 14:44:05,409 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b422a41727ff69d6f2316b HTTP/1.1" 200 None 2026-03-15 14:44:05,410 - lava_callback - DEBUG - Processing node 69b422a41727ff69d6f2316b: baseline-arm-clabbe 2026-03-15 14:44:05,411 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b422a41727ff69d6f2316b 2026-03-15 14:44:05,411 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 14:44:05,429 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b422a41727ff69d6f2316b HTTP/1.1" 200 None 2026-03-15 14:44:05,431 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 14:44:05,444 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b3c7f91727ff69d6f21d89 HTTP/1.1" 200 None 2026-03-15 14:44:05,446 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 14:44:05,466 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b422a41727ff69d6f2316b HTTP/1.1" 200 None 2026-03-15 14:44:05,468 - lava_callback - ERROR - Error processing callback for node 69b422a41727ff69d6f2316b: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:51538 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38406 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:38414 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59664 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53882 - "GET / HTTP/1.0" 200 OK 2026-03-15 14:44:45,427 - lava_callback - INFO - Received callback for node 69b422cc1727ff69d6f23174 INFO: 172.21.0.1:34376 - "POST /node/69b422cc1727ff69d6f23174 HTTP/1.0" 202 Accepted 2026-03-15 14:44:45,433 - lava_callback - INFO - Starting async job submit for node 69b422cc1727ff69d6f23174 2026-03-15 14:44:45,434 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 14:44:45,448 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b422cc1727ff69d6f23174 HTTP/1.1" 200 None 2026-03-15 14:44:45,449 - lava_callback - DEBUG - Processing node 69b422cc1727ff69d6f23174: baseline-arm-clabbe 2026-03-15 14:44:45,449 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b422cc1727ff69d6f23174 2026-03-15 14:44:45,450 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 14:44:45,462 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b422cc1727ff69d6f23174 HTTP/1.1" 200 None 2026-03-15 14:44:45,464 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 14:44:45,487 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b3c7f91727ff69d6f21d89 HTTP/1.1" 200 None 2026-03-15 14:44:45,488 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 14:44:45,509 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b422cc1727ff69d6f23174 HTTP/1.1" 200 None 2026-03-15 14:44:45,510 - lava_callback - ERROR - Error processing callback for node 69b422cc1727ff69d6f23174: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:34380 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50874 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37786 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37788 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39474 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:39490 - "GET / HTTP/1.0" 200 OK 2026-03-15 14:45:25,436 - lava_callback - INFO - Received callback for node 69b422f41727ff69d6f23183 INFO: 172.21.0.1:45004 - "POST /node/69b422f41727ff69d6f23183 HTTP/1.0" 202 Accepted 2026-03-15 14:45:25,441 - lava_callback - INFO - Starting async job submit for node 69b422f41727ff69d6f23183 2026-03-15 14:45:25,442 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 14:45:25,457 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b422f41727ff69d6f23183 HTTP/1.1" 200 None 2026-03-15 14:45:25,458 - lava_callback - DEBUG - Processing node 69b422f41727ff69d6f23183: baseline-arm-clabbe 2026-03-15 14:45:25,458 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b422f41727ff69d6f23183 2026-03-15 14:45:25,459 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 14:45:25,472 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b422f41727ff69d6f23183 HTTP/1.1" 200 None 2026-03-15 14:45:25,473 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 14:45:25,491 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b3c7f91727ff69d6f21d89 HTTP/1.1" 200 None 2026-03-15 14:45:25,493 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 14:45:25,514 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b422f41727ff69d6f23183 HTTP/1.1" 200 None 2026-03-15 14:45:25,516 - lava_callback - ERROR - Error processing callback for node 69b422f41727ff69d6f23183: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:45014 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37180 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60246 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39264 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37784 - "GET / HTTP/1.0" 200 OK 2026-03-15 14:46:05,490 - lava_callback - INFO - Received callback for node 69b4231b1727ff69d6f2318c INFO: 172.21.0.1:37790 - "POST /node/69b4231b1727ff69d6f2318c HTTP/1.0" 202 Accepted 2026-03-15 14:46:05,495 - lava_callback - INFO - Starting async job submit for node 69b4231b1727ff69d6f2318c 2026-03-15 14:46:05,497 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 14:46:05,511 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b4231b1727ff69d6f2318c HTTP/1.1" 200 None 2026-03-15 14:46:05,512 - lava_callback - DEBUG - Processing node 69b4231b1727ff69d6f2318c: baseline-arm-clabbe 2026-03-15 14:46:05,512 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b4231b1727ff69d6f2318c 2026-03-15 14:46:05,513 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 14:46:05,526 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b4231b1727ff69d6f2318c HTTP/1.1" 200 None 2026-03-15 14:46:05,528 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 14:46:05,564 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b3c7f91727ff69d6f21d89 HTTP/1.1" 200 None 2026-03-15 14:46:05,565 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 14:46:05,607 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b4231b1727ff69d6f2318c HTTP/1.1" 200 None 2026-03-15 14:46:05,612 - lava_callback - ERROR - Error processing callback for node 69b4231b1727ff69d6f2318c: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:37796 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55488 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:55492 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60982 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42994 - "GET / HTTP/1.0" 200 OK 2026-03-15 14:46:45,472 - lava_callback - INFO - Received callback for node 69b423411727ff69d6f23198 INFO: 172.21.0.1:49372 - "POST /node/69b423411727ff69d6f23198 HTTP/1.0" 202 Accepted 2026-03-15 14:46:45,478 - lava_callback - INFO - Starting async job submit for node 69b423411727ff69d6f23198 2026-03-15 14:46:45,478 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 14:46:45,493 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b423411727ff69d6f23198 HTTP/1.1" 200 None 2026-03-15 14:46:45,494 - lava_callback - DEBUG - Processing node 69b423411727ff69d6f23198: baseline-arm-clabbe 2026-03-15 14:46:45,494 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b423411727ff69d6f23198 2026-03-15 14:46:45,495 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 14:46:45,509 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b423411727ff69d6f23198 HTTP/1.1" 200 None 2026-03-15 14:46:45,510 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 14:46:45,526 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b12591a870a1dc3343ba82 HTTP/1.1" 200 None 2026-03-15 14:46:45,527 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 14:46:45,548 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b423411727ff69d6f23198 HTTP/1.1" 200 None 2026-03-15 14:46:45,550 - lava_callback - ERROR - Error processing callback for node 69b423411727ff69d6f23198: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:49384 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57310 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56736 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56746 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55524 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:55538 - "GET / HTTP/1.0" 200 OK 2026-03-15 14:47:25,513 - lava_callback - INFO - Received callback for node 69b4236a1727ff69d6f231a5 INFO: 172.21.0.1:50960 - "POST /node/69b4236a1727ff69d6f231a5 HTTP/1.0" 202 Accepted 2026-03-15 14:47:25,519 - lava_callback - INFO - Starting async job submit for node 69b4236a1727ff69d6f231a5 2026-03-15 14:47:25,520 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 14:47:25,536 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b4236a1727ff69d6f231a5 HTTP/1.1" 200 None 2026-03-15 14:47:25,537 - lava_callback - DEBUG - Processing node 69b4236a1727ff69d6f231a5: baseline-arm-clabbe 2026-03-15 14:47:25,537 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b4236a1727ff69d6f231a5 2026-03-15 14:47:25,538 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 14:47:25,552 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b4236a1727ff69d6f231a5 HTTP/1.1" 200 None 2026-03-15 14:47:25,554 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 14:47:25,568 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b12591a870a1dc3343ba82 HTTP/1.1" 200 None 2026-03-15 14:47:25,570 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 14:47:25,591 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b4236a1727ff69d6f231a5 HTTP/1.1" 200 None 2026-03-15 14:47:25,593 - lava_callback - ERROR - Error processing callback for node 69b4236a1727ff69d6f231a5: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:50968 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40676 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43350 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40846 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42144 - "GET / HTTP/1.0" 200 OK 2026-03-15 14:48:05,530 - lava_callback - INFO - Received callback for node 69b423911727ff69d6f231ad INFO: 172.21.0.1:42146 - "POST /node/69b423911727ff69d6f231ad HTTP/1.0" 202 Accepted 2026-03-15 14:48:05,536 - lava_callback - INFO - Starting async job submit for node 69b423911727ff69d6f231ad 2026-03-15 14:48:05,537 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 14:48:05,551 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b423911727ff69d6f231ad HTTP/1.1" 200 None 2026-03-15 14:48:05,552 - lava_callback - DEBUG - Processing node 69b423911727ff69d6f231ad: baseline-arm-clabbe 2026-03-15 14:48:05,552 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b423911727ff69d6f231ad 2026-03-15 14:48:05,553 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 14:48:05,567 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b423911727ff69d6f231ad HTTP/1.1" 200 None 2026-03-15 14:48:05,568 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 14:48:05,609 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b12591a870a1dc3343ba82 HTTP/1.1" 200 None 2026-03-15 14:48:05,611 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 14:48:05,632 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b423911727ff69d6f231ad HTTP/1.1" 200 None 2026-03-15 14:48:05,636 - lava_callback - ERROR - Error processing callback for node 69b423911727ff69d6f231ad: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:42158 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59402 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:59412 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33022 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42276 - "GET / HTTP/1.0" 200 OK 2026-03-15 14:48:45,589 - lava_callback - INFO - Received callback for node 69b423b91727ff69d6f231bb INFO: 172.21.0.1:48476 - "POST /node/69b423b91727ff69d6f231bb HTTP/1.0" 202 Accepted 2026-03-15 14:48:45,594 - lava_callback - INFO - Starting async job submit for node 69b423b91727ff69d6f231bb 2026-03-15 14:48:45,595 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 14:48:45,613 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b423b91727ff69d6f231bb HTTP/1.1" 200 None 2026-03-15 14:48:45,613 - lava_callback - DEBUG - Processing node 69b423b91727ff69d6f231bb: baseline-arm-clabbe 2026-03-15 14:48:45,614 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b423b91727ff69d6f231bb 2026-03-15 14:48:45,614 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 14:48:45,629 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b423b91727ff69d6f231bb HTTP/1.1" 200 None 2026-03-15 14:48:45,631 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 14:48:45,644 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b12591a870a1dc3343ba82 HTTP/1.1" 200 None 2026-03-15 14:48:45,646 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 14:48:45,669 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b423b91727ff69d6f231bb HTTP/1.1" 200 None 2026-03-15 14:48:45,673 - lava_callback - ERROR - Error processing callback for node 69b423b91727ff69d6f231bb: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:48490 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37734 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33214 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33218 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36310 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:36326 - "GET / HTTP/1.0" 200 OK 2026-03-15 14:49:25,588 - lava_callback - INFO - Received callback for node 69b423e01727ff69d6f231c6 INFO: 172.21.0.1:42580 - "POST /node/69b423e01727ff69d6f231c6 HTTP/1.0" 202 Accepted 2026-03-15 14:49:25,593 - lava_callback - INFO - Starting async job submit for node 69b423e01727ff69d6f231c6 2026-03-15 14:49:25,594 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 14:49:25,608 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b423e01727ff69d6f231c6 HTTP/1.1" 200 None 2026-03-15 14:49:25,609 - lava_callback - DEBUG - Processing node 69b423e01727ff69d6f231c6: baseline-arm-clabbe 2026-03-15 14:49:25,609 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b423e01727ff69d6f231c6 2026-03-15 14:49:25,610 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 14:49:25,632 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b423e01727ff69d6f231c6 HTTP/1.1" 200 None 2026-03-15 14:49:25,634 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 14:49:25,650 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b12591a870a1dc3343ba82 HTTP/1.1" 200 None 2026-03-15 14:49:25,652 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 14:49:25,673 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b423e01727ff69d6f231c6 HTTP/1.1" 200 None 2026-03-15 14:49:25,678 - lava_callback - ERROR - Error processing callback for node 69b423e01727ff69d6f231c6: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:42582 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38768 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46094 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47666 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42504 - "GET / HTTP/1.0" 200 OK 2026-03-15 14:50:05,645 - lava_callback - INFO - Received callback for node 69b424071727ff69d6f231cf INFO: 172.21.0.1:42512 - "POST /node/69b424071727ff69d6f231cf HTTP/1.0" 202 Accepted 2026-03-15 14:50:05,650 - lava_callback - INFO - Starting async job submit for node 69b424071727ff69d6f231cf 2026-03-15 14:50:05,651 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 14:50:05,666 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b424071727ff69d6f231cf HTTP/1.1" 200 None 2026-03-15 14:50:05,667 - lava_callback - DEBUG - Processing node 69b424071727ff69d6f231cf: baseline-arm-clabbe 2026-03-15 14:50:05,667 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b424071727ff69d6f231cf 2026-03-15 14:50:05,668 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 14:50:05,687 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b424071727ff69d6f231cf HTTP/1.1" 200 None 2026-03-15 14:50:05,688 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 14:50:05,702 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b12591a870a1dc3343ba82 HTTP/1.1" 200 None 2026-03-15 14:50:05,703 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 14:50:05,724 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b424071727ff69d6f231cf HTTP/1.1" 200 None 2026-03-15 14:50:05,725 - lava_callback - ERROR - Error processing callback for node 69b424071727ff69d6f231cf: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:42518 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47248 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:47254 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50280 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50690 - "GET / HTTP/1.0" 200 OK 2026-03-15 14:50:45,629 - lava_callback - INFO - Received callback for node 69b4242f1727ff69d6f231da INFO: 172.21.0.1:55534 - "POST /node/69b4242f1727ff69d6f231da HTTP/1.0" 202 Accepted 2026-03-15 14:50:45,636 - lava_callback - INFO - Starting async job submit for node 69b4242f1727ff69d6f231da 2026-03-15 14:50:45,637 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 14:50:45,661 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b4242f1727ff69d6f231da HTTP/1.1" 200 None 2026-03-15 14:50:45,662 - lava_callback - DEBUG - Processing node 69b4242f1727ff69d6f231da: baseline-arm-clabbe 2026-03-15 14:50:45,662 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b4242f1727ff69d6f231da 2026-03-15 14:50:45,663 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 14:50:45,676 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b4242f1727ff69d6f231da HTTP/1.1" 200 None 2026-03-15 14:50:45,678 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 14:50:45,691 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b12591a870a1dc3343ba82 HTTP/1.1" 200 None 2026-03-15 14:50:45,693 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 14:50:45,714 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b4242f1727ff69d6f231da HTTP/1.1" 200 None 2026-03-15 14:50:45,719 - lava_callback - ERROR - Error processing callback for node 69b4242f1727ff69d6f231da: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:55544 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43014 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56170 - "GET / HTTP/1.0" 200 OK 2026-03-15 14:51:05,666 - lava_callback - INFO - Received callback for node 69b424561727ff69d6f231f5 INFO: 172.21.0.1:56176 - "POST /node/69b424561727ff69d6f231f5 HTTP/1.0" 202 Accepted 2026-03-15 14:51:05,672 - lava_callback - INFO - Starting async job submit for node 69b424561727ff69d6f231f5 2026-03-15 14:51:05,673 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 14:51:05,687 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b424561727ff69d6f231f5 HTTP/1.1" 200 None 2026-03-15 14:51:05,688 - lava_callback - DEBUG - Processing node 69b424561727ff69d6f231f5: baseline-arm-clabbe 2026-03-15 14:51:05,688 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b424561727ff69d6f231f5 2026-03-15 14:51:05,689 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 14:51:05,702 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b424561727ff69d6f231f5 HTTP/1.1" 200 None 2026-03-15 14:51:05,703 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 14:51:05,716 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b12591a870a1dc3343ba82 HTTP/1.1" 200 None 2026-03-15 14:51:05,718 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 14:51:05,737 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b424561727ff69d6f231f5 HTTP/1.1" 200 None 2026-03-15 14:51:05,746 - lava_callback - ERROR - Error processing callback for node 69b424561727ff69d6f231f5: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:56178 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50384 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:50394 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33848 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49584 - "GET / HTTP/1.0" 200 OK 2026-03-15 14:51:45,661 - lava_callback - INFO - Received callback for node 69b4247d1727ff69d6f23208 INFO: 172.21.0.1:47398 - "POST /node/69b4247d1727ff69d6f23208 HTTP/1.0" 202 Accepted 2026-03-15 14:51:45,667 - lava_callback - INFO - Starting async job submit for node 69b4247d1727ff69d6f23208 2026-03-15 14:51:45,667 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 14:51:45,693 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b4247d1727ff69d6f23208 HTTP/1.1" 200 None 2026-03-15 14:51:45,694 - lava_callback - DEBUG - Processing node 69b4247d1727ff69d6f23208: baseline-arm-clabbe 2026-03-15 14:51:45,694 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b4247d1727ff69d6f23208 2026-03-15 14:51:45,695 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 14:51:45,729 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b4247d1727ff69d6f23208 HTTP/1.1" 200 None 2026-03-15 14:51:45,731 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 14:51:45,752 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b12591a870a1dc3343ba82 HTTP/1.1" 200 None 2026-03-15 14:51:45,753 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 14:51:45,777 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b4247d1727ff69d6f23208 HTTP/1.1" 200 None 2026-03-15 14:51:45,779 - lava_callback - ERROR - Error processing callback for node 69b4247d1727ff69d6f23208: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:47404 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49816 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44026 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44042 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44682 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:44688 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53792 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57392 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38680 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41604 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48526 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48530 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55042 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:55054 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56204 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43416 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58664 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58100 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33316 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33330 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34446 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:34462 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44586 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45100 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56150 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37860 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60712 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60722 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43912 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:43924 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55594 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53438 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40572 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44896 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51998 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52012 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47654 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:47664 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49076 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56202 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59308 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59888 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35628 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35642 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38434 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:38450 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34988 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37966 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38446 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55482 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55710 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55724 - "GET / HTTP/1.0" 200 OK 2026-03-15 14:58:10,183 - lava_callback - INFO - Received callback for node 69b425f21727ff69d6f23252 INFO: 172.21.0.1:58018 - "POST /node/69b425f21727ff69d6f23252 HTTP/1.0" 202 Accepted 2026-03-15 14:58:10,189 - lava_callback - INFO - Starting async job submit for node 69b425f21727ff69d6f23252 2026-03-15 14:58:10,190 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 14:58:10,204 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b425f21727ff69d6f23252 HTTP/1.1" 200 None 2026-03-15 14:58:10,205 - lava_callback - DEBUG - Processing node 69b425f21727ff69d6f23252: baseline-arm64-baylibre 2026-03-15 14:58:10,205 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b425f21727ff69d6f23252 2026-03-15 14:58:10,206 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 14:58:10,218 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b425f21727ff69d6f23252 HTTP/1.1" 200 None 2026-03-15 14:58:10,220 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 14:58:10,235 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b3c8061727ff69d6f21d98 HTTP/1.1" 200 None 2026-03-15 14:58:10,236 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 14:58:10,260 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b425f21727ff69d6f23252 HTTP/1.1" 200 None 2026-03-15 14:58:10,262 - lava_callback - ERROR - Error processing callback for node 69b425f21727ff69d6f23252: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:58026 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:58032 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43762 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56408 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41258 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34034 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33438 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33454 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34402 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:34414 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55840 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55842 - "GET / HTTP/1.0" 200 OK 2026-03-15 14:59:30,127 - lava_callback - INFO - Received callback for node 69b426451727ff69d6f2325b INFO: 172.21.0.1:46036 - "POST /node/69b426451727ff69d6f2325b HTTP/1.0" 202 Accepted 2026-03-15 14:59:30,133 - lava_callback - INFO - Starting async job submit for node 69b426451727ff69d6f2325b 2026-03-15 14:59:30,134 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 14:59:30,148 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b426451727ff69d6f2325b HTTP/1.1" 200 None 2026-03-15 14:59:30,149 - lava_callback - DEBUG - Processing node 69b426451727ff69d6f2325b: baseline-arm64-baylibre 2026-03-15 14:59:30,149 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b426451727ff69d6f2325b 2026-03-15 14:59:30,150 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 14:59:30,164 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b426451727ff69d6f2325b HTTP/1.1" 200 None 2026-03-15 14:59:30,165 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 14:59:30,181 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b3c8061727ff69d6f21d98 HTTP/1.1" 200 None 2026-03-15 14:59:30,183 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 14:59:30,206 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b426451727ff69d6f2325b HTTP/1.1" 200 None 2026-03-15 14:59:30,212 - lava_callback - ERROR - Error processing callback for node 69b426451727ff69d6f2325b: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:46038 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54342 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54718 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33844 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33848 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48782 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:48784 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54432 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48194 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47384 - "GET / HTTP/1.0" 200 OK 2026-03-15 15:00:50,148 - lava_callback - INFO - Received callback for node 69b426991727ff69d6f23266 INFO: 172.21.0.1:56196 - "POST /node/69b426991727ff69d6f23266 HTTP/1.0" 202 Accepted 2026-03-15 15:00:50,153 - lava_callback - INFO - Starting async job submit for node 69b426991727ff69d6f23266 2026-03-15 15:00:50,154 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 15:00:50,168 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b426991727ff69d6f23266 HTTP/1.1" 200 None 2026-03-15 15:00:50,169 - lava_callback - DEBUG - Processing node 69b426991727ff69d6f23266: baseline-arm64-baylibre 2026-03-15 15:00:50,169 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b426991727ff69d6f23266 2026-03-15 15:00:50,170 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 15:00:50,192 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b426991727ff69d6f23266 HTTP/1.1" 200 None 2026-03-15 15:00:50,194 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 15:00:50,208 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b3c8061727ff69d6f21d98 HTTP/1.1" 200 None 2026-03-15 15:00:50,210 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 15:00:50,234 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b426991727ff69d6f23266 HTTP/1.1" 200 None 2026-03-15 15:00:50,235 - lava_callback - ERROR - Error processing callback for node 69b426991727ff69d6f23266: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:56206 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34124 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34128 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53326 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:53328 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49038 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36166 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41930 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45254 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36794 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36802 - "GET / HTTP/1.0" 200 OK 2026-03-15 15:02:10,208 - lava_callback - INFO - Received callback for node 69b426ec1727ff69d6f23271 INFO: 172.21.0.1:52536 - "POST /node/69b426ec1727ff69d6f23271 HTTP/1.0" 202 Accepted 2026-03-15 15:02:10,214 - lava_callback - INFO - Starting async job submit for node 69b426ec1727ff69d6f23271 2026-03-15 15:02:10,215 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 15:02:10,229 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b426ec1727ff69d6f23271 HTTP/1.1" 200 None 2026-03-15 15:02:10,230 - lava_callback - DEBUG - Processing node 69b426ec1727ff69d6f23271: baseline-arm64-baylibre 2026-03-15 15:02:10,230 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b426ec1727ff69d6f23271 2026-03-15 15:02:10,231 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 15:02:10,245 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b426ec1727ff69d6f23271 HTTP/1.1" 200 None 2026-03-15 15:02:10,246 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 15:02:10,260 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b3c8061727ff69d6f21d98 HTTP/1.1" 200 None 2026-03-15 15:02:10,262 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 15:02:10,311 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b426ec1727ff69d6f23271 HTTP/1.1" 200 None 2026-03-15 15:02:10,312 - lava_callback - ERROR - Error processing callback for node 69b426ec1727ff69d6f23271: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:52548 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:52564 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53488 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35262 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59554 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43880 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37898 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37906 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51006 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:51020 - "GET / HTTP/1.0" 200 OK 2026-03-15 15:03:26,163 - lava_callback - INFO - Received callback for node 69b427361727ff69d6f2327a INFO: 172.21.0.1:32840 - "POST /node/69b427361727ff69d6f2327a HTTP/1.0" 202 Accepted 2026-03-15 15:03:26,172 - lava_callback - INFO - Starting async job submit for node 69b427361727ff69d6f2327a 2026-03-15 15:03:26,173 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 15:03:26,188 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b427361727ff69d6f2327a HTTP/1.1" 200 None 2026-03-15 15:03:26,188 - lava_callback - DEBUG - Processing node 69b427361727ff69d6f2327a: baseline-arm-clabbe 2026-03-15 15:03:26,189 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b427361727ff69d6f2327a 2026-03-15 15:03:26,189 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 15:03:26,203 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b427361727ff69d6f2327a HTTP/1.1" 200 None 2026-03-15 15:03:26,204 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 15:03:26,232 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b12591a870a1dc3343ba82 HTTP/1.1" 200 None 2026-03-15 15:03:26,234 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 15:03:26,265 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b427361727ff69d6f2327a HTTP/1.1" 200 None 2026-03-15 15:03:26,267 - lava_callback - ERROR - Error processing callback for node 69b427361727ff69d6f2327a: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:32846 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60730 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:32866 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34024 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50040 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50052 - "GET / HTTP/1.0" 200 OK 2026-03-15 15:04:10,305 - lava_callback - INFO - Received callback for node 69b427641727ff69d6f23287 INFO: 172.21.0.1:55812 - "POST /node/69b427641727ff69d6f23287 HTTP/1.0" 202 Accepted 2026-03-15 15:04:10,311 - lava_callback - INFO - Starting async job submit for node 69b427641727ff69d6f23287 2026-03-15 15:04:10,312 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 15:04:10,326 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b427641727ff69d6f23287 HTTP/1.1" 200 None 2026-03-15 15:04:10,327 - lava_callback - DEBUG - Processing node 69b427641727ff69d6f23287: baseline-arm64-baylibre 2026-03-15 15:04:10,327 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b427641727ff69d6f23287 2026-03-15 15:04:10,328 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 15:04:10,341 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b427641727ff69d6f23287 HTTP/1.1" 200 None 2026-03-15 15:04:10,342 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 15:04:10,356 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b3c8061727ff69d6f21d98 HTTP/1.1" 200 None 2026-03-15 15:04:10,358 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 15:04:10,384 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b427641727ff69d6f23287 HTTP/1.1" 200 None 2026-03-15 15:04:10,385 - lava_callback - ERROR - Error processing callback for node 69b427641727ff69d6f23287: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:55814 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:55824 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40188 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42836 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50646 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37274 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60012 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60016 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36960 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:36968 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47508 - "GET / HTTP/1.0" 200 OK 2026-03-15 15:05:30,377 - lava_callback - INFO - Received callback for node 69b427b51727ff69d6f23291 INFO: 172.21.0.1:34904 - "POST /node/69b427b51727ff69d6f23291 HTTP/1.0" 202 Accepted 2026-03-15 15:05:30,383 - lava_callback - INFO - Starting async job submit for node 69b427b51727ff69d6f23291 2026-03-15 15:05:30,384 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 15:05:30,401 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b427b51727ff69d6f23291 HTTP/1.1" 200 None 2026-03-15 15:05:30,402 - lava_callback - DEBUG - Processing node 69b427b51727ff69d6f23291: baseline-arm64-baylibre 2026-03-15 15:05:30,402 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b427b51727ff69d6f23291 2026-03-15 15:05:30,403 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 15:05:30,416 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b427b51727ff69d6f23291 HTTP/1.1" 200 None 2026-03-15 15:05:30,417 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 15:05:30,430 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b3c8061727ff69d6f21d98 HTTP/1.1" 200 None 2026-03-15 15:05:30,432 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 15:05:30,453 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b427b51727ff69d6f23291 HTTP/1.1" 200 None 2026-03-15 15:05:30,459 - lava_callback - ERROR - Error processing callback for node 69b427b51727ff69d6f23291: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:34918 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34720 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44286 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38330 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38338 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38062 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:38068 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45576 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34680 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42852 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40940 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52394 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52396 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58620 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:58628 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58984 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60118 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51460 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54802 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42720 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42734 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47998 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:48014 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59450 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60828 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39916 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57922 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43194 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43208 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39454 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:39462 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60950 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50024 - "GET / HTTP/1.0" 200 OK 2026-03-15 15:09:46,476 - lava_callback - INFO - Received callback for node 69b428ad1727ff69d6f232b9 INFO: 172.21.0.1:43766 - "POST /node/69b428ad1727ff69d6f232b9 HTTP/1.0" 202 Accepted 2026-03-15 15:09:46,482 - lava_callback - INFO - Starting async job submit for node 69b428ad1727ff69d6f232b9 2026-03-15 15:09:46,483 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 15:09:46,504 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b428ad1727ff69d6f232b9 HTTP/1.1" 200 None 2026-03-15 15:09:46,505 - lava_callback - DEBUG - Processing node 69b428ad1727ff69d6f232b9: baseline-arm64-clabbe 2026-03-15 15:09:46,505 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b428ad1727ff69d6f232b9 INFO: 172.21.0.1:43768 - "GET / HTTP/1.0" 200 OK 2026-03-15 15:09:46,506 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 15:09:46,520 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b428ad1727ff69d6f232b9 HTTP/1.1" 200 None 2026-03-15 15:09:46,521 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 15:09:46,535 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b3c8061727ff69d6f21d98 HTTP/1.1" 200 None 2026-03-15 15:09:46,537 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 15:09:46,558 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b428ad1727ff69d6f232b9 HTTP/1.1" 200 None 2026-03-15 15:09:46,559 - lava_callback - ERROR - Error processing callback for node 69b428ad1727ff69d6f232b9: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:60482 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47810 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47824 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57352 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:57364 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56284 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60854 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59046 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34612 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50922 - "GET / HTTP/1.0" 200 OK 2026-03-15 15:11:06,449 - lava_callback - INFO - Received callback for node 69b428fe1727ff69d6f232c4 INFO: 172.21.0.1:50926 - "POST /node/69b428fe1727ff69d6f232c4 HTTP/1.0" 202 Accepted 2026-03-15 15:11:06,455 - lava_callback - INFO - Starting async job submit for node 69b428fe1727ff69d6f232c4 2026-03-15 15:11:06,456 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 15:11:06,471 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b428fe1727ff69d6f232c4 HTTP/1.1" 200 None 2026-03-15 15:11:06,472 - lava_callback - DEBUG - Processing node 69b428fe1727ff69d6f232c4: baseline-arm64-clabbe 2026-03-15 15:11:06,472 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b428fe1727ff69d6f232c4 2026-03-15 15:11:06,473 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 15:11:06,486 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b428fe1727ff69d6f232c4 HTTP/1.1" 200 None 2026-03-15 15:11:06,487 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 15:11:06,500 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b3c8061727ff69d6f21d98 HTTP/1.1" 200 None 2026-03-15 15:11:06,501 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 INFO: 172.21.0.1:50932 - "GET / HTTP/1.0" 200 OK 2026-03-15 15:11:06,522 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b428fe1727ff69d6f232c4 HTTP/1.1" 200 None 2026-03-15 15:11:06,531 - lava_callback - ERROR - Error processing callback for node 69b428fe1727ff69d6f232c4: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:52328 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:52334 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37482 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60910 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59484 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53502 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50840 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50848 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49402 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:49418 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51296 - "GET / HTTP/1.0" 200 OK 2026-03-15 15:12:26,531 - lava_callback - INFO - Received callback for node 69b429521727ff69d6f232d2 INFO: 172.21.0.1:51302 - "POST /node/69b429521727ff69d6f232d2 HTTP/1.0" 202 Accepted 2026-03-15 15:12:26,537 - lava_callback - INFO - Starting async job submit for node 69b429521727ff69d6f232d2 2026-03-15 15:12:26,538 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 15:12:26,557 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b429521727ff69d6f232d2 HTTP/1.1" 200 None 2026-03-15 15:12:26,558 - lava_callback - DEBUG - Processing node 69b429521727ff69d6f232d2: baseline-arm64-clabbe 2026-03-15 15:12:26,558 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b429521727ff69d6f232d2 2026-03-15 15:12:26,559 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 15:12:26,577 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b429521727ff69d6f232d2 HTTP/1.1" 200 None 2026-03-15 15:12:26,579 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 15:12:26,593 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b3c8061727ff69d6f21d98 HTTP/1.1" 200 None 2026-03-15 15:12:26,594 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 15:12:26,622 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b429521727ff69d6f232d2 HTTP/1.1" 200 None 2026-03-15 15:12:26,623 - lava_callback - ERROR - Error processing callback for node 69b429521727ff69d6f232d2: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:44002 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34452 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37210 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38338 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38350 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48254 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:48262 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43300 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40706 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45234 - "GET / HTTP/1.0" 200 OK 2026-03-15 15:13:46,631 - lava_callback - INFO - Received callback for node 69b429a21727ff69d6f232e5 INFO: 172.21.0.1:45242 - "POST /node/69b429a21727ff69d6f232e5 HTTP/1.0" 202 Accepted 2026-03-15 15:13:46,637 - lava_callback - INFO - Starting async job submit for node 69b429a21727ff69d6f232e5 2026-03-15 15:13:46,637 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 15:13:46,652 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b429a21727ff69d6f232e5 HTTP/1.1" 200 None 2026-03-15 15:13:46,653 - lava_callback - DEBUG - Processing node 69b429a21727ff69d6f232e5: baseline-arm64-clabbe 2026-03-15 15:13:46,653 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b429a21727ff69d6f232e5 2026-03-15 15:13:46,654 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 15:13:46,667 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b429a21727ff69d6f232e5 HTTP/1.1" 200 None 2026-03-15 15:13:46,669 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 15:13:46,682 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b3c8061727ff69d6f21d98 HTTP/1.1" 200 None 2026-03-15 15:13:46,684 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 15:13:46,711 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b429a21727ff69d6f232e5 HTTP/1.1" 200 None 2026-03-15 15:13:46,721 - lava_callback - ERROR - Error processing callback for node 69b429a21727ff69d6f232e5: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:32768 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43902 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43914 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49364 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:49374 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58596 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41934 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52880 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53210 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37742 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37748 - "GET / HTTP/1.0" 200 OK 2026-03-15 15:15:06,697 - lava_callback - INFO - Received callback for node 69b429f31727ff69d6f232f1 INFO: 172.21.0.1:37764 - "POST /node/69b429f31727ff69d6f232f1 HTTP/1.0" 202 Accepted 2026-03-15 15:15:06,702 - lava_callback - INFO - Starting async job submit for node 69b429f31727ff69d6f232f1 2026-03-15 15:15:06,703 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 15:15:06,718 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b429f31727ff69d6f232f1 HTTP/1.1" 200 None 2026-03-15 15:15:06,719 - lava_callback - DEBUG - Processing node 69b429f31727ff69d6f232f1: baseline-arm64-clabbe 2026-03-15 15:15:06,719 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b429f31727ff69d6f232f1 2026-03-15 15:15:06,719 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 15:15:06,733 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b429f31727ff69d6f232f1 HTTP/1.1" 200 None 2026-03-15 15:15:06,734 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 15:15:06,751 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b3c8061727ff69d6f21d98 HTTP/1.1" 200 None 2026-03-15 15:15:06,752 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 15:15:06,773 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b429f31727ff69d6f232f1 HTTP/1.1" 200 None 2026-03-15 15:15:06,779 - lava_callback - ERROR - Error processing callback for node 69b429f31727ff69d6f232f1: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:37168 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:37182 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45940 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49194 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38006 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41320 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56252 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56258 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59994 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:60006 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41802 - "GET / HTTP/1.0" 200 OK 2026-03-15 15:16:26,677 - lava_callback - INFO - Received callback for node 69b42a421727ff69d6f23306 INFO: 172.21.0.1:41816 - "POST /node/69b42a421727ff69d6f23306 HTTP/1.0" 202 Accepted 2026-03-15 15:16:26,688 - lava_callback - INFO - Starting async job submit for node 69b42a421727ff69d6f23306 2026-03-15 15:16:26,691 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 15:16:26,719 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b42a421727ff69d6f23306 HTTP/1.1" 200 None 2026-03-15 15:16:26,720 - lava_callback - DEBUG - Processing node 69b42a421727ff69d6f23306: baseline-arm64-clabbe 2026-03-15 15:16:26,720 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b42a421727ff69d6f23306 2026-03-15 15:16:26,721 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 15:16:26,738 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b42a421727ff69d6f23306 HTTP/1.1" 200 None 2026-03-15 15:16:26,740 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 15:16:26,755 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b3c8061727ff69d6f21d98 HTTP/1.1" 200 None 2026-03-15 15:16:26,757 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 15:16:26,783 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b42a421727ff69d6f23306 HTTP/1.1" 200 None 2026-03-15 15:16:26,784 - lava_callback - ERROR - Error processing callback for node 69b42a421727ff69d6f23306: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:43900 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37576 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33418 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49178 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49186 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:32820 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:32830 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:32838 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55426 - "GET / HTTP/1.0" 200 OK 2026-03-15 15:17:31,079 - lava_callback - INFO - Received callback for node 69b42a7f1727ff69d6f2330e INFO: 172.21.0.1:47828 - "POST /node/69b42a7f1727ff69d6f2330e HTTP/1.0" 202 Accepted 2026-03-15 15:17:31,085 - lava_callback - INFO - Starting async job submit for node 69b42a7f1727ff69d6f2330e 2026-03-15 15:17:31,086 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 15:17:31,102 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b42a7f1727ff69d6f2330e HTTP/1.1" 200 None 2026-03-15 15:17:31,104 - lava_callback - DEBUG - Processing node 69b42a7f1727ff69d6f2330e: baseline-arm-baylibre 2026-03-15 15:17:31,104 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b42a7f1727ff69d6f2330e 2026-03-15 15:17:31,105 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 15:17:31,122 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b42a7f1727ff69d6f2330e HTTP/1.1" 200 None 2026-03-15 15:17:31,123 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 15:17:31,138 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ae8223c660ead8a389aafd HTTP/1.1" 200 None 2026-03-15 15:17:31,140 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 15:17:31,162 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b42a7f1727ff69d6f2330e HTTP/1.1" 200 None 2026-03-15 15:17:31,164 - lava_callback - ERROR - Error processing callback for node 69b42a7f1727ff69d6f2330e: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:47830 - "GET /favicon.ico HTTP/1.0" 404 Not Found INFO: 172.21.0.1:47836 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46044 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49182 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52154 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52170 - "GET / HTTP/1.0" 200 OK 2026-03-15 15:18:11,016 - lava_callback - INFO - Received callback for node 69b42aa31727ff69d6f23319 INFO: 172.21.0.1:52656 - "POST /node/69b42aa31727ff69d6f23319 HTTP/1.0" 202 Accepted 2026-03-15 15:18:11,021 - lava_callback - INFO - Starting async job submit for node 69b42aa31727ff69d6f23319 2026-03-15 15:18:11,023 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 15:18:11,045 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b42aa31727ff69d6f23319 HTTP/1.1" 200 None 2026-03-15 15:18:11,045 - lava_callback - DEBUG - Processing node 69b42aa31727ff69d6f23319: baseline-arm-baylibre 2026-03-15 15:18:11,046 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b42aa31727ff69d6f23319 2026-03-15 15:18:11,046 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 15:18:11,060 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b42aa31727ff69d6f23319 HTTP/1.1" 200 None 2026-03-15 15:18:11,061 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 15:18:11,076 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ae8223c660ead8a389aafd HTTP/1.1" 200 None 2026-03-15 15:18:11,077 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 15:18:11,102 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b42aa31727ff69d6f23319 HTTP/1.1" 200 None 2026-03-15 15:18:11,103 - lava_callback - ERROR - Error processing callback for node 69b42aa31727ff69d6f23319: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:52670 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:52672 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41588 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44548 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37134 - "GET / HTTP/1.0" 200 OK 2026-03-15 15:18:51,423 - lava_callback - INFO - Received callback for node 69b42ac81727ff69d6f23322 INFO: 172.21.0.1:41896 - "POST /node/69b42ac81727ff69d6f23322 HTTP/1.0" 202 Accepted 2026-03-15 15:18:51,428 - lava_callback - INFO - Starting async job submit for node 69b42ac81727ff69d6f23322 2026-03-15 15:18:51,429 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 15:18:51,443 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b42ac81727ff69d6f23322 HTTP/1.1" 200 None 2026-03-15 15:18:51,444 - lava_callback - DEBUG - Processing node 69b42ac81727ff69d6f23322: baseline-arm-baylibre 2026-03-15 15:18:51,444 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b42ac81727ff69d6f23322 2026-03-15 15:18:51,445 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 15:18:51,458 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b42ac81727ff69d6f23322 HTTP/1.1" 200 None 2026-03-15 15:18:51,459 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 15:18:51,475 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ae8223c660ead8a389aafd HTTP/1.1" 200 None 2026-03-15 15:18:51,477 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 15:18:51,520 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b42ac81727ff69d6f23322 HTTP/1.1" 200 None 2026-03-15 15:18:51,540 - lava_callback - ERROR - Error processing callback for node 69b42ac81727ff69d6f23322: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:41898 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50792 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50808 - "GET / HTTP/1.0" 200 OK 2026-03-15 15:19:11,092 - lava_callback - INFO - Received callback for node 69b42aea1727ff69d6f23331 INFO: 172.21.0.1:57164 - "POST /node/69b42aea1727ff69d6f23331 HTTP/1.0" 202 Accepted 2026-03-15 15:19:11,101 - lava_callback - INFO - Starting async job submit for node 69b42aea1727ff69d6f23331 2026-03-15 15:19:11,102 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 15:19:11,117 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b42aea1727ff69d6f23331 HTTP/1.1" 200 None 2026-03-15 15:19:11,118 - lava_callback - DEBUG - Processing node 69b42aea1727ff69d6f23331: baseline-arm-baylibre 2026-03-15 15:19:11,118 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b42aea1727ff69d6f23331 2026-03-15 15:19:11,119 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 15:19:11,132 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b42aea1727ff69d6f23331 HTTP/1.1" 200 None 2026-03-15 15:19:11,134 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 15:19:11,168 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ae8223c660ead8a389aafd HTTP/1.1" 200 None 2026-03-15 15:19:11,170 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 15:19:11,201 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b42aea1727ff69d6f23331 HTTP/1.1" 200 None 2026-03-15 15:19:11,202 - lava_callback - ERROR - Error processing callback for node 69b42aea1727ff69d6f23331: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:57174 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:57178 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50346 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44934 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49086 - "GET / HTTP/1.0" 200 OK 2026-03-15 15:19:51,124 - lava_callback - INFO - Received callback for node 69b42b0f1727ff69d6f2333d INFO: 172.21.0.1:50354 - "POST /node/69b42b0f1727ff69d6f2333d HTTP/1.0" 202 Accepted 2026-03-15 15:19:51,130 - lava_callback - INFO - Starting async job submit for node 69b42b0f1727ff69d6f2333d 2026-03-15 15:19:51,131 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 15:19:51,146 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b42b0f1727ff69d6f2333d HTTP/1.1" 200 None 2026-03-15 15:19:51,147 - lava_callback - DEBUG - Processing node 69b42b0f1727ff69d6f2333d: baseline-arm-baylibre 2026-03-15 15:19:51,148 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b42b0f1727ff69d6f2333d 2026-03-15 15:19:51,148 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 15:19:51,163 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b42b0f1727ff69d6f2333d HTTP/1.1" 200 None 2026-03-15 15:19:51,164 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 15:19:51,179 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ae8223c660ead8a389aafd HTTP/1.1" 200 None 2026-03-15 15:19:51,181 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 15:19:51,217 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b42b0f1727ff69d6f2333d HTTP/1.1" 200 None 2026-03-15 15:19:51,218 - lava_callback - ERROR - Error processing callback for node 69b42b0f1727ff69d6f2333d: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:50368 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47150 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47156 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33336 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:33340 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42530 - "GET / HTTP/1.0" 200 OK 2026-03-15 15:20:31,178 - lava_callback - INFO - Received callback for node 69b42b351727ff69d6f23349 INFO: 172.21.0.1:44930 - "POST /node/69b42b351727ff69d6f23349 HTTP/1.0" 202 Accepted 2026-03-15 15:20:31,183 - lava_callback - INFO - Starting async job submit for node 69b42b351727ff69d6f23349 2026-03-15 15:20:31,185 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 15:20:31,202 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b42b351727ff69d6f23349 HTTP/1.1" 200 None 2026-03-15 15:20:31,202 - lava_callback - DEBUG - Processing node 69b42b351727ff69d6f23349: baseline-arm-baylibre 2026-03-15 15:20:31,203 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b42b351727ff69d6f23349 2026-03-15 15:20:31,203 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 15:20:31,242 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b42b351727ff69d6f23349 HTTP/1.1" 200 None 2026-03-15 15:20:31,243 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 15:20:31,260 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ae8223c660ead8a389aafd HTTP/1.1" 200 None 2026-03-15 15:20:31,262 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 15:20:31,284 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b42b351727ff69d6f23349 HTTP/1.1" 200 None 2026-03-15 15:20:31,292 - lava_callback - ERROR - Error processing callback for node 69b42b351727ff69d6f23349: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:44944 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47336 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38332 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60002 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60008 - "GET / HTTP/1.0" 200 OK 2026-03-15 15:21:11,173 - lava_callback - INFO - Received callback for node 69b42b5a1727ff69d6f23353 INFO: 172.21.0.1:33192 - "POST /node/69b42b5a1727ff69d6f23353 HTTP/1.0" 202 Accepted 2026-03-15 15:21:11,179 - lava_callback - INFO - Starting async job submit for node 69b42b5a1727ff69d6f23353 2026-03-15 15:21:11,180 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 15:21:11,194 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b42b5a1727ff69d6f23353 HTTP/1.1" 200 None 2026-03-15 15:21:11,195 - lava_callback - DEBUG - Processing node 69b42b5a1727ff69d6f23353: baseline-arm-baylibre 2026-03-15 15:21:11,195 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b42b5a1727ff69d6f23353 2026-03-15 15:21:11,195 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 15:21:11,209 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b42b5a1727ff69d6f23353 HTTP/1.1" 200 None 2026-03-15 15:21:11,210 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 15:21:11,223 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ae8223c660ead8a389aafd HTTP/1.1" 200 None 2026-03-15 15:21:11,225 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 15:21:11,255 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b42b5a1727ff69d6f23353 HTTP/1.1" 200 None 2026-03-15 15:21:11,257 - lava_callback - ERROR - Error processing callback for node 69b42b5a1727ff69d6f23353: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:33204 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:33208 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41390 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45450 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49454 - "GET / HTTP/1.0" 200 OK 2026-03-15 15:21:51,240 - lava_callback - INFO - Received callback for node 69b42b7c1727ff69d6f2335d INFO: 172.21.0.1:60388 - "POST /node/69b42b7c1727ff69d6f2335d HTTP/1.0" 202 Accepted 2026-03-15 15:21:51,247 - lava_callback - INFO - Starting async job submit for node 69b42b7c1727ff69d6f2335d 2026-03-15 15:21:51,248 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 15:21:51,269 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b42b7c1727ff69d6f2335d HTTP/1.1" 200 None 2026-03-15 15:21:51,270 - lava_callback - DEBUG - Processing node 69b42b7c1727ff69d6f2335d: baseline-arm-baylibre 2026-03-15 15:21:51,270 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b42b7c1727ff69d6f2335d 2026-03-15 15:21:51,271 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 15:21:51,305 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b42b7c1727ff69d6f2335d HTTP/1.1" 200 None 2026-03-15 15:21:51,307 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 15:21:51,326 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ae8223c660ead8a389aafd HTTP/1.1" 200 None 2026-03-15 15:21:51,328 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 15:21:51,357 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b42b7c1727ff69d6f2335d HTTP/1.1" 200 None 2026-03-15 15:21:51,358 - lava_callback - ERROR - Error processing callback for node 69b42b7c1727ff69d6f2335d: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:60390 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51810 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51824 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56360 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:56366 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45528 - "GET / HTTP/1.0" 200 OK 2026-03-15 15:22:26,917 - lava_callback - INFO - Received callback for node 69b42ba41727ff69d6f23369 INFO: 172.21.0.1:45540 - "POST /node/69b42ba41727ff69d6f23369 HTTP/1.0" 202 Accepted 2026-03-15 15:22:26,923 - lava_callback - INFO - Starting async job submit for node 69b42ba41727ff69d6f23369 2026-03-15 15:22:26,924 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 15:22:26,943 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b42ba41727ff69d6f23369 HTTP/1.1" 200 None 2026-03-15 15:22:26,944 - lava_callback - DEBUG - Processing node 69b42ba41727ff69d6f23369: baseline-arm-clabbe 2026-03-15 15:22:26,945 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b42ba41727ff69d6f23369 2026-03-15 15:22:26,945 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 15:22:26,959 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b42ba41727ff69d6f23369 HTTP/1.1" 200 None 2026-03-15 15:22:26,960 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 15:22:26,973 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ae8223c660ead8a389aafd HTTP/1.1" 200 None 2026-03-15 15:22:26,974 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 15:22:26,996 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b42ba41727ff69d6f23369 HTTP/1.1" 200 None 2026-03-15 15:22:26,997 - lava_callback - ERROR - Error processing callback for node 69b42ba41727ff69d6f23369: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:46394 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48182 - "GET / HTTP/1.0" 200 OK 2026-03-15 15:22:51,365 - lava_callback - INFO - Received callback for node 69b42bc51727ff69d6f23376 INFO: 172.21.0.1:52578 - "POST /node/69b42bc51727ff69d6f23376 HTTP/1.0" 202 Accepted 2026-03-15 15:22:51,371 - lava_callback - INFO - Starting async job submit for node 69b42bc51727ff69d6f23376 2026-03-15 15:22:51,372 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 15:22:51,387 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b42bc51727ff69d6f23376 HTTP/1.1" 200 None 2026-03-15 15:22:51,388 - lava_callback - DEBUG - Processing node 69b42bc51727ff69d6f23376: baseline-arm-baylibre 2026-03-15 15:22:51,388 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b42bc51727ff69d6f23376 2026-03-15 15:22:51,389 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 15:22:51,434 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b42bc51727ff69d6f23376 HTTP/1.1" 200 None 2026-03-15 15:22:51,435 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 15:22:51,449 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ae8223c660ead8a389aafd HTTP/1.1" 200 None 2026-03-15 15:22:51,450 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 15:22:51,477 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b42bc51727ff69d6f23376 HTTP/1.1" 200 None 2026-03-15 15:22:51,479 - lava_callback - ERROR - Error processing callback for node 69b42bc51727ff69d6f23376: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:52582 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48818 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48824 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37828 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:37842 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60224 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60426 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52210 - "GET / HTTP/1.0" 200 OK 2026-03-15 15:23:46,983 - lava_callback - INFO - Received callback for node 69b42bed1727ff69d6f23381 INFO: 172.21.0.1:52220 - "POST /node/69b42bed1727ff69d6f23381 HTTP/1.0" 202 Accepted 2026-03-15 15:23:46,988 - lava_callback - INFO - Starting async job submit for node 69b42bed1727ff69d6f23381 2026-03-15 15:23:46,989 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 15:23:47,013 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b42bed1727ff69d6f23381 HTTP/1.1" 200 None 2026-03-15 15:23:47,014 - lava_callback - DEBUG - Processing node 69b42bed1727ff69d6f23381: baseline-arm-clabbe 2026-03-15 15:23:47,014 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b42bed1727ff69d6f23381 2026-03-15 15:23:47,015 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 15:23:47,029 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b42bed1727ff69d6f23381 HTTP/1.1" 200 None 2026-03-15 15:23:47,030 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 15:23:47,092 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ae8223c660ead8a389aafd HTTP/1.1" 200 None 2026-03-15 15:23:47,094 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 15:23:47,126 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b42bed1727ff69d6f23381 HTTP/1.1" 200 None 2026-03-15 15:23:47,128 - lava_callback - ERROR - Error processing callback for node 69b42bed1727ff69d6f23381: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:35912 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59444 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59448 - "GET / HTTP/1.0" 200 OK 2026-03-15 15:24:11,406 - lava_callback - INFO - Received callback for node 69b42c101727ff69d6f2338c INFO: 172.21.0.1:41510 - "POST /node/69b42c101727ff69d6f2338c HTTP/1.0" 202 Accepted 2026-03-15 15:24:11,412 - lava_callback - INFO - Starting async job submit for node 69b42c101727ff69d6f2338c 2026-03-15 15:24:11,413 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 15:24:11,427 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b42c101727ff69d6f2338c HTTP/1.1" 200 None 2026-03-15 15:24:11,428 - lava_callback - DEBUG - Processing node 69b42c101727ff69d6f2338c: baseline-arm-baylibre 2026-03-15 15:24:11,428 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b42c101727ff69d6f2338c 2026-03-15 15:24:11,429 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 15:24:11,443 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b42c101727ff69d6f2338c HTTP/1.1" 200 None 2026-03-15 15:24:11,444 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 15:24:11,459 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ae8223c660ead8a389aafd HTTP/1.1" 200 None 2026-03-15 15:24:11,460 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 15:24:11,483 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b42c101727ff69d6f2338c HTTP/1.1" 200 None 2026-03-15 15:24:11,484 - lava_callback - ERROR - Error processing callback for node 69b42c101727ff69d6f2338c: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:41518 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:41524 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33422 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39670 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45100 - "GET / HTTP/1.0" 200 OK 2026-03-15 15:24:51,397 - lava_callback - INFO - Received callback for node 69b42c381727ff69d6f23399 INFO: 172.21.0.1:58820 - "POST /node/69b42c381727ff69d6f23399 HTTP/1.0" 202 Accepted 2026-03-15 15:24:51,402 - lava_callback - INFO - Starting async job submit for node 69b42c381727ff69d6f23399 2026-03-15 15:24:51,404 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 15:24:51,419 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b42c381727ff69d6f23399 HTTP/1.1" 200 None 2026-03-15 15:24:51,420 - lava_callback - DEBUG - Processing node 69b42c381727ff69d6f23399: baseline-arm-baylibre 2026-03-15 15:24:51,420 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b42c381727ff69d6f23399 2026-03-15 15:24:51,421 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 15:24:51,435 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b42c381727ff69d6f23399 HTTP/1.1" 200 None 2026-03-15 15:24:51,437 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 15:24:51,463 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ae8223c660ead8a389aafd HTTP/1.1" 200 None 2026-03-15 15:24:51,465 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 15:24:51,486 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b42c381727ff69d6f23399 HTTP/1.1" 200 None 2026-03-15 15:24:51,492 - lava_callback - ERROR - Error processing callback for node 69b42c381727ff69d6f23399: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:58836 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53180 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53182 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40784 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:40790 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36762 - "GET / HTTP/1.0" 200 OK 2026-03-15 15:25:27,065 - lava_callback - INFO - Received callback for node 69b42c5f1727ff69d6f233a4 INFO: 172.21.0.1:36768 - "POST /node/69b42c5f1727ff69d6f233a4 HTTP/1.0" 202 Accepted 2026-03-15 15:25:27,071 - lava_callback - INFO - Starting async job submit for node 69b42c5f1727ff69d6f233a4 2026-03-15 15:25:27,072 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 15:25:27,123 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b42c5f1727ff69d6f233a4 HTTP/1.1" 200 None 2026-03-15 15:25:27,124 - lava_callback - DEBUG - Processing node 69b42c5f1727ff69d6f233a4: baseline-arm-clabbe 2026-03-15 15:25:27,124 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b42c5f1727ff69d6f233a4 2026-03-15 15:25:27,124 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 15:25:27,137 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b42c5f1727ff69d6f233a4 HTTP/1.1" 200 None 2026-03-15 15:25:27,139 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 15:25:27,154 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ae8223c660ead8a389aafd HTTP/1.1" 200 None 2026-03-15 15:25:27,156 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 15:25:27,177 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b42c5f1727ff69d6f233a4 HTTP/1.1" 200 None 2026-03-15 15:25:27,179 - lava_callback - ERROR - Error processing callback for node 69b42c5f1727ff69d6f233a4: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:34114 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42418 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53906 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48642 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48658 - "GET / HTTP/1.0" 200 OK 2026-03-15 15:26:07,040 - lava_callback - INFO - Received callback for node 69b42c8c1727ff69d6f233b3 INFO: 172.21.0.1:48674 - "POST /node/69b42c8c1727ff69d6f233b3 HTTP/1.0" 202 Accepted 2026-03-15 15:26:07,046 - lava_callback - INFO - Starting async job submit for node 69b42c8c1727ff69d6f233b3 2026-03-15 15:26:07,047 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 15:26:07,063 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b42c8c1727ff69d6f233b3 HTTP/1.1" 200 None 2026-03-15 15:26:07,064 - lava_callback - DEBUG - Processing node 69b42c8c1727ff69d6f233b3: baseline-arm-clabbe 2026-03-15 15:26:07,064 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b42c8c1727ff69d6f233b3 2026-03-15 15:26:07,065 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 15:26:07,079 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b42c8c1727ff69d6f233b3 HTTP/1.1" 200 None 2026-03-15 15:26:07,080 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 15:26:07,094 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ae8223c660ead8a389aafd HTTP/1.1" 200 None 2026-03-15 15:26:07,096 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 15:26:07,118 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b42c8c1727ff69d6f233b3 HTTP/1.1" 200 None 2026-03-15 15:26:07,128 - lava_callback - ERROR - Error processing callback for node 69b42c8c1727ff69d6f233b3: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:35482 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:35492 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51578 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43896 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56752 - "GET / HTTP/1.0" 200 OK 2026-03-15 15:26:47,323 - lava_callback - INFO - Received callback for node 69b42cb11727ff69d6f233c1 INFO: 172.21.0.1:56766 - "POST /node/69b42cb11727ff69d6f233c1 HTTP/1.0" 202 Accepted 2026-03-15 15:26:47,329 - lava_callback - INFO - Starting async job submit for node 69b42cb11727ff69d6f233c1 2026-03-15 15:26:47,329 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 15:26:47,344 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b42cb11727ff69d6f233c1 HTTP/1.1" 200 None 2026-03-15 15:26:47,345 - lava_callback - DEBUG - Processing node 69b42cb11727ff69d6f233c1: baseline-arm-clabbe 2026-03-15 15:26:47,345 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b42cb11727ff69d6f233c1 2026-03-15 15:26:47,346 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 15:26:47,359 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b42cb11727ff69d6f233c1 HTTP/1.1" 200 None 2026-03-15 15:26:47,361 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 15:26:47,374 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ae8223c660ead8a389aafd HTTP/1.1" 200 None 2026-03-15 15:26:47,376 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 15:26:47,396 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b42cb11727ff69d6f233c1 HTTP/1.1" 200 None 2026-03-15 15:26:47,406 - lava_callback - ERROR - Error processing callback for node 69b42cb11727ff69d6f233c1: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:48806 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40402 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40414 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57482 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:57490 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37320 - "GET / HTTP/1.0" 200 OK 2026-03-15 15:27:27,116 - lava_callback - INFO - Received callback for node 69b42cd61727ff69d6f233ca INFO: 172.21.0.1:37326 - "POST /node/69b42cd61727ff69d6f233ca HTTP/1.0" 202 Accepted 2026-03-15 15:27:27,122 - lava_callback - INFO - Starting async job submit for node 69b42cd61727ff69d6f233ca 2026-03-15 15:27:27,122 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 15:27:27,139 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b42cd61727ff69d6f233ca HTTP/1.1" 200 None 2026-03-15 15:27:27,140 - lava_callback - DEBUG - Processing node 69b42cd61727ff69d6f233ca: baseline-arm-clabbe 2026-03-15 15:27:27,141 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b42cd61727ff69d6f233ca 2026-03-15 15:27:27,141 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 15:27:27,155 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b42cd61727ff69d6f233ca HTTP/1.1" 200 None 2026-03-15 15:27:27,156 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 15:27:27,170 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ae8223c660ead8a389aafd HTTP/1.1" 200 None 2026-03-15 15:27:27,171 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 15:27:27,202 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b42cd61727ff69d6f233ca HTTP/1.1" 200 None 2026-03-15 15:27:27,210 - lava_callback - ERROR - Error processing callback for node 69b42cd61727ff69d6f233ca: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:57754 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43186 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55070 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38738 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38746 - "GET / HTTP/1.0" 200 OK 2026-03-15 15:28:07,193 - lava_callback - INFO - Received callback for node 69b42cfa1727ff69d6f233db INFO: 172.21.0.1:38762 - "POST /node/69b42cfa1727ff69d6f233db HTTP/1.0" 202 Accepted 2026-03-15 15:28:07,198 - lava_callback - INFO - Starting async job submit for node 69b42cfa1727ff69d6f233db 2026-03-15 15:28:07,200 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 15:28:07,214 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b42cfa1727ff69d6f233db HTTP/1.1" 200 None 2026-03-15 15:28:07,215 - lava_callback - DEBUG - Processing node 69b42cfa1727ff69d6f233db: baseline-arm-clabbe 2026-03-15 15:28:07,215 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b42cfa1727ff69d6f233db 2026-03-15 15:28:07,216 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 15:28:07,230 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b42cfa1727ff69d6f233db HTTP/1.1" 200 None 2026-03-15 15:28:07,231 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 15:28:07,246 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ae8223c660ead8a389aafd HTTP/1.1" 200 None 2026-03-15 15:28:07,247 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 15:28:07,273 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b42cfa1727ff69d6f233db HTTP/1.1" 200 None 2026-03-15 15:28:07,279 - lava_callback - ERROR - Error processing callback for node 69b42cfa1727ff69d6f233db: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:60686 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:60694 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40474 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39088 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35664 - "GET / HTTP/1.0" 200 OK 2026-03-15 15:28:47,200 - lava_callback - INFO - Received callback for node 69b42d1f1727ff69d6f233e9 INFO: 172.21.0.1:35680 - "POST /node/69b42d1f1727ff69d6f233e9 HTTP/1.0" 202 Accepted 2026-03-15 15:28:47,205 - lava_callback - INFO - Starting async job submit for node 69b42d1f1727ff69d6f233e9 2026-03-15 15:28:47,206 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 15:28:47,221 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b42d1f1727ff69d6f233e9 HTTP/1.1" 200 None 2026-03-15 15:28:47,222 - lava_callback - DEBUG - Processing node 69b42d1f1727ff69d6f233e9: baseline-arm-clabbe 2026-03-15 15:28:47,222 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b42d1f1727ff69d6f233e9 2026-03-15 15:28:47,222 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 15:28:47,244 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b42d1f1727ff69d6f233e9 HTTP/1.1" 200 None 2026-03-15 15:28:47,245 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 15:28:47,259 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ae8223c660ead8a389aafd HTTP/1.1" 200 None 2026-03-15 15:28:47,261 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 15:28:47,284 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b42d1f1727ff69d6f233e9 HTTP/1.1" 200 None 2026-03-15 15:28:47,287 - lava_callback - ERROR - Error processing callback for node 69b42d1f1727ff69d6f233e9: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:41998 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38498 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38508 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46362 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:46376 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35500 - "GET / HTTP/1.0" 200 OK 2026-03-15 15:29:27,237 - lava_callback - INFO - Received callback for node 69b42d431727ff69d6f233ff INFO: 172.21.0.1:35510 - "POST /node/69b42d431727ff69d6f233ff HTTP/1.0" 202 Accepted 2026-03-15 15:29:27,243 - lava_callback - INFO - Starting async job submit for node 69b42d431727ff69d6f233ff 2026-03-15 15:29:27,244 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 15:29:27,260 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b42d431727ff69d6f233ff HTTP/1.1" 200 None 2026-03-15 15:29:27,261 - lava_callback - DEBUG - Processing node 69b42d431727ff69d6f233ff: baseline-arm-clabbe 2026-03-15 15:29:27,261 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b42d431727ff69d6f233ff 2026-03-15 15:29:27,261 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 15:29:27,282 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b42d431727ff69d6f233ff HTTP/1.1" 200 None 2026-03-15 15:29:27,284 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 15:29:27,298 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ae8223c660ead8a389aafd HTTP/1.1" 200 None 2026-03-15 15:29:27,299 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 15:29:27,320 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b42d431727ff69d6f233ff HTTP/1.1" 200 None 2026-03-15 15:29:27,321 - lava_callback - ERROR - Error processing callback for node 69b42d431727ff69d6f233ff: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:56668 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44262 - "GET / HTTP/1.0" 200 OK 2026-03-15 15:29:47,225 - lava_callback - INFO - Received callback for node 69b42d671727ff69d6f2340b INFO: 172.21.0.1:44268 - "POST /node/69b42d671727ff69d6f2340b HTTP/1.0" 202 Accepted 2026-03-15 15:29:47,231 - lava_callback - INFO - Starting async job submit for node 69b42d671727ff69d6f2340b 2026-03-15 15:29:47,232 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 15:29:47,268 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b42d671727ff69d6f2340b HTTP/1.1" 200 None 2026-03-15 15:29:47,269 - lava_callback - DEBUG - Processing node 69b42d671727ff69d6f2340b: baseline-arm-clabbe 2026-03-15 15:29:47,269 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b42d671727ff69d6f2340b 2026-03-15 15:29:47,270 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 15:29:47,283 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b42d671727ff69d6f2340b HTTP/1.1" 200 None 2026-03-15 15:29:47,285 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 15:29:47,312 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ae8223c660ead8a389aafd HTTP/1.1" 200 None 2026-03-15 15:29:47,313 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 15:29:47,343 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b42d671727ff69d6f2340b HTTP/1.1" 200 None 2026-03-15 15:29:47,344 - lava_callback - ERROR - Error processing callback for node 69b42d671727ff69d6f2340b: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:48650 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42444 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42460 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51918 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:51934 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45592 - "GET / HTTP/1.0" 200 OK 2026-03-15 15:30:31,756 - lava_callback - INFO - Received callback for node 69b42d931727ff69d6f23421 INFO: 172.21.0.1:44510 - "POST /node/69b42d931727ff69d6f23421 HTTP/1.0" 202 Accepted 2026-03-15 15:30:31,761 - lava_callback - INFO - Starting async job submit for node 69b42d931727ff69d6f23421 2026-03-15 15:30:31,762 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 15:30:31,778 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b42d931727ff69d6f23421 HTTP/1.1" 200 None 2026-03-15 15:30:31,779 - lava_callback - DEBUG - Processing node 69b42d931727ff69d6f23421: baseline-arm64-baylibre 2026-03-15 15:30:31,779 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b42d931727ff69d6f23421 2026-03-15 15:30:31,779 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 15:30:31,792 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b42d931727ff69d6f23421 HTTP/1.1" 200 None 2026-03-15 15:30:31,794 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 15:30:31,817 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ae822fc660ead8a389ab0e HTTP/1.1" 200 None 2026-03-15 15:30:31,819 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 15:30:31,854 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b42d931727ff69d6f23421 HTTP/1.1" 200 None 2026-03-15 15:30:31,855 - lava_callback - ERROR - Error processing callback for node 69b42d931727ff69d6f23421: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:44514 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46460 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50900 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53446 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53452 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42224 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:42236 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45196 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59034 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52804 - "GET / HTTP/1.0" 200 OK 2026-03-15 15:31:51,838 - lava_callback - INFO - Received callback for node 69b42de51727ff69d6f2342e INFO: 172.21.0.1:54050 - "POST /node/69b42de51727ff69d6f2342e HTTP/1.0" 202 Accepted 2026-03-15 15:31:51,844 - lava_callback - INFO - Starting async job submit for node 69b42de51727ff69d6f2342e 2026-03-15 15:31:51,844 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 15:31:51,860 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b42de51727ff69d6f2342e HTTP/1.1" 200 None 2026-03-15 15:31:51,861 - lava_callback - DEBUG - Processing node 69b42de51727ff69d6f2342e: baseline-arm64-baylibre 2026-03-15 15:31:51,861 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b42de51727ff69d6f2342e 2026-03-15 15:31:51,861 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 15:31:51,880 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b42de51727ff69d6f2342e HTTP/1.1" 200 None 2026-03-15 15:31:51,881 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 15:31:51,895 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ae822fc660ead8a389ab0e HTTP/1.1" 200 None 2026-03-15 15:31:51,896 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 15:31:51,954 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b42de51727ff69d6f2342e HTTP/1.1" 200 None 2026-03-15 15:31:51,956 - lava_callback - ERROR - Error processing callback for node 69b42de51727ff69d6f2342e: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:54066 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57106 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57120 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40900 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:40906 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39432 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53740 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47036 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38794 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49912 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49922 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41390 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:41402 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51388 - "GET / HTTP/1.0" 200 OK 2026-03-15 15:33:31,896 - lava_callback - INFO - Received callback for node 69b42e371727ff69d6f2343f INFO: 172.21.0.1:37352 - "POST /node/69b42e371727ff69d6f2343f HTTP/1.0" 202 Accepted 2026-03-15 15:33:31,901 - lava_callback - INFO - Starting async job submit for node 69b42e371727ff69d6f2343f 2026-03-15 15:33:31,902 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 15:33:31,937 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b42e371727ff69d6f2343f HTTP/1.1" 200 None 2026-03-15 15:33:31,938 - lava_callback - DEBUG - Processing node 69b42e371727ff69d6f2343f: baseline-arm64-baylibre 2026-03-15 15:33:31,939 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b42e371727ff69d6f2343f 2026-03-15 15:33:31,939 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 15:33:31,981 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b42e371727ff69d6f2343f HTTP/1.1" 200 None 2026-03-15 15:33:31,982 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 15:33:32,026 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ae822fc660ead8a389ab0e HTTP/1.1" 200 None 2026-03-15 15:33:32,028 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 15:33:32,055 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b42e371727ff69d6f2343f HTTP/1.1" 200 None 2026-03-15 15:33:32,057 - lava_callback - ERROR - Error processing callback for node 69b42e371727ff69d6f2343f: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:37366 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56376 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59870 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55470 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55472 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50366 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:50376 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53026 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56224 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48060 - "GET / HTTP/1.0" 200 OK 2026-03-15 15:34:52,148 - lava_callback - INFO - Received callback for node 69b42e8a1727ff69d6f23448 INFO: 172.21.0.1:56064 - "POST /node/69b42e8a1727ff69d6f23448 HTTP/1.0" 202 Accepted 2026-03-15 15:34:52,153 - lava_callback - INFO - Starting async job submit for node 69b42e8a1727ff69d6f23448 2026-03-15 15:34:52,154 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 15:34:52,169 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b42e8a1727ff69d6f23448 HTTP/1.1" 200 None 2026-03-15 15:34:52,170 - lava_callback - DEBUG - Processing node 69b42e8a1727ff69d6f23448: baseline-arm64-baylibre 2026-03-15 15:34:52,171 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b42e8a1727ff69d6f23448 2026-03-15 15:34:52,171 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 15:34:52,185 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b42e8a1727ff69d6f23448 HTTP/1.1" 200 None 2026-03-15 15:34:52,186 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 15:34:52,206 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ae822fc660ead8a389ab0e HTTP/1.1" 200 None 2026-03-15 15:34:52,208 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 15:34:52,229 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b42e8a1727ff69d6f23448 HTTP/1.1" 200 None 2026-03-15 15:34:52,238 - lava_callback - ERROR - Error processing callback for node 69b42e8a1727ff69d6f23448: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:56068 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:32770 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:32786 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50744 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:50746 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49404 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34968 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49300 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48838 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56928 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56942 - "GET / HTTP/1.0" 200 OK 2026-03-15 15:36:12,055 - lava_callback - INFO - Received callback for node 69b42edb1727ff69d6f23453 INFO: 172.21.0.1:49740 - "POST /node/69b42edb1727ff69d6f23453 HTTP/1.0" 202 Accepted 2026-03-15 15:36:12,061 - lava_callback - INFO - Starting async job submit for node 69b42edb1727ff69d6f23453 2026-03-15 15:36:12,062 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 15:36:12,076 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b42edb1727ff69d6f23453 HTTP/1.1" 200 None 2026-03-15 15:36:12,077 - lava_callback - DEBUG - Processing node 69b42edb1727ff69d6f23453: baseline-arm64-baylibre 2026-03-15 15:36:12,078 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b42edb1727ff69d6f23453 2026-03-15 15:36:12,078 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 15:36:12,092 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b42edb1727ff69d6f23453 HTTP/1.1" 200 None 2026-03-15 15:36:12,094 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 15:36:12,107 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ae822fc660ead8a389ab0e HTTP/1.1" 200 None 2026-03-15 15:36:12,108 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 15:36:12,151 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b42edb1727ff69d6f23453 HTTP/1.1" 200 None 2026-03-15 15:36:12,152 - lava_callback - ERROR - Error processing callback for node 69b42edb1727ff69d6f23453: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:49752 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:49760 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50760 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:32782 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40422 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42716 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45234 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45246 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43446 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:43454 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38014 - "GET / HTTP/1.0" 200 OK 2026-03-15 15:37:32,106 - lava_callback - INFO - Received callback for node 69b42f2c1727ff69d6f23462 INFO: 172.21.0.1:49852 - "POST /node/69b42f2c1727ff69d6f23462 HTTP/1.0" 202 Accepted 2026-03-15 15:37:32,112 - lava_callback - INFO - Starting async job submit for node 69b42f2c1727ff69d6f23462 2026-03-15 15:37:32,112 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 15:37:32,149 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b42f2c1727ff69d6f23462 HTTP/1.1" 200 None 2026-03-15 15:37:32,150 - lava_callback - DEBUG - Processing node 69b42f2c1727ff69d6f23462: baseline-arm64-baylibre 2026-03-15 15:37:32,150 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b42f2c1727ff69d6f23462 2026-03-15 15:37:32,151 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 15:37:32,187 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b42f2c1727ff69d6f23462 HTTP/1.1" 200 None 2026-03-15 15:37:32,188 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 15:37:32,202 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ae822fc660ead8a389ab0e HTTP/1.1" 200 None 2026-03-15 15:37:32,204 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 15:37:32,259 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b42f2c1727ff69d6f23462 HTTP/1.1" 200 None 2026-03-15 15:37:32,260 - lava_callback - ERROR - Error processing callback for node 69b42f2c1727ff69d6f23462: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:49854 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52128 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52420 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51298 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51302 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39592 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:39606 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35782 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51864 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45666 - "GET / HTTP/1.0" 200 OK 2026-03-15 15:38:47,847 - lava_callback - INFO - Received callback for node 69b42f831727ff69d6f23470 INFO: 172.21.0.1:45668 - "POST /node/69b42f831727ff69d6f23470 HTTP/1.0" 202 Accepted 2026-03-15 15:38:47,852 - lava_callback - INFO - Starting async job submit for node 69b42f831727ff69d6f23470 2026-03-15 15:38:47,853 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 15:38:47,877 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b42f831727ff69d6f23470 HTTP/1.1" 200 None 2026-03-15 15:38:47,878 - lava_callback - DEBUG - Processing node 69b42f831727ff69d6f23470: baseline-arm64-clabbe 2026-03-15 15:38:47,878 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b42f831727ff69d6f23470 2026-03-15 15:38:47,879 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 15:38:47,905 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b42f831727ff69d6f23470 HTTP/1.1" 200 None 2026-03-15 15:38:47,906 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 15:38:47,925 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ae822fc660ead8a389ab0e HTTP/1.1" 200 None 2026-03-15 15:38:47,927 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 15:38:47,949 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b42f831727ff69d6f23470 HTTP/1.1" 200 None 2026-03-15 15:38:47,950 - lava_callback - ERROR - Error processing callback for node 69b42f831727ff69d6f23470: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:49680 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60638 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60652 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57742 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:57756 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53624 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34696 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40304 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52654 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52008 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52018 - "GET / HTTP/1.0" 200 OK 2026-03-15 15:40:12,317 - lava_callback - INFO - Received callback for node 69b42fcb1727ff69d6f2347a INFO: 172.21.0.1:57954 - "POST /node/69b42fcb1727ff69d6f2347a HTTP/1.0" 202 Accepted 2026-03-15 15:40:12,322 - lava_callback - INFO - Starting async job submit for node 69b42fcb1727ff69d6f2347a 2026-03-15 15:40:12,323 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 15:40:12,347 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b42fcb1727ff69d6f2347a HTTP/1.1" 200 None 2026-03-15 15:40:12,348 - lava_callback - DEBUG - Processing node 69b42fcb1727ff69d6f2347a: baseline-arm64-baylibre 2026-03-15 15:40:12,348 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b42fcb1727ff69d6f2347a 2026-03-15 15:40:12,349 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 15:40:12,392 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b42fcb1727ff69d6f2347a HTTP/1.1" 200 None 2026-03-15 15:40:12,393 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 15:40:12,406 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ae822fc660ead8a389ab0e HTTP/1.1" 200 None 2026-03-15 15:40:12,408 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 15:40:12,449 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b42fcb1727ff69d6f2347a HTTP/1.1" 200 None 2026-03-15 15:40:12,450 - lava_callback - ERROR - Error processing callback for node 69b42fcb1727ff69d6f2347a: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:57962 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:57968 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:32930 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35044 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48554 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33746 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41330 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41334 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44890 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:44898 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41998 - "GET / HTTP/1.0" 200 OK 2026-03-15 15:41:27,751 - lava_callback - INFO - Received callback for node 69b430251727ff69d6f23488 INFO: 172.21.0.1:42010 - "POST /node/69b430251727ff69d6f23488 HTTP/1.0" 202 Accepted 2026-03-15 15:41:27,757 - lava_callback - INFO - Starting async job submit for node 69b430251727ff69d6f23488 2026-03-15 15:41:27,758 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 15:41:27,774 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b430251727ff69d6f23488 HTTP/1.1" 200 None 2026-03-15 15:41:27,775 - lava_callback - DEBUG - Processing node 69b430251727ff69d6f23488: baseline-arm64-clabbe 2026-03-15 15:41:27,775 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b430251727ff69d6f23488 2026-03-15 15:41:27,776 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 15:41:27,789 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b430251727ff69d6f23488 HTTP/1.1" 200 None 2026-03-15 15:41:27,791 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 15:41:27,805 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ae822fc660ead8a389ab0e HTTP/1.1" 200 None 2026-03-15 15:41:27,806 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 15:41:27,834 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b430251727ff69d6f23488 HTTP/1.1" 200 None 2026-03-15 15:41:27,835 - lava_callback - ERROR - Error processing callback for node 69b430251727ff69d6f23488: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:56628 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38498 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42090 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35328 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35340 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47288 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:47292 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44114 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47382 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46440 - "GET / HTTP/1.0" 200 OK 2026-03-15 15:42:53,117 - lava_callback - INFO - Received callback for node 69b4306c1727ff69d6f23497 INFO: 172.21.0.1:51294 - "POST /node/69b4306c1727ff69d6f23497 HTTP/1.0" 202 Accepted 2026-03-15 15:42:53,122 - lava_callback - INFO - Starting async job submit for node 69b4306c1727ff69d6f23497 2026-03-15 15:42:53,123 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 15:42:53,164 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b4306c1727ff69d6f23497 HTTP/1.1" 200 None 2026-03-15 15:42:53,165 - lava_callback - DEBUG - Processing node 69b4306c1727ff69d6f23497: baseline-arm64-baylibre 2026-03-15 15:42:53,165 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b4306c1727ff69d6f23497 2026-03-15 15:42:53,166 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 15:42:53,202 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b4306c1727ff69d6f23497 HTTP/1.1" 200 None 2026-03-15 15:42:53,203 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 15:42:53,219 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ae822fc660ead8a389ab0e HTTP/1.1" 200 None 2026-03-15 15:42:53,221 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 15:42:53,264 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b4306c1727ff69d6f23497 HTTP/1.1" 200 None 2026-03-15 15:42:53,270 - lava_callback - ERROR - Error processing callback for node 69b4306c1727ff69d6f23497: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:51300 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58008 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58024 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42414 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:42430 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33146 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41186 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48616 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48940 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42860 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42866 - "GET / HTTP/1.0" 200 OK 2026-03-15 15:44:07,813 - lava_callback - INFO - Received callback for node 69b430c31727ff69d6f2349d INFO: 172.21.0.1:42872 - "POST /node/69b430c31727ff69d6f2349d HTTP/1.0" 202 Accepted 2026-03-15 15:44:07,818 - lava_callback - INFO - Starting async job submit for node 69b430c31727ff69d6f2349d 2026-03-15 15:44:07,819 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 15:44:07,843 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b430c31727ff69d6f2349d HTTP/1.1" 200 None 2026-03-15 15:44:07,844 - lava_callback - DEBUG - Processing node 69b430c31727ff69d6f2349d: baseline-arm64-clabbe 2026-03-15 15:44:07,844 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b430c31727ff69d6f2349d 2026-03-15 15:44:07,845 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 15:44:07,859 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b430c31727ff69d6f2349d HTTP/1.1" 200 None 2026-03-15 15:44:07,860 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 15:44:07,889 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ae822fc660ead8a389ab0e HTTP/1.1" 200 None 2026-03-15 15:44:07,890 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 15:44:07,921 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b430c31727ff69d6f2349d HTTP/1.1" 200 None 2026-03-15 15:44:07,923 - lava_callback - ERROR - Error processing callback for node 69b430c31727ff69d6f2349d: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:56368 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:56382 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49516 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35148 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46546 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56308 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47842 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47846 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40604 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:40614 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49118 - "GET / HTTP/1.0" 200 OK 2026-03-15 15:45:27,869 - lava_callback - INFO - Received callback for node 69b431151727ff69d6f234aa INFO: 172.21.0.1:49130 - "POST /node/69b431151727ff69d6f234aa HTTP/1.0" 202 Accepted 2026-03-15 15:45:27,875 - lava_callback - INFO - Starting async job submit for node 69b431151727ff69d6f234aa 2026-03-15 15:45:27,875 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 15:45:27,891 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b431151727ff69d6f234aa HTTP/1.1" 200 None 2026-03-15 15:45:27,892 - lava_callback - DEBUG - Processing node 69b431151727ff69d6f234aa: baseline-arm64-clabbe 2026-03-15 15:45:27,892 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b431151727ff69d6f234aa 2026-03-15 15:45:27,892 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 15:45:27,906 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b431151727ff69d6f234aa HTTP/1.1" 200 None 2026-03-15 15:45:27,907 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 15:45:27,921 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ae822fc660ead8a389ab0e HTTP/1.1" 200 None 2026-03-15 15:45:27,923 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 15:45:27,961 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b431151727ff69d6f234aa HTTP/1.1" 200 None 2026-03-15 15:45:27,963 - lava_callback - ERROR - Error processing callback for node 69b431151727ff69d6f234aa: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:43864 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45990 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35602 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49060 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49076 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59550 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:59556 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50234 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42480 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46490 - "GET / HTTP/1.0" 200 OK 2026-03-15 15:46:52,655 - lava_callback - INFO - Received callback for node 69b4315d1727ff69d6f234b8 INFO: 172.21.0.1:56718 - "POST /node/69b4315d1727ff69d6f234b8 HTTP/1.0" 202 Accepted 2026-03-15 15:46:52,661 - lava_callback - INFO - Starting async job submit for node 69b4315d1727ff69d6f234b8 2026-03-15 15:46:52,662 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 15:46:52,677 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b4315d1727ff69d6f234b8 HTTP/1.1" 200 None 2026-03-15 15:46:52,678 - lava_callback - DEBUG - Processing node 69b4315d1727ff69d6f234b8: baseline-arm64-baylibre 2026-03-15 15:46:52,678 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b4315d1727ff69d6f234b8 2026-03-15 15:46:52,679 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 15:46:52,701 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b4315d1727ff69d6f234b8 HTTP/1.1" 200 None 2026-03-15 15:46:52,702 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 15:46:52,729 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ae822fc660ead8a389ab0e HTTP/1.1" 200 None 2026-03-15 15:46:52,731 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 15:46:52,775 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b4315d1727ff69d6f234b8 HTTP/1.1" 200 None 2026-03-15 15:46:52,785 - lava_callback - ERROR - Error processing callback for node 69b4315d1727ff69d6f234b8: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:56722 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55976 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55984 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59870 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:59884 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42162 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45956 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47258 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35000 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44080 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44090 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47372 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:47376 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39412 - "GET / HTTP/1.0" 200 OK 2026-03-15 15:48:28,055 - lava_callback - INFO - Received callback for node 69b431b61727ff69d6f234c4 INFO: 172.21.0.1:39416 - "POST /node/69b431b61727ff69d6f234c4 HTTP/1.0" 202 Accepted 2026-03-15 15:48:28,061 - lava_callback - INFO - Starting async job submit for node 69b431b61727ff69d6f234c4 2026-03-15 15:48:28,062 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 15:48:28,078 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b431b61727ff69d6f234c4 HTTP/1.1" 200 None 2026-03-15 15:48:28,079 - lava_callback - DEBUG - Processing node 69b431b61727ff69d6f234c4: baseline-arm64-clabbe 2026-03-15 15:48:28,079 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b431b61727ff69d6f234c4 2026-03-15 15:48:28,080 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 15:48:28,162 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b431b61727ff69d6f234c4 HTTP/1.1" 200 None 2026-03-15 15:48:28,164 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 15:48:28,187 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ae822fc660ead8a389ab0e HTTP/1.1" 200 None 2026-03-15 15:48:28,189 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 15:48:28,212 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b431b61727ff69d6f234c4 HTTP/1.1" 200 None 2026-03-15 15:48:28,213 - lava_callback - ERROR - Error processing callback for node 69b431b61727ff69d6f234c4: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:34326 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59370 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50512 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50040 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50050 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55864 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:55870 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36466 - "GET / HTTP/1.0" 200 OK 2026-03-15 15:49:32,774 - lava_callback - INFO - Received callback for node 69b431fe1727ff69d6f234cb INFO: 172.21.0.1:45482 - "POST /node/69b431fe1727ff69d6f234cb HTTP/1.0" 202 Accepted 2026-03-15 15:49:32,780 - lava_callback - INFO - Starting async job submit for node 69b431fe1727ff69d6f234cb 2026-03-15 15:49:32,780 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 15:49:32,820 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b431fe1727ff69d6f234cb HTTP/1.1" 200 None 2026-03-15 15:49:32,821 - lava_callback - DEBUG - Processing node 69b431fe1727ff69d6f234cb: baseline-arm64-baylibre 2026-03-15 15:49:32,821 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b431fe1727ff69d6f234cb 2026-03-15 15:49:32,822 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 15:49:32,843 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b431fe1727ff69d6f234cb HTTP/1.1" 200 None 2026-03-15 15:49:32,845 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 15:49:32,860 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ae822fc660ead8a389ab0e HTTP/1.1" 200 None 2026-03-15 15:49:32,862 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 15:49:32,913 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b431fe1727ff69d6f234cb HTTP/1.1" 200 None 2026-03-15 15:49:32,915 - lava_callback - ERROR - Error processing callback for node 69b431fe1727ff69d6f234cb: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:45494 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47592 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52640 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59776 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59782 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51902 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:51904 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55460 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39028 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60186 - "GET / HTTP/1.0" 200 OK 2026-03-15 15:50:53,249 - lava_callback - INFO - Received callback for node 69b432501727ff69d6f234d5 INFO: 172.21.0.1:58748 - "POST /node/69b432501727ff69d6f234d5 HTTP/1.0" 202 Accepted 2026-03-15 15:50:53,255 - lava_callback - INFO - Starting async job submit for node 69b432501727ff69d6f234d5 2026-03-15 15:50:53,256 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 15:50:53,274 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b432501727ff69d6f234d5 HTTP/1.1" 200 None 2026-03-15 15:50:53,275 - lava_callback - DEBUG - Processing node 69b432501727ff69d6f234d5: baseline-arm64-baylibre 2026-03-15 15:50:53,275 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b432501727ff69d6f234d5 2026-03-15 15:50:53,276 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 15:50:53,290 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b432501727ff69d6f234d5 HTTP/1.1" 200 None 2026-03-15 15:50:53,291 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 15:50:53,315 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ae822fc660ead8a389ab0e HTTP/1.1" 200 None 2026-03-15 15:50:53,316 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 15:50:53,358 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b432501727ff69d6f234d5 HTTP/1.1" 200 None 2026-03-15 15:50:53,359 - lava_callback - ERROR - Error processing callback for node 69b432501727ff69d6f234d5: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:58750 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47456 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47466 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45502 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:45504 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42714 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41378 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59514 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40160 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35018 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35034 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53632 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:53648 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49964 - "GET / HTTP/1.0" 200 OK 2026-03-15 15:52:29,203 - lava_callback - INFO - Received callback for node 69b432a71727ff69d6f234df INFO: 172.21.0.1:49968 - "POST /node/69b432a71727ff69d6f234df HTTP/1.0" 202 Accepted 2026-03-15 15:52:29,209 - lava_callback - INFO - Starting async job submit for node 69b432a71727ff69d6f234df 2026-03-15 15:52:29,210 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 15:52:29,230 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b432a71727ff69d6f234df HTTP/1.1" 200 None 2026-03-15 15:52:29,231 - lava_callback - DEBUG - Processing node 69b432a71727ff69d6f234df: baseline-arm64-clabbe 2026-03-15 15:52:29,231 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b432a71727ff69d6f234df 2026-03-15 15:52:29,232 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 15:52:29,246 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b432a71727ff69d6f234df HTTP/1.1" 200 None 2026-03-15 15:52:29,247 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 15:52:29,261 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ae822fc660ead8a389ab0e HTTP/1.1" 200 None 2026-03-15 15:52:29,262 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 15:52:29,284 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b432a71727ff69d6f234df HTTP/1.1" 200 None 2026-03-15 15:52:29,285 - lava_callback - ERROR - Error processing callback for node 69b432a71727ff69d6f234df: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:54184 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52472 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47114 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42512 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42526 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38622 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:38626 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48866 - "GET / HTTP/1.0" 200 OK 2026-03-15 15:53:33,016 - lava_callback - INFO - Received callback for node 69b432f11727ff69d6f234e5 INFO: 172.21.0.1:52384 - "POST /node/69b432f11727ff69d6f234e5 HTTP/1.0" 202 Accepted 2026-03-15 15:53:33,022 - lava_callback - INFO - Starting async job submit for node 69b432f11727ff69d6f234e5 2026-03-15 15:53:33,023 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 15:53:33,047 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b432f11727ff69d6f234e5 HTTP/1.1" 200 None 2026-03-15 15:53:33,048 - lava_callback - DEBUG - Processing node 69b432f11727ff69d6f234e5: baseline-arm64-baylibre 2026-03-15 15:53:33,048 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b432f11727ff69d6f234e5 2026-03-15 15:53:33,049 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 15:53:33,083 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b432f11727ff69d6f234e5 HTTP/1.1" 200 None 2026-03-15 15:53:33,084 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 15:53:33,103 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ae822fc660ead8a389ab0e HTTP/1.1" 200 None 2026-03-15 15:53:33,104 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 15:53:33,139 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b432f11727ff69d6f234e5 HTTP/1.1" 200 None 2026-03-15 15:53:33,141 - lava_callback - ERROR - Error processing callback for node 69b432f11727ff69d6f234e5: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:52390 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58898 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40888 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38384 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38394 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59772 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:59782 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50764 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52958 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39896 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54300 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43398 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43400 - "GET / HTTP/1.0" 200 OK 2026-03-15 15:55:08,323 - lava_callback - INFO - Received callback for node 69b433471727ff69d6f234f1 INFO: 172.21.0.1:43404 - "POST /node/69b433471727ff69d6f234f1 HTTP/1.0" 202 Accepted 2026-03-15 15:55:08,329 - lava_callback - INFO - Starting async job submit for node 69b433471727ff69d6f234f1 2026-03-15 15:55:08,330 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 15:55:08,345 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b433471727ff69d6f234f1 HTTP/1.1" 200 None 2026-03-15 15:55:08,346 - lava_callback - DEBUG - Processing node 69b433471727ff69d6f234f1: baseline-arm64-clabbe 2026-03-15 15:55:08,346 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b433471727ff69d6f234f1 2026-03-15 15:55:08,346 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 15:55:08,403 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b433471727ff69d6f234f1 HTTP/1.1" 200 None 2026-03-15 15:55:08,405 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 15:55:08,430 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ae822fc660ead8a389ab0e HTTP/1.1" 200 None 2026-03-15 15:55:08,431 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 15:55:08,452 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b433471727ff69d6f234f1 HTTP/1.1" 200 None 2026-03-15 15:55:08,454 - lava_callback - ERROR - Error processing callback for node 69b433471727ff69d6f234f1: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:41898 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:41906 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36014 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53938 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60194 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35378 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33406 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33414 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53042 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:53058 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43278 - "GET / HTTP/1.0" 200 OK 2026-03-15 15:56:28,374 - lava_callback - INFO - Received callback for node 69b433971727ff69d6f234fd INFO: 172.21.0.1:43288 - "POST /node/69b433971727ff69d6f234fd HTTP/1.0" 202 Accepted 2026-03-15 15:56:28,379 - lava_callback - INFO - Starting async job submit for node 69b433971727ff69d6f234fd 2026-03-15 15:56:28,380 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 15:56:28,406 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b433971727ff69d6f234fd HTTP/1.1" 200 None 2026-03-15 15:56:28,407 - lava_callback - DEBUG - Processing node 69b433971727ff69d6f234fd: baseline-arm64-clabbe 2026-03-15 15:56:28,407 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b433971727ff69d6f234fd 2026-03-15 15:56:28,407 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 15:56:28,421 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b433971727ff69d6f234fd HTTP/1.1" 200 None 2026-03-15 15:56:28,422 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 15:56:28,437 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ae822fc660ead8a389ab0e HTTP/1.1" 200 None 2026-03-15 15:56:28,439 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 15:56:28,461 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b433971727ff69d6f234fd HTTP/1.1" 200 None 2026-03-15 15:56:28,462 - lava_callback - ERROR - Error processing callback for node 69b433971727ff69d6f234fd: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:51546 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36278 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55218 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43750 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43764 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57298 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:57310 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52274 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53568 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37548 - "GET / HTTP/1.0" 200 OK 2026-03-15 15:57:48,447 - lava_callback - INFO - Received callback for node 69b433e81727ff69d6f23507 INFO: 172.21.0.1:37560 - "POST /node/69b433e81727ff69d6f23507 HTTP/1.0" 202 Accepted 2026-03-15 15:57:48,452 - lava_callback - INFO - Starting async job submit for node 69b433e81727ff69d6f23507 2026-03-15 15:57:48,453 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 15:57:48,467 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b433e81727ff69d6f23507 HTTP/1.1" 200 None 2026-03-15 15:57:48,468 - lava_callback - DEBUG - Processing node 69b433e81727ff69d6f23507: baseline-arm64-clabbe 2026-03-15 15:57:48,469 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b433e81727ff69d6f23507 2026-03-15 15:57:48,469 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 15:57:48,487 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b433e81727ff69d6f23507 HTTP/1.1" 200 None 2026-03-15 15:57:48,489 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 15:57:48,502 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ae822fc660ead8a389ab0e HTTP/1.1" 200 None 2026-03-15 15:57:48,504 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 15:57:48,553 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b433e81727ff69d6f23507 HTTP/1.1" 200 None 2026-03-15 15:57:48,555 - lava_callback - ERROR - Error processing callback for node 69b433e81727ff69d6f23507: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:50476 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52094 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52098 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55598 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:55612 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48902 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33160 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49524 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50884 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36230 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36238 - "GET / HTTP/1.0" 200 OK 2026-03-15 15:59:08,487 - lava_callback - INFO - Received callback for node 69b434361727ff69d6f23513 INFO: 172.21.0.1:36252 - "POST /node/69b434361727ff69d6f23513 HTTP/1.0" 202 Accepted 2026-03-15 15:59:08,492 - lava_callback - INFO - Starting async job submit for node 69b434361727ff69d6f23513 2026-03-15 15:59:08,493 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 15:59:08,523 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b434361727ff69d6f23513 HTTP/1.1" 200 None 2026-03-15 15:59:08,524 - lava_callback - DEBUG - Processing node 69b434361727ff69d6f23513: baseline-arm64-clabbe 2026-03-15 15:59:08,524 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b434361727ff69d6f23513 2026-03-15 15:59:08,525 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 15:59:08,553 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b434361727ff69d6f23513 HTTP/1.1" 200 None 2026-03-15 15:59:08,554 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 15:59:08,568 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ae822fc660ead8a389ab0e HTTP/1.1" 200 None 2026-03-15 15:59:08,569 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 15:59:08,594 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b434361727ff69d6f23513 HTTP/1.1" 200 None 2026-03-15 15:59:08,601 - lava_callback - ERROR - Error processing callback for node 69b434361727ff69d6f23513: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:42882 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:42884 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53502 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60454 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53078 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56368 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41470 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41474 - "GET / HTTP/1.0" 200 OK 2026-03-15 16:00:08,731 - lava_callback - INFO - Received callback for node 69b434851727ff69d6f2351f INFO: 172.21.0.1:41482 - "POST /node/69b434851727ff69d6f2351f HTTP/1.0" 202 Accepted 2026-03-15 16:00:08,736 - lava_callback - INFO - Starting async job submit for node 69b434851727ff69d6f2351f 2026-03-15 16:00:08,737 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 16:00:08,773 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b434851727ff69d6f2351f HTTP/1.1" 200 None 2026-03-15 16:00:08,774 - lava_callback - DEBUG - Processing node 69b434851727ff69d6f2351f: baseline-arm64-clabbe 2026-03-15 16:00:08,774 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b434851727ff69d6f2351f 2026-03-15 16:00:08,775 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 16:00:08,821 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b434851727ff69d6f2351f HTTP/1.1" 200 None 2026-03-15 16:00:08,823 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 16:00:08,837 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ae822fc660ead8a389ab0e HTTP/1.1" 200 None 2026-03-15 16:00:08,838 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 16:00:08,859 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b434851727ff69d6f2351f HTTP/1.1" 200 None 2026-03-15 16:00:08,866 - lava_callback - ERROR - Error processing callback for node 69b434851727ff69d6f2351f: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:37016 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:37032 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56310 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54858 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45668 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49858 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46436 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46438 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58664 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:58676 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42586 - "GET / HTTP/1.0" 200 OK 2026-03-15 16:01:28,625 - lava_callback - INFO - Received callback for node 69b434d51727ff69d6f23527 INFO: 172.21.0.1:42594 - "POST /node/69b434d51727ff69d6f23527 HTTP/1.0" 202 Accepted 2026-03-15 16:01:28,630 - lava_callback - INFO - Starting async job submit for node 69b434d51727ff69d6f23527 2026-03-15 16:01:28,631 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 16:01:28,656 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b434d51727ff69d6f23527 HTTP/1.1" 200 None 2026-03-15 16:01:28,657 - lava_callback - DEBUG - Processing node 69b434d51727ff69d6f23527: baseline-arm64-clabbe 2026-03-15 16:01:28,657 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b434d51727ff69d6f23527 2026-03-15 16:01:28,658 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 16:01:28,682 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b434d51727ff69d6f23527 HTTP/1.1" 200 None 2026-03-15 16:01:28,684 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 16:01:28,724 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ae822fc660ead8a389ab0e HTTP/1.1" 200 None 2026-03-15 16:01:28,726 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 16:01:28,752 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b434d51727ff69d6f23527 HTTP/1.1" 200 None 2026-03-15 16:01:28,754 - lava_callback - ERROR - Error processing callback for node 69b434d51727ff69d6f23527: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:35150 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42348 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43716 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51312 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51324 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54052 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:54056 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36086 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51460 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49346 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33404 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60938 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60950 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50196 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:50200 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50674 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45654 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51116 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50856 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35346 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35352 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36124 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:36136 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42482 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40522 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47758 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52604 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45156 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45166 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55878 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:55886 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41860 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60580 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35262 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50488 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37020 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37022 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34194 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:34198 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48200 - "GET / HTTP/1.0" 200 OK 2026-03-15 16:06:34,013 - lava_callback - INFO - Received callback for node 69b435f61727ff69d6f23539 INFO: 172.21.0.1:39094 - "POST /node/69b435f61727ff69d6f23539 HTTP/1.0" 202 Accepted 2026-03-15 16:06:34,019 - lava_callback - INFO - Starting async job submit for node 69b435f61727ff69d6f23539 2026-03-15 16:06:34,020 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 16:06:34,034 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b435f61727ff69d6f23539 HTTP/1.1" 200 None 2026-03-15 16:06:34,035 - lava_callback - DEBUG - Processing node 69b435f61727ff69d6f23539: baseline-arm64-baylibre 2026-03-15 16:06:34,035 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b435f61727ff69d6f23539 2026-03-15 16:06:34,036 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 16:06:34,054 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b435f61727ff69d6f23539 HTTP/1.1" 200 None 2026-03-15 16:06:34,056 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 16:06:34,071 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b125a3a870a1dc3343ba94 HTTP/1.1" 200 None 2026-03-15 16:06:34,072 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 16:06:34,098 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b435f61727ff69d6f23539 HTTP/1.1" 200 None 2026-03-15 16:06:34,100 - lava_callback - ERROR - Error processing callback for node 69b435f61727ff69d6f23539: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:39096 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53674 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43918 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33568 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33578 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45300 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:45314 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41684 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45992 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60752 - "GET / HTTP/1.0" 200 OK 2026-03-15 16:07:53,760 - lava_callback - INFO - Received callback for node 69b436461727ff69d6f23541 INFO: 172.21.0.1:35506 - "POST /node/69b436461727ff69d6f23541 HTTP/1.0" 202 Accepted 2026-03-15 16:07:53,766 - lava_callback - INFO - Starting async job submit for node 69b436461727ff69d6f23541 2026-03-15 16:07:53,766 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 16:07:53,781 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b436461727ff69d6f23541 HTTP/1.1" 200 None 2026-03-15 16:07:53,782 - lava_callback - DEBUG - Processing node 69b436461727ff69d6f23541: baseline-arm64-baylibre 2026-03-15 16:07:53,782 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b436461727ff69d6f23541 2026-03-15 16:07:53,783 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 16:07:53,828 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b436461727ff69d6f23541 HTTP/1.1" 200 None 2026-03-15 16:07:53,829 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 16:07:53,843 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b125a3a870a1dc3343ba94 HTTP/1.1" 200 None 2026-03-15 16:07:53,845 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 16:07:53,871 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b436461727ff69d6f23541 HTTP/1.1" 200 None 2026-03-15 16:07:53,873 - lava_callback - ERROR - Error processing callback for node 69b436461727ff69d6f23541: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:35520 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54228 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54242 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49328 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:49342 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35910 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39312 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44458 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46508 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59114 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59126 - "GET / HTTP/1.0" 200 OK 2026-03-15 16:09:13,852 - lava_callback - INFO - Received callback for node 69b436941727ff69d6f23550 INFO: 172.21.0.1:54374 - "POST /node/69b436941727ff69d6f23550 HTTP/1.0" 202 Accepted 2026-03-15 16:09:13,857 - lava_callback - INFO - Starting async job submit for node 69b436941727ff69d6f23550 2026-03-15 16:09:13,858 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 16:09:13,872 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b436941727ff69d6f23550 HTTP/1.1" 200 None 2026-03-15 16:09:13,873 - lava_callback - DEBUG - Processing node 69b436941727ff69d6f23550: baseline-arm64-baylibre 2026-03-15 16:09:13,874 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b436941727ff69d6f23550 2026-03-15 16:09:13,874 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 16:09:13,910 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b436941727ff69d6f23550 HTTP/1.1" 200 None 2026-03-15 16:09:13,911 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 16:09:13,930 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b125a3a870a1dc3343ba94 HTTP/1.1" 200 None 2026-03-15 16:09:13,932 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 16:09:13,952 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b436941727ff69d6f23550 HTTP/1.1" 200 None 2026-03-15 16:09:13,958 - lava_callback - ERROR - Error processing callback for node 69b436941727ff69d6f23550: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:54382 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:54388 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46452 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35174 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38400 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52406 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51224 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51230 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46244 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:46246 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57104 - "GET / HTTP/1.0" 200 OK 2026-03-15 16:10:29,024 - lava_callback - INFO - Received callback for node 69b436f01727ff69d6f23563 INFO: 172.21.0.1:57106 - "POST /node/69b436f01727ff69d6f23563 HTTP/1.0" 202 Accepted 2026-03-15 16:10:29,030 - lava_callback - INFO - Starting async job submit for node 69b436f01727ff69d6f23563 2026-03-15 16:10:29,031 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 16:10:29,045 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b436f01727ff69d6f23563 HTTP/1.1" 200 None 2026-03-15 16:10:29,046 - lava_callback - DEBUG - Processing node 69b436f01727ff69d6f23563: baseline-arm64-clabbe 2026-03-15 16:10:29,046 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b436f01727ff69d6f23563 2026-03-15 16:10:29,047 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 16:10:29,068 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b436f01727ff69d6f23563 HTTP/1.1" 200 None 2026-03-15 16:10:29,070 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 16:10:29,084 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b125a3a870a1dc3343ba94 HTTP/1.1" 200 None 2026-03-15 16:10:29,085 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 16:10:29,109 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b436f01727ff69d6f23563 HTTP/1.1" 200 None 2026-03-15 16:10:29,110 - lava_callback - ERROR - Error processing callback for node 69b436f01727ff69d6f23563: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:36072 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47370 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56620 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45882 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45894 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38140 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:38154 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35824 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53882 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37698 - "GET / HTTP/1.0" 200 OK 2026-03-15 16:11:54,038 - lava_callback - INFO - Received callback for node 69b4373d1727ff69d6f2356f INFO: 172.21.0.1:40162 - "POST /node/69b4373d1727ff69d6f2356f HTTP/1.0" 202 Accepted 2026-03-15 16:11:54,044 - lava_callback - INFO - Starting async job submit for node 69b4373d1727ff69d6f2356f 2026-03-15 16:11:54,044 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 16:11:54,060 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b4373d1727ff69d6f2356f HTTP/1.1" 200 None 2026-03-15 16:11:54,061 - lava_callback - DEBUG - Processing node 69b4373d1727ff69d6f2356f: baseline-arm64-baylibre 2026-03-15 16:11:54,061 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b4373d1727ff69d6f2356f 2026-03-15 16:11:54,062 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 16:11:54,075 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b4373d1727ff69d6f2356f HTTP/1.1" 200 None 2026-03-15 16:11:54,077 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 16:11:54,090 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b125a3a870a1dc3343ba94 HTTP/1.1" 200 None 2026-03-15 16:11:54,092 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 16:11:54,119 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b4373d1727ff69d6f2356f HTTP/1.1" 200 None 2026-03-15 16:11:54,125 - lava_callback - ERROR - Error processing callback for node 69b4373d1727ff69d6f2356f: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:40170 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50998 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51006 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41324 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:41330 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33266 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51558 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54018 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59240 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36806 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36816 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50740 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:50746 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34564 - "GET / HTTP/1.0" 200 OK 2026-03-15 16:13:29,128 - lava_callback - INFO - Received callback for node 69b437951727ff69d6f2357f INFO: 172.21.0.1:34566 - "POST /node/69b437951727ff69d6f2357f HTTP/1.0" 202 Accepted 2026-03-15 16:13:29,136 - lava_callback - INFO - Starting async job submit for node 69b437951727ff69d6f2357f 2026-03-15 16:13:29,137 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 16:13:29,151 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b437951727ff69d6f2357f HTTP/1.1" 200 None 2026-03-15 16:13:29,152 - lava_callback - DEBUG - Processing node 69b437951727ff69d6f2357f: baseline-arm64-clabbe 2026-03-15 16:13:29,152 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b437951727ff69d6f2357f 2026-03-15 16:13:29,153 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 16:13:29,166 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b437951727ff69d6f2357f HTTP/1.1" 200 None 2026-03-15 16:13:29,167 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 16:13:29,193 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b125a3a870a1dc3343ba94 HTTP/1.1" 200 None 2026-03-15 16:13:29,195 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 16:13:29,217 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b437951727ff69d6f2357f HTTP/1.1" 200 None 2026-03-15 16:13:29,218 - lava_callback - ERROR - Error processing callback for node 69b437951727ff69d6f2357f: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:37162 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52218 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59860 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45078 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45086 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56470 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:56480 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55134 - "GET / HTTP/1.0" 200 OK 2026-03-15 16:14:34,165 - lava_callback - INFO - Received callback for node 69b437e01727ff69d6f23589 INFO: 172.21.0.1:56984 - "POST /node/69b437e01727ff69d6f23589 HTTP/1.0" 202 Accepted 2026-03-15 16:14:34,170 - lava_callback - INFO - Starting async job submit for node 69b437e01727ff69d6f23589 2026-03-15 16:14:34,171 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 16:14:34,186 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b437e01727ff69d6f23589 HTTP/1.1" 200 None 2026-03-15 16:14:34,186 - lava_callback - DEBUG - Processing node 69b437e01727ff69d6f23589: baseline-arm64-baylibre 2026-03-15 16:14:34,187 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b437e01727ff69d6f23589 2026-03-15 16:14:34,187 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 16:14:34,211 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b437e01727ff69d6f23589 HTTP/1.1" 200 None 2026-03-15 16:14:34,212 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 16:14:34,226 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b125a3a870a1dc3343ba94 HTTP/1.1" 200 None 2026-03-15 16:14:34,227 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 16:14:34,276 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b437e01727ff69d6f23589 HTTP/1.1" 200 None 2026-03-15 16:14:34,285 - lava_callback - ERROR - Error processing callback for node 69b437e01727ff69d6f23589: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:56990 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37540 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38532 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35440 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35448 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46164 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:46172 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59984 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41138 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50572 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41432 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34548 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34560 - "GET / HTTP/1.0" 200 OK 2026-03-15 16:16:09,284 - lava_callback - INFO - Received callback for node 69b438391727ff69d6f23598 INFO: 172.21.0.1:34574 - "POST /node/69b438391727ff69d6f23598 HTTP/1.0" 202 Accepted 2026-03-15 16:16:09,290 - lava_callback - INFO - Starting async job submit for node 69b438391727ff69d6f23598 2026-03-15 16:16:09,291 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 16:16:09,312 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b438391727ff69d6f23598 HTTP/1.1" 200 None 2026-03-15 16:16:09,313 - lava_callback - DEBUG - Processing node 69b438391727ff69d6f23598: baseline-arm64-clabbe 2026-03-15 16:16:09,313 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b438391727ff69d6f23598 2026-03-15 16:16:09,314 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 16:16:09,329 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b438391727ff69d6f23598 HTTP/1.1" 200 None 2026-03-15 16:16:09,330 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 16:16:09,344 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b125a3a870a1dc3343ba94 HTTP/1.1" 200 None 2026-03-15 16:16:09,346 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 16:16:09,367 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b438391727ff69d6f23598 HTTP/1.1" 200 None 2026-03-15 16:16:09,374 - lava_callback - ERROR - Error processing callback for node 69b438391727ff69d6f23598: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:41952 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:41966 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39782 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56854 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42736 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41744 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37172 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37182 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55306 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:55310 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44966 - "GET / HTTP/1.0" 200 OK 2026-03-15 16:17:32,936 - lava_callback - INFO - Received callback for node 69b4388b1727ff69d6f235a8 INFO: 172.21.0.1:39408 - "POST /node/69b4388b1727ff69d6f235a8 HTTP/1.0" 202 Accepted 2026-03-15 16:17:32,942 - lava_callback - INFO - Starting async job submit for node 69b4388b1727ff69d6f235a8 2026-03-15 16:17:32,943 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 16:17:32,957 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b4388b1727ff69d6f235a8 HTTP/1.1" 200 None 2026-03-15 16:17:32,958 - lava_callback - DEBUG - Processing node 69b4388b1727ff69d6f235a8: baseline-arm64-clabbe 2026-03-15 16:17:32,958 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b4388b1727ff69d6f235a8 2026-03-15 16:17:32,958 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 16:17:32,980 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b4388b1727ff69d6f235a8 HTTP/1.1" 200 None 2026-03-15 16:17:32,982 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 16:17:32,998 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b125a3a870a1dc3343ba94 HTTP/1.1" 200 None 2026-03-15 16:17:32,999 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 16:17:33,021 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b4388b1727ff69d6f235a8 HTTP/1.1" 200 None 2026-03-15 16:17:33,026 - lava_callback - ERROR - Error processing callback for node 69b4388b1727ff69d6f235a8: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:39418 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56974 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39972 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59558 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59574 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41302 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:41306 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48134 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45302 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58660 - "GET / HTTP/1.0" 200 OK 2026-03-15 16:18:49,501 - lava_callback - INFO - Received callback for node 69b438dd1727ff69d6f235b5 INFO: 172.21.0.1:58674 - "POST /node/69b438dd1727ff69d6f235b5 HTTP/1.0" 202 Accepted 2026-03-15 16:18:49,507 - lava_callback - INFO - Starting async job submit for node 69b438dd1727ff69d6f235b5 2026-03-15 16:18:49,508 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 16:18:49,536 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b438dd1727ff69d6f235b5 HTTP/1.1" 200 None 2026-03-15 16:18:49,537 - lava_callback - DEBUG - Processing node 69b438dd1727ff69d6f235b5: baseline-arm64-clabbe 2026-03-15 16:18:49,537 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b438dd1727ff69d6f235b5 2026-03-15 16:18:49,538 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 16:18:49,560 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b438dd1727ff69d6f235b5 HTTP/1.1" 200 None 2026-03-15 16:18:49,562 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 16:18:49,576 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b125a3a870a1dc3343ba94 HTTP/1.1" 200 None 2026-03-15 16:18:49,577 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 16:18:49,599 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b438dd1727ff69d6f235b5 HTTP/1.1" 200 None 2026-03-15 16:18:49,605 - lava_callback - ERROR - Error processing callback for node 69b438dd1727ff69d6f235b5: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:58426 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57704 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57716 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55904 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:55916 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37622 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55578 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40410 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36096 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35540 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35554 - "GET / HTTP/1.0" 200 OK 2026-03-15 16:20:09,553 - lava_callback - INFO - Received callback for node 69b4392e1727ff69d6f235be INFO: 172.21.0.1:35566 - "POST /node/69b4392e1727ff69d6f235be HTTP/1.0" 202 Accepted 2026-03-15 16:20:09,558 - lava_callback - INFO - Starting async job submit for node 69b4392e1727ff69d6f235be 2026-03-15 16:20:09,559 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 16:20:09,574 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b4392e1727ff69d6f235be HTTP/1.1" 200 None 2026-03-15 16:20:09,575 - lava_callback - DEBUG - Processing node 69b4392e1727ff69d6f235be: baseline-arm64-clabbe 2026-03-15 16:20:09,575 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b4392e1727ff69d6f235be 2026-03-15 16:20:09,576 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 16:20:09,590 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b4392e1727ff69d6f235be HTTP/1.1" 200 None 2026-03-15 16:20:09,591 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 16:20:09,605 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b125a3a870a1dc3343ba94 HTTP/1.1" 200 None 2026-03-15 16:20:09,606 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 16:20:09,629 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b4392e1727ff69d6f235be HTTP/1.1" 200 None 2026-03-15 16:20:09,630 - lava_callback - ERROR - Error processing callback for node 69b4392e1727ff69d6f235be: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:34472 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:34486 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42090 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46598 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45168 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41540 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52432 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52438 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34302 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:34308 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47650 - "GET / HTTP/1.0" 200 OK 2026-03-15 16:21:29,630 - lava_callback - INFO - Received callback for node 69b439801727ff69d6f235c9 INFO: 172.21.0.1:47652 - "POST /node/69b439801727ff69d6f235c9 HTTP/1.0" 202 Accepted 2026-03-15 16:21:29,636 - lava_callback - INFO - Starting async job submit for node 69b439801727ff69d6f235c9 2026-03-15 16:21:29,637 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 16:21:29,652 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b439801727ff69d6f235c9 HTTP/1.1" 200 None 2026-03-15 16:21:29,653 - lava_callback - DEBUG - Processing node 69b439801727ff69d6f235c9: baseline-arm64-clabbe 2026-03-15 16:21:29,653 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b439801727ff69d6f235c9 2026-03-15 16:21:29,654 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 16:21:29,668 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b439801727ff69d6f235c9 HTTP/1.1" 200 None 2026-03-15 16:21:29,669 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 16:21:29,682 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b125a3a870a1dc3343ba94 HTTP/1.1" 200 None 2026-03-15 16:21:29,684 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 16:21:29,704 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b439801727ff69d6f235c9 HTTP/1.1" 200 None 2026-03-15 16:21:29,705 - lava_callback - ERROR - Error processing callback for node 69b439801727ff69d6f235c9: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:41572 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56110 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56686 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50522 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50536 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35608 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:35616 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36862 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47374 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47536 - "GET / HTTP/1.0" 200 OK 2026-03-15 16:22:49,699 - lava_callback - INFO - Received callback for node 69b439d11727ff69d6f235d6 INFO: 172.21.0.1:52200 - "POST /node/69b439d11727ff69d6f235d6 HTTP/1.0" 202 Accepted 2026-03-15 16:22:49,704 - lava_callback - INFO - Starting async job submit for node 69b439d11727ff69d6f235d6 2026-03-15 16:22:49,705 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 16:22:49,741 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b439d11727ff69d6f235d6 HTTP/1.1" 200 None 2026-03-15 16:22:49,742 - lava_callback - DEBUG - Processing node 69b439d11727ff69d6f235d6: baseline-arm64-clabbe 2026-03-15 16:22:49,742 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b439d11727ff69d6f235d6 2026-03-15 16:22:49,743 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 16:22:49,757 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b439d11727ff69d6f235d6 HTTP/1.1" 200 None 2026-03-15 16:22:49,759 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 16:22:49,773 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b125a3a870a1dc3343ba94 HTTP/1.1" 200 None 2026-03-15 16:22:49,775 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 16:22:49,797 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b439d11727ff69d6f235d6 HTTP/1.1" 200 None 2026-03-15 16:22:49,798 - lava_callback - ERROR - Error processing callback for node 69b439d11727ff69d6f235d6: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:52208 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35626 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35634 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35104 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:35108 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42254 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60424 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33406 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42894 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60854 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60868 - "GET / HTTP/1.0" 200 OK 2026-03-15 16:24:09,741 - lava_callback - INFO - Received callback for node 69b43a231727ff69d6f235db INFO: 172.21.0.1:44832 - "POST /node/69b43a231727ff69d6f235db HTTP/1.0" 202 Accepted 2026-03-15 16:24:09,746 - lava_callback - INFO - Starting async job submit for node 69b43a231727ff69d6f235db 2026-03-15 16:24:09,747 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 16:24:09,777 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b43a231727ff69d6f235db HTTP/1.1" 200 None 2026-03-15 16:24:09,778 - lava_callback - DEBUG - Processing node 69b43a231727ff69d6f235db: baseline-arm64-clabbe 2026-03-15 16:24:09,778 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b43a231727ff69d6f235db 2026-03-15 16:24:09,778 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 16:24:09,792 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b43a231727ff69d6f235db HTTP/1.1" 200 None 2026-03-15 16:24:09,794 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 16:24:09,814 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b125a3a870a1dc3343ba94 HTTP/1.1" 200 None 2026-03-15 16:24:09,816 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 16:24:09,838 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b43a231727ff69d6f235db HTTP/1.1" 200 None 2026-03-15 16:24:09,840 - lava_callback - ERROR - Error processing callback for node 69b43a231727ff69d6f235db: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:44838 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:44848 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51400 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50074 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47674 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38748 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34318 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34328 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36358 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:36372 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55044 - "GET / HTTP/1.0" 200 OK 2026-03-15 16:25:29,705 - lava_callback - INFO - Received callback for node 69b43a751727ff69d6f235e6 INFO: 172.21.0.1:33932 - "POST /node/69b43a751727ff69d6f235e6 HTTP/1.0" 202 Accepted 2026-03-15 16:25:29,711 - lava_callback - INFO - Starting async job submit for node 69b43a751727ff69d6f235e6 2026-03-15 16:25:29,712 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 16:25:29,727 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b43a751727ff69d6f235e6 HTTP/1.1" 200 None 2026-03-15 16:25:29,728 - lava_callback - DEBUG - Processing node 69b43a751727ff69d6f235e6: baseline-arm64-clabbe 2026-03-15 16:25:29,728 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b43a751727ff69d6f235e6 2026-03-15 16:25:29,729 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 16:25:29,742 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b43a751727ff69d6f235e6 HTTP/1.1" 200 None 2026-03-15 16:25:29,743 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 16:25:29,759 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b125a3a870a1dc3343ba94 HTTP/1.1" 200 None 2026-03-15 16:25:29,760 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 16:25:29,781 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b43a751727ff69d6f235e6 HTTP/1.1" 200 None 2026-03-15 16:25:29,811 - lava_callback - ERROR - Error processing callback for node 69b43a751727ff69d6f235e6: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:33936 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50152 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37974 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42620 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42628 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56854 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:56866 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54696 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43462 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41768 - "GET / HTTP/1.0" 200 OK 2026-03-15 16:26:49,735 - lava_callback - INFO - Received callback for node 69b43ac61727ff69d6f235f2 INFO: 172.21.0.1:53226 - "POST /node/69b43ac61727ff69d6f235f2 HTTP/1.0" 202 Accepted 2026-03-15 16:26:49,740 - lava_callback - INFO - Starting async job submit for node 69b43ac61727ff69d6f235f2 2026-03-15 16:26:49,741 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 16:26:49,757 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b43ac61727ff69d6f235f2 HTTP/1.1" 200 None 2026-03-15 16:26:49,758 - lava_callback - DEBUG - Processing node 69b43ac61727ff69d6f235f2: baseline-arm64-clabbe 2026-03-15 16:26:49,758 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b43ac61727ff69d6f235f2 2026-03-15 16:26:49,759 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 16:26:49,774 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b43ac61727ff69d6f235f2 HTTP/1.1" 200 None 2026-03-15 16:26:49,776 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 16:26:49,789 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b125a3a870a1dc3343ba94 HTTP/1.1" 200 None 2026-03-15 16:26:49,791 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 16:26:49,811 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b43ac61727ff69d6f235f2 HTTP/1.1" 200 None 2026-03-15 16:26:49,822 - lava_callback - ERROR - Error processing callback for node 69b43ac61727ff69d6f235f2: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:53242 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44178 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44192 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58116 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:58132 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38538 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33672 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54786 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39174 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42784 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42790 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48532 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:48540 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34336 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49522 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47732 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58986 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55096 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55110 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48640 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:48652 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40734 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39390 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47820 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39504 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57312 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57318 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59608 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:59622 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37646 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44380 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54504 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59812 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55770 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55774 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38674 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:38678 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51440 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43146 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48290 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59786 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60958 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60974 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44164 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:44180 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57668 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44520 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46212 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57428 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57220 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57226 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39536 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:39552 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57280 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50930 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53826 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49004 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49332 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49346 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34620 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:34632 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37210 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55570 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40870 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60040 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45834 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45840 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58218 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:58232 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51012 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45944 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38260 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59108 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47950 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47966 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56034 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:56048 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34632 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60710 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46176 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36870 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56926 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56928 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58608 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:58610 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54206 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53812 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36692 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40180 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44720 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44732 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56696 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:56706 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48896 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51028 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55176 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41102 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33322 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33334 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46540 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:46546 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57760 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40704 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37408 - "GET / HTTP/1.0" 200 OK 2026-03-15 16:39:55,429 - lava_callback - INFO - Received callback for node 69b43dce1727ff69d6f23605 INFO: 172.21.0.1:33928 - "POST /node/69b43dce1727ff69d6f23605 HTTP/1.0" 202 Accepted 2026-03-15 16:39:55,435 - lava_callback - INFO - Starting async job submit for node 69b43dce1727ff69d6f23605 2026-03-15 16:39:55,436 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 16:39:55,460 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b43dce1727ff69d6f23605 HTTP/1.1" 200 None 2026-03-15 16:39:55,461 - lava_callback - DEBUG - Processing node 69b43dce1727ff69d6f23605: baseline-arm-baylibre 2026-03-15 16:39:55,461 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b43dce1727ff69d6f23605 2026-03-15 16:39:55,462 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 16:39:55,477 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b43dce1727ff69d6f23605 HTTP/1.1" 200 None 2026-03-15 16:39:55,478 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 16:39:55,499 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b195f7a26b422765ba3705 HTTP/1.1" 200 None 2026-03-15 16:39:55,501 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 16:39:55,527 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b43dce1727ff69d6f23605 HTTP/1.1" 200 None 2026-03-15 16:39:55,528 - lava_callback - ERROR - Error processing callback for node 69b43dce1727ff69d6f23605: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:33934 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60762 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60776 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55320 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:55332 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49062 - "GET / HTTP/1.0" 200 OK 2026-03-15 16:40:35,430 - lava_callback - INFO - Received callback for node 69b43df41727ff69d6f23618 INFO: 172.21.0.1:49684 - "POST /node/69b43df41727ff69d6f23618 HTTP/1.0" 202 Accepted 2026-03-15 16:40:35,435 - lava_callback - INFO - Starting async job submit for node 69b43df41727ff69d6f23618 2026-03-15 16:40:35,436 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 16:40:35,450 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b43df41727ff69d6f23618 HTTP/1.1" 200 None 2026-03-15 16:40:35,451 - lava_callback - DEBUG - Processing node 69b43df41727ff69d6f23618: baseline-arm-baylibre 2026-03-15 16:40:35,451 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b43df41727ff69d6f23618 2026-03-15 16:40:35,452 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 16:40:35,466 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b43df41727ff69d6f23618 HTTP/1.1" 200 None 2026-03-15 16:40:35,467 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 16:40:35,481 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b195f7a26b422765ba3705 HTTP/1.1" 200 None 2026-03-15 16:40:35,482 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 16:40:35,505 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b43df41727ff69d6f23618 HTTP/1.1" 200 None 2026-03-15 16:40:35,510 - lava_callback - ERROR - Error processing callback for node 69b43df41727ff69d6f23618: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:49686 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49890 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33422 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60118 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60122 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43570 - "GET /api/metrics HTTP/1.0" 200 OK 2026-03-15 16:41:15,519 - lava_callback - INFO - Received callback for node 69b43e1a1727ff69d6f23621 INFO: 172.21.0.1:43576 - "POST /node/69b43e1a1727ff69d6f23621 HTTP/1.0" 202 Accepted 2026-03-15 16:41:15,524 - lava_callback - INFO - Starting async job submit for node 69b43e1a1727ff69d6f23621 2026-03-15 16:41:15,525 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 16:41:15,539 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b43e1a1727ff69d6f23621 HTTP/1.1" 200 None 2026-03-15 16:41:15,540 - lava_callback - DEBUG - Processing node 69b43e1a1727ff69d6f23621: baseline-arm-baylibre 2026-03-15 16:41:15,540 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b43e1a1727ff69d6f23621 2026-03-15 16:41:15,541 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 16:41:15,554 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b43e1a1727ff69d6f23621 HTTP/1.1" 200 None 2026-03-15 16:41:15,555 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 16:41:15,569 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b195f7a26b422765ba3705 HTTP/1.1" 200 None 2026-03-15 16:41:15,570 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 16:41:15,628 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b43e1a1727ff69d6f23621 HTTP/1.1" 200 None 2026-03-15 16:41:15,639 - lava_callback - ERROR - Error processing callback for node 69b43e1a1727ff69d6f23621: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:43580 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59702 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54586 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48666 - "GET / HTTP/1.0" 200 OK 2026-03-15 16:41:55,476 - lava_callback - INFO - Received callback for node 69b43e3e1727ff69d6f2362a INFO: 172.21.0.1:42680 - "POST /node/69b43e3e1727ff69d6f2362a HTTP/1.0" 202 Accepted 2026-03-15 16:41:55,482 - lava_callback - INFO - Starting async job submit for node 69b43e3e1727ff69d6f2362a 2026-03-15 16:41:55,483 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 16:41:55,497 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b43e3e1727ff69d6f2362a HTTP/1.1" 200 None 2026-03-15 16:41:55,498 - lava_callback - DEBUG - Processing node 69b43e3e1727ff69d6f2362a: baseline-arm-baylibre 2026-03-15 16:41:55,498 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b43e3e1727ff69d6f2362a 2026-03-15 16:41:55,499 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 16:41:55,512 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b43e3e1727ff69d6f2362a HTTP/1.1" 200 None 2026-03-15 16:41:55,513 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 16:41:55,526 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b195f7a26b422765ba3705 HTTP/1.1" 200 None 2026-03-15 16:41:55,528 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 16:41:55,548 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b43e3e1727ff69d6f2362a HTTP/1.1" 200 None 2026-03-15 16:41:55,555 - lava_callback - ERROR - Error processing callback for node 69b43e3e1727ff69d6f2362a: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:42682 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52034 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52042 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34806 - "GET /api/metrics HTTP/1.0" 200 OK 2026-03-15 16:42:15,489 - lava_callback - INFO - Received callback for node 69b43e641727ff69d6f23634 INFO: 172.21.0.1:34818 - "POST /node/69b43e641727ff69d6f23634 HTTP/1.0" 202 Accepted 2026-03-15 16:42:15,495 - lava_callback - INFO - Starting async job submit for node 69b43e641727ff69d6f23634 2026-03-15 16:42:15,496 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 16:42:15,514 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b43e641727ff69d6f23634 HTTP/1.1" 200 None 2026-03-15 16:42:15,515 - lava_callback - DEBUG - Processing node 69b43e641727ff69d6f23634: baseline-arm-baylibre 2026-03-15 16:42:15,516 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b43e641727ff69d6f23634 2026-03-15 16:42:15,516 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 16:42:15,530 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b43e641727ff69d6f23634 HTTP/1.1" 200 None 2026-03-15 16:42:15,532 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 16:42:15,545 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b195f7a26b422765ba3705 HTTP/1.1" 200 None 2026-03-15 16:42:15,547 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 16:42:15,568 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b43e641727ff69d6f23634 HTTP/1.1" 200 None 2026-03-15 16:42:15,579 - lava_callback - ERROR - Error processing callback for node 69b43e641727ff69d6f23634: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:34822 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43592 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40922 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50154 - "GET / HTTP/1.0" 200 OK 2026-03-15 16:42:55,592 - lava_callback - INFO - Received callback for node 69b43e881727ff69d6f2363d INFO: 172.21.0.1:56436 - "POST /node/69b43e881727ff69d6f2363d HTTP/1.0" 202 Accepted 2026-03-15 16:42:55,598 - lava_callback - INFO - Starting async job submit for node 69b43e881727ff69d6f2363d 2026-03-15 16:42:55,598 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 16:42:55,613 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b43e881727ff69d6f2363d HTTP/1.1" 200 None 2026-03-15 16:42:55,614 - lava_callback - DEBUG - Processing node 69b43e881727ff69d6f2363d: baseline-arm-baylibre 2026-03-15 16:42:55,614 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b43e881727ff69d6f2363d 2026-03-15 16:42:55,615 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 16:42:55,629 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b43e881727ff69d6f2363d HTTP/1.1" 200 None 2026-03-15 16:42:55,630 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 16:42:55,652 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b195f7a26b422765ba3705 HTTP/1.1" 200 None 2026-03-15 16:42:55,654 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 16:42:55,675 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b43e881727ff69d6f2363d HTTP/1.1" 200 None 2026-03-15 16:42:55,676 - lava_callback - ERROR - Error processing callback for node 69b43e881727ff69d6f2363d: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:56438 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36630 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36638 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44460 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:44470 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48026 - "GET / HTTP/1.0" 200 OK 2026-03-15 16:43:30,453 - lava_callback - INFO - Received callback for node 69b43ead1727ff69d6f23646 INFO: 172.21.0.1:43616 - "POST /node/69b43ead1727ff69d6f23646 HTTP/1.0" 202 Accepted 2026-03-15 16:43:30,459 - lava_callback - INFO - Starting async job submit for node 69b43ead1727ff69d6f23646 2026-03-15 16:43:30,460 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 16:43:30,473 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b43ead1727ff69d6f23646 HTTP/1.1" 200 None 2026-03-15 16:43:30,474 - lava_callback - DEBUG - Processing node 69b43ead1727ff69d6f23646: baseline-arm-clabbe 2026-03-15 16:43:30,475 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b43ead1727ff69d6f23646 2026-03-15 16:43:30,475 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 16:43:30,489 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b43ead1727ff69d6f23646 HTTP/1.1" 200 None 2026-03-15 16:43:30,490 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 16:43:30,504 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b195f7a26b422765ba3705 HTTP/1.1" 200 None 2026-03-15 16:43:30,506 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 16:43:30,526 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b43ead1727ff69d6f23646 HTTP/1.1" 200 None 2026-03-15 16:43:30,528 - lava_callback - ERROR - Error processing callback for node 69b43ead1727ff69d6f23646: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:43618 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46566 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58010 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45358 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45362 - "GET / HTTP/1.0" 200 OK 2026-03-15 16:44:10,598 - lava_callback - INFO - Received callback for node 69b43ed21727ff69d6f2364f INFO: 172.21.0.1:34760 - "POST /node/69b43ed21727ff69d6f2364f HTTP/1.0" 202 Accepted 2026-03-15 16:44:10,603 - lava_callback - INFO - Starting async job submit for node 69b43ed21727ff69d6f2364f 2026-03-15 16:44:10,604 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 16:44:10,629 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b43ed21727ff69d6f2364f HTTP/1.1" 200 None 2026-03-15 16:44:10,630 - lava_callback - DEBUG - Processing node 69b43ed21727ff69d6f2364f: baseline-arm-clabbe 2026-03-15 16:44:10,630 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b43ed21727ff69d6f2364f 2026-03-15 16:44:10,631 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 16:44:10,645 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b43ed21727ff69d6f2364f HTTP/1.1" 200 None 2026-03-15 16:44:10,646 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 16:44:10,659 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b195f7a26b422765ba3705 HTTP/1.1" 200 None 2026-03-15 16:44:10,661 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 16:44:10,681 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b43ed21727ff69d6f2364f HTTP/1.1" 200 None 2026-03-15 16:44:10,686 - lava_callback - ERROR - Error processing callback for node 69b43ed21727ff69d6f2364f: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:34762 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:34766 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38910 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58822 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34198 - "GET / HTTP/1.0" 200 OK 2026-03-15 16:44:50,513 - lava_callback - INFO - Received callback for node 69b43ef71727ff69d6f2365a INFO: 172.21.0.1:58060 - "POST /node/69b43ef71727ff69d6f2365a HTTP/1.0" 202 Accepted 2026-03-15 16:44:50,519 - lava_callback - INFO - Starting async job submit for node 69b43ef71727ff69d6f2365a 2026-03-15 16:44:50,520 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 16:44:50,534 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b43ef71727ff69d6f2365a HTTP/1.1" 200 None 2026-03-15 16:44:50,535 - lava_callback - DEBUG - Processing node 69b43ef71727ff69d6f2365a: baseline-arm-clabbe 2026-03-15 16:44:50,535 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b43ef71727ff69d6f2365a 2026-03-15 16:44:50,535 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 16:44:50,552 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b43ef71727ff69d6f2365a HTTP/1.1" 200 None 2026-03-15 16:44:50,553 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 16:44:50,569 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b195f7a26b422765ba3705 HTTP/1.1" 200 None 2026-03-15 16:44:50,571 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 16:44:50,592 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b43ef71727ff69d6f2365a HTTP/1.1" 200 None 2026-03-15 16:44:50,599 - lava_callback - ERROR - Error processing callback for node 69b43ef71727ff69d6f2365a: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:58064 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55936 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55948 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59582 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:59584 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40652 - "GET / HTTP/1.0" 200 OK 2026-03-15 16:45:30,496 - lava_callback - INFO - Received callback for node 69b43f1b1727ff69d6f23661 INFO: 172.21.0.1:39680 - "POST /node/69b43f1b1727ff69d6f23661 HTTP/1.0" 202 Accepted 2026-03-15 16:45:30,502 - lava_callback - INFO - Starting async job submit for node 69b43f1b1727ff69d6f23661 2026-03-15 16:45:30,503 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 16:45:30,518 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b43f1b1727ff69d6f23661 HTTP/1.1" 200 None 2026-03-15 16:45:30,519 - lava_callback - DEBUG - Processing node 69b43f1b1727ff69d6f23661: baseline-arm-clabbe 2026-03-15 16:45:30,519 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b43f1b1727ff69d6f23661 2026-03-15 16:45:30,520 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 16:45:30,533 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b43f1b1727ff69d6f23661 HTTP/1.1" 200 None 2026-03-15 16:45:30,534 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 16:45:30,558 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b195f7a26b422765ba3705 HTTP/1.1" 200 None 2026-03-15 16:45:30,560 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 16:45:30,592 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b43f1b1727ff69d6f23661 HTTP/1.1" 200 None 2026-03-15 16:45:30,593 - lava_callback - ERROR - Error processing callback for node 69b43f1b1727ff69d6f23661: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:39692 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45798 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33144 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58962 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58968 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59444 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:59452 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56362 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48294 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40738 - "GET / HTTP/1.0" 200 OK 2026-03-15 16:46:50,631 - lava_callback - INFO - Received callback for node 69b43f661727ff69d6f23674 INFO: 172.21.0.1:54860 - "POST /node/69b43f661727ff69d6f23674 HTTP/1.0" 202 Accepted 2026-03-15 16:46:50,636 - lava_callback - INFO - Starting async job submit for node 69b43f661727ff69d6f23674 2026-03-15 16:46:50,637 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 16:46:50,660 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b43f661727ff69d6f23674 HTTP/1.1" 200 None 2026-03-15 16:46:50,661 - lava_callback - DEBUG - Processing node 69b43f661727ff69d6f23674: baseline-arm-clabbe 2026-03-15 16:46:50,662 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b43f661727ff69d6f23674 2026-03-15 16:46:50,662 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 16:46:50,677 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b43f661727ff69d6f23674 HTTP/1.1" 200 None 2026-03-15 16:46:50,678 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 16:46:50,701 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b195f7a26b422765ba3705 HTTP/1.1" 200 None 2026-03-15 16:46:50,702 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 16:46:50,723 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b43f661727ff69d6f23674 HTTP/1.1" 200 None 2026-03-15 16:46:50,724 - lava_callback - ERROR - Error processing callback for node 69b43f661727ff69d6f23674: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:54876 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59682 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59698 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47984 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:47988 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54464 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56054 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42602 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40438 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48180 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48184 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60016 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:60022 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45188 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40406 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60392 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55078 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39008 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39022 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45226 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:45228 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48062 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:32844 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58346 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47436 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55822 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55832 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41376 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:41380 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47852 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60782 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34606 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49326 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60530 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60544 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45820 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:45826 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38696 - "GET / HTTP/1.0" 200 OK 2026-03-15 16:51:36,376 - lava_callback - INFO - Received callback for node 69b4408b1727ff69d6f23682 INFO: 172.21.0.1:43440 - "POST /node/69b4408b1727ff69d6f23682 HTTP/1.0" 202 Accepted 2026-03-15 16:51:36,382 - lava_callback - INFO - Starting async job submit for node 69b4408b1727ff69d6f23682 2026-03-15 16:51:36,382 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 16:51:36,419 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b4408b1727ff69d6f23682 HTTP/1.1" 200 None 2026-03-15 16:51:36,420 - lava_callback - DEBUG - Processing node 69b4408b1727ff69d6f23682: baseline-arm-baylibre 2026-03-15 16:51:36,420 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b4408b1727ff69d6f23682 2026-03-15 16:51:36,420 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 16:51:36,453 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b4408b1727ff69d6f23682 HTTP/1.1" 200 None 2026-03-15 16:51:36,454 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 16:51:36,467 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ac4f6846f7ae8ff3364c2c HTTP/1.1" 200 None 2026-03-15 16:51:36,469 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 16:51:36,495 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b4408b1727ff69d6f23682 HTTP/1.1" 200 None 2026-03-15 16:51:36,497 - lava_callback - ERROR - Error processing callback for node 69b4408b1727ff69d6f23682: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:43452 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53602 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44076 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35808 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35812 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59052 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:59066 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42396 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54760 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36866 - "GET / HTTP/1.0" 200 OK 2026-03-15 16:52:56,174 - lava_callback - INFO - Received callback for node 69b440dd1727ff69d6f2368d INFO: 172.21.0.1:41238 - "POST /node/69b440dd1727ff69d6f2368d HTTP/1.0" 202 Accepted 2026-03-15 16:52:56,180 - lava_callback - INFO - Starting async job submit for node 69b440dd1727ff69d6f2368d 2026-03-15 16:52:56,181 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 16:52:56,195 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b440dd1727ff69d6f2368d HTTP/1.1" 200 None 2026-03-15 16:52:56,196 - lava_callback - DEBUG - Processing node 69b440dd1727ff69d6f2368d: baseline-arm-baylibre 2026-03-15 16:52:56,197 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b440dd1727ff69d6f2368d 2026-03-15 16:52:56,197 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 16:52:56,218 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b440dd1727ff69d6f2368d HTTP/1.1" 200 None 2026-03-15 16:52:56,220 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 16:52:56,234 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ac4f6846f7ae8ff3364c2c HTTP/1.1" 200 None 2026-03-15 16:52:56,236 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 16:52:56,257 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b440dd1727ff69d6f2368d HTTP/1.1" 200 None 2026-03-15 16:52:56,269 - lava_callback - ERROR - Error processing callback for node 69b440dd1727ff69d6f2368d: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:41250 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38254 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38260 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33470 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:33482 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41066 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40086 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43226 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52616 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58704 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58714 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43158 - "GET /api/metrics HTTP/1.0" 200 OK 2026-03-15 16:54:16,208 - lava_callback - INFO - Received callback for node 69b4412a1727ff69d6f2369a INFO: 172.21.0.1:43174 - "POST /node/69b4412a1727ff69d6f2369a HTTP/1.0" 202 Accepted 2026-03-15 16:54:16,214 - lava_callback - INFO - Starting async job submit for node 69b4412a1727ff69d6f2369a 2026-03-15 16:54:16,215 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 16:54:16,235 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b4412a1727ff69d6f2369a HTTP/1.1" 200 None 2026-03-15 16:54:16,236 - lava_callback - DEBUG - Processing node 69b4412a1727ff69d6f2369a: baseline-arm-baylibre 2026-03-15 16:54:16,237 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b4412a1727ff69d6f2369a 2026-03-15 16:54:16,237 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 16:54:16,262 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b4412a1727ff69d6f2369a HTTP/1.1" 200 None 2026-03-15 16:54:16,264 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 16:54:16,278 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ac4f6846f7ae8ff3364c2c HTTP/1.1" 200 None 2026-03-15 16:54:16,279 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 16:54:16,300 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b4412a1727ff69d6f2369a HTTP/1.1" 200 None 2026-03-15 16:54:16,301 - lava_callback - ERROR - Error processing callback for node 69b4412a1727ff69d6f2369a: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:43190 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50212 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47000 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54438 - "GET / HTTP/1.0" 200 OK 2026-03-15 16:54:56,190 - lava_callback - INFO - Received callback for node 69b441521727ff69d6f236a5 INFO: 172.21.0.1:60936 - "POST /node/69b441521727ff69d6f236a5 HTTP/1.0" 202 Accepted 2026-03-15 16:54:56,195 - lava_callback - INFO - Starting async job submit for node 69b441521727ff69d6f236a5 2026-03-15 16:54:56,196 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 16:54:56,216 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b441521727ff69d6f236a5 HTTP/1.1" 200 None 2026-03-15 16:54:56,217 - lava_callback - DEBUG - Processing node 69b441521727ff69d6f236a5: baseline-arm-baylibre 2026-03-15 16:54:56,217 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b441521727ff69d6f236a5 2026-03-15 16:54:56,218 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 16:54:56,231 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b441521727ff69d6f236a5 HTTP/1.1" 200 None 2026-03-15 16:54:56,233 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 16:54:56,255 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ac4f6846f7ae8ff3364c2c HTTP/1.1" 200 None 2026-03-15 16:54:56,257 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 16:54:56,299 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b441521727ff69d6f236a5 HTTP/1.1" 200 None 2026-03-15 16:54:56,301 - lava_callback - ERROR - Error processing callback for node 69b441521727ff69d6f236a5: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:60938 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41446 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41456 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39646 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:39650 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40670 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57924 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39068 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57170 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46840 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46842 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33342 - "GET /api/metrics HTTP/1.0" 200 OK 2026-03-15 16:56:16,336 - lava_callback - INFO - Received callback for node 69b441a31727ff69d6f236b2 INFO: 172.21.0.1:33344 - "POST /node/69b441a31727ff69d6f236b2 HTTP/1.0" 202 Accepted 2026-03-15 16:56:16,341 - lava_callback - INFO - Starting async job submit for node 69b441a31727ff69d6f236b2 2026-03-15 16:56:16,342 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 16:56:16,384 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b441a31727ff69d6f236b2 HTTP/1.1" 200 None 2026-03-15 16:56:16,385 - lava_callback - DEBUG - Processing node 69b441a31727ff69d6f236b2: baseline-arm-baylibre 2026-03-15 16:56:16,385 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b441a31727ff69d6f236b2 2026-03-15 16:56:16,386 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 16:56:16,410 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b441a31727ff69d6f236b2 HTTP/1.1" 200 None 2026-03-15 16:56:16,411 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 16:56:16,424 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ac4f6846f7ae8ff3364c2c HTTP/1.1" 200 None 2026-03-15 16:56:16,426 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 16:56:16,448 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b441a31727ff69d6f236b2 HTTP/1.1" 200 None 2026-03-15 16:56:16,459 - lava_callback - ERROR - Error processing callback for node 69b441a31727ff69d6f236b2: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:33352 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33612 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39344 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35990 - "GET / HTTP/1.0" 200 OK 2026-03-15 16:56:56,373 - lava_callback - INFO - Received callback for node 69b441cd1727ff69d6f236bf INFO: 172.21.0.1:36838 - "POST /node/69b441cd1727ff69d6f236bf HTTP/1.0" 202 Accepted 2026-03-15 16:56:56,379 - lava_callback - INFO - Starting async job submit for node 69b441cd1727ff69d6f236bf 2026-03-15 16:56:56,380 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 16:56:56,421 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b441cd1727ff69d6f236bf HTTP/1.1" 200 None 2026-03-15 16:56:56,421 - lava_callback - DEBUG - Processing node 69b441cd1727ff69d6f236bf: baseline-arm-baylibre 2026-03-15 16:56:56,422 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b441cd1727ff69d6f236bf 2026-03-15 16:56:56,422 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 16:56:56,444 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b441cd1727ff69d6f236bf HTTP/1.1" 200 None 2026-03-15 16:56:56,445 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 16:56:56,480 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ac4f6846f7ae8ff3364c2c HTTP/1.1" 200 None 2026-03-15 16:56:56,482 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 16:56:56,507 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b441cd1727ff69d6f236bf HTTP/1.1" 200 None 2026-03-15 16:56:56,510 - lava_callback - ERROR - Error processing callback for node 69b441cd1727ff69d6f236bf: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:36844 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52996 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53002 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33464 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:33472 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33868 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52926 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60832 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49444 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54004 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54012 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38572 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:38588 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33566 - "GET / HTTP/1.0" 200 OK 2026-03-15 16:58:31,084 - lava_callback - INFO - Received callback for node 69b442261727ff69d6f236cb INFO: 172.21.0.1:41008 - "POST /node/69b442261727ff69d6f236cb HTTP/1.0" 202 Accepted 2026-03-15 16:58:31,090 - lava_callback - INFO - Starting async job submit for node 69b442261727ff69d6f236cb 2026-03-15 16:58:31,091 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 16:58:31,124 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b442261727ff69d6f236cb HTTP/1.1" 200 None 2026-03-15 16:58:31,126 - lava_callback - DEBUG - Processing node 69b442261727ff69d6f236cb: baseline-arm-clabbe 2026-03-15 16:58:31,126 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b442261727ff69d6f236cb 2026-03-15 16:58:31,126 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 16:58:31,149 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b442261727ff69d6f236cb HTTP/1.1" 200 None 2026-03-15 16:58:31,151 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 16:58:31,182 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ac4f6846f7ae8ff3364c2c HTTP/1.1" 200 None 2026-03-15 16:58:31,183 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 16:58:31,211 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b442261727ff69d6f236cb HTTP/1.1" 200 None 2026-03-15 16:58:31,213 - lava_callback - ERROR - Error processing callback for node 69b442261727ff69d6f236cb: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:41020 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41588 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59622 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37102 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37116 - "GET / HTTP/1.0" 200 OK 2026-03-15 16:59:11,110 - lava_callback - INFO - Received callback for node 69b4424e1727ff69d6f236d7 INFO: 172.21.0.1:37158 - "POST /node/69b4424e1727ff69d6f236d7 HTTP/1.0" 202 Accepted 2026-03-15 16:59:11,115 - lava_callback - INFO - Starting async job submit for node 69b4424e1727ff69d6f236d7 2026-03-15 16:59:11,116 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 16:59:11,139 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b4424e1727ff69d6f236d7 HTTP/1.1" 200 None 2026-03-15 16:59:11,140 - lava_callback - DEBUG - Processing node 69b4424e1727ff69d6f236d7: baseline-arm-clabbe 2026-03-15 16:59:11,140 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b4424e1727ff69d6f236d7 2026-03-15 16:59:11,141 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 16:59:11,154 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b4424e1727ff69d6f236d7 HTTP/1.1" 200 None 2026-03-15 16:59:11,156 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 16:59:11,196 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ac4f6846f7ae8ff3364c2c HTTP/1.1" 200 None 2026-03-15 16:59:11,198 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 16:59:11,219 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b4424e1727ff69d6f236d7 HTTP/1.1" 200 None 2026-03-15 16:59:11,224 - lava_callback - ERROR - Error processing callback for node 69b4424e1727ff69d6f236d7: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:37174 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:37182 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56376 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55818 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48530 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48306 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50244 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50248 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33062 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:33078 - "GET / HTTP/1.0" 200 OK 2026-03-15 17:00:16,545 - lava_callback - INFO - Received callback for node 69b442931727ff69d6f236e2 INFO: 172.21.0.1:33090 - "POST /node/69b442931727ff69d6f236e2 HTTP/1.0" 202 Accepted 2026-03-15 17:00:16,550 - lava_callback - INFO - Starting async job submit for node 69b442931727ff69d6f236e2 2026-03-15 17:00:16,551 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 17:00:16,566 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b442931727ff69d6f236e2 HTTP/1.1" 200 None 2026-03-15 17:00:16,567 - lava_callback - DEBUG - Processing node 69b442931727ff69d6f236e2: baseline-arm-baylibre 2026-03-15 17:00:16,567 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b442931727ff69d6f236e2 2026-03-15 17:00:16,568 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 17:00:16,581 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b442931727ff69d6f236e2 HTTP/1.1" 200 None 2026-03-15 17:00:16,582 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 17:00:16,604 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aef424ce46d8ec186ab80e HTTP/1.1" 200 None 2026-03-15 17:00:16,605 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 17:00:16,634 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b442931727ff69d6f236e2 HTTP/1.1" 200 None 2026-03-15 17:00:16,636 - lava_callback - ERROR - Error processing callback for node 69b442931727ff69d6f236e2: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:34070 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54840 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47014 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48228 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41030 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41036 - "GET / HTTP/1.0" 200 OK 2026-03-15 17:01:11,257 - lava_callback - INFO - Received callback for node 69b442c61727ff69d6f236ed INFO: 172.21.0.1:41504 - "POST /node/69b442c61727ff69d6f236ed HTTP/1.0" 202 Accepted 2026-03-15 17:01:11,263 - lava_callback - INFO - Starting async job submit for node 69b442c61727ff69d6f236ed 2026-03-15 17:01:11,264 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 17:01:11,284 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b442c61727ff69d6f236ed HTTP/1.1" 200 None 2026-03-15 17:01:11,285 - lava_callback - DEBUG - Processing node 69b442c61727ff69d6f236ed: baseline-arm-clabbe 2026-03-15 17:01:11,285 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b442c61727ff69d6f236ed 2026-03-15 17:01:11,286 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 17:01:11,299 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b442c61727ff69d6f236ed HTTP/1.1" 200 None 2026-03-15 17:01:11,301 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 17:01:11,314 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ac4f6846f7ae8ff3364c2c HTTP/1.1" 200 None 2026-03-15 17:01:11,316 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 17:01:11,345 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b442c61727ff69d6f236ed HTTP/1.1" 200 None 2026-03-15 17:01:11,346 - lava_callback - ERROR - Error processing callback for node 69b442c61727ff69d6f236ed: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:41506 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:41516 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60978 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58248 - "GET / HTTP/1.0" 200 OK 2026-03-15 17:01:36,652 - lava_callback - INFO - Received callback for node 69b442e51727ff69d6f236f8 INFO: 172.21.0.1:58258 - "POST /node/69b442e51727ff69d6f236f8 HTTP/1.0" 202 Accepted 2026-03-15 17:01:36,657 - lava_callback - INFO - Starting async job submit for node 69b442e51727ff69d6f236f8 2026-03-15 17:01:36,658 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 17:01:36,692 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b442e51727ff69d6f236f8 HTTP/1.1" 200 None 2026-03-15 17:01:36,693 - lava_callback - DEBUG - Processing node 69b442e51727ff69d6f236f8: baseline-arm-baylibre 2026-03-15 17:01:36,693 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b442e51727ff69d6f236f8 2026-03-15 17:01:36,694 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 17:01:36,729 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b442e51727ff69d6f236f8 HTTP/1.1" 200 None 2026-03-15 17:01:36,730 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 17:01:36,781 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aef424ce46d8ec186ab80e HTTP/1.1" 200 None 2026-03-15 17:01:36,783 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 17:01:36,804 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b442e51727ff69d6f236f8 HTTP/1.1" 200 None 2026-03-15 17:01:36,805 - lava_callback - ERROR - Error processing callback for node 69b442e51727ff69d6f236f8: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:38318 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58872 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52014 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52020 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42466 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:42480 - "GET / HTTP/1.0" 200 OK 2026-03-15 17:02:16,663 - lava_callback - INFO - Received callback for node 69b4430b1727ff69d6f23703 INFO: 172.21.0.1:42494 - "POST /node/69b4430b1727ff69d6f23703 HTTP/1.0" 202 Accepted 2026-03-15 17:02:16,669 - lava_callback - INFO - Starting async job submit for node 69b4430b1727ff69d6f23703 2026-03-15 17:02:16,669 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 17:02:16,718 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b4430b1727ff69d6f23703 HTTP/1.1" 200 None 2026-03-15 17:02:16,719 - lava_callback - DEBUG - Processing node 69b4430b1727ff69d6f23703: baseline-arm-baylibre 2026-03-15 17:02:16,719 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b4430b1727ff69d6f23703 2026-03-15 17:02:16,720 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 17:02:16,744 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b4430b1727ff69d6f23703 HTTP/1.1" 200 None 2026-03-15 17:02:16,745 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 17:02:16,776 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aef424ce46d8ec186ab80e HTTP/1.1" 200 None 2026-03-15 17:02:16,778 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 17:02:16,799 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b4430b1727ff69d6f23703 HTTP/1.1" 200 None 2026-03-15 17:02:16,804 - lava_callback - ERROR - Error processing callback for node 69b4430b1727ff69d6f23703: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:52648 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42286 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37726 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35464 - "GET / HTTP/1.0" 200 OK 2026-03-15 17:02:56,667 - lava_callback - INFO - Received callback for node 69b443341727ff69d6f2370e INFO: 172.21.0.1:35466 - "POST /node/69b443341727ff69d6f2370e HTTP/1.0" 202 Accepted 2026-03-15 17:02:56,673 - lava_callback - INFO - Starting async job submit for node 69b443341727ff69d6f2370e 2026-03-15 17:02:56,674 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 17:02:56,694 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b443341727ff69d6f2370e HTTP/1.1" 200 None 2026-03-15 17:02:56,695 - lava_callback - DEBUG - Processing node 69b443341727ff69d6f2370e: baseline-arm-baylibre 2026-03-15 17:02:56,695 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b443341727ff69d6f2370e 2026-03-15 17:02:56,696 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 17:02:56,718 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b443341727ff69d6f2370e HTTP/1.1" 200 None 2026-03-15 17:02:56,720 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 17:02:56,736 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aef424ce46d8ec186ab80e HTTP/1.1" 200 None 2026-03-15 17:02:56,737 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 17:02:56,758 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b443341727ff69d6f2370e HTTP/1.1" 200 None 2026-03-15 17:02:56,764 - lava_callback - ERROR - Error processing callback for node 69b443341727ff69d6f2370e: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:44456 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44472 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45126 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:45138 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56908 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41610 - "GET / HTTP/1.0" 200 OK 2026-03-15 17:03:36,714 - lava_callback - INFO - Received callback for node 69b4435d1727ff69d6f23719 INFO: 172.21.0.1:41614 - "POST /node/69b4435d1727ff69d6f23719 HTTP/1.0" 202 Accepted 2026-03-15 17:03:36,720 - lava_callback - INFO - Starting async job submit for node 69b4435d1727ff69d6f23719 2026-03-15 17:03:36,721 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 17:03:36,741 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b4435d1727ff69d6f23719 HTTP/1.1" 200 None 2026-03-15 17:03:36,742 - lava_callback - DEBUG - Processing node 69b4435d1727ff69d6f23719: baseline-arm-baylibre 2026-03-15 17:03:36,742 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b4435d1727ff69d6f23719 2026-03-15 17:03:36,743 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 17:03:36,756 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b4435d1727ff69d6f23719 HTTP/1.1" 200 None 2026-03-15 17:03:36,758 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 17:03:36,771 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aef424ce46d8ec186ab80e HTTP/1.1" 200 None 2026-03-15 17:03:36,773 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 17:03:36,793 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b4435d1727ff69d6f23719 HTTP/1.1" 200 None 2026-03-15 17:03:36,799 - lava_callback - ERROR - Error processing callback for node 69b4435d1727ff69d6f23719: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:50834 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48496 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52532 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52534 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54674 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:54690 - "GET / HTTP/1.0" 200 OK 2026-03-15 17:04:16,782 - lava_callback - INFO - Received callback for node 69b443861727ff69d6f23724 INFO: 172.21.0.1:54704 - "POST /node/69b443861727ff69d6f23724 HTTP/1.0" 202 Accepted 2026-03-15 17:04:16,787 - lava_callback - INFO - Starting async job submit for node 69b443861727ff69d6f23724 2026-03-15 17:04:16,788 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 17:04:16,810 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b443861727ff69d6f23724 HTTP/1.1" 200 None 2026-03-15 17:04:16,811 - lava_callback - DEBUG - Processing node 69b443861727ff69d6f23724: baseline-arm-baylibre 2026-03-15 17:04:16,811 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b443861727ff69d6f23724 2026-03-15 17:04:16,812 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 17:04:16,827 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b443861727ff69d6f23724 HTTP/1.1" 200 None 2026-03-15 17:04:16,829 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 17:04:16,842 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aef424ce46d8ec186ab80e HTTP/1.1" 200 None 2026-03-15 17:04:16,843 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 17:04:16,864 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b443861727ff69d6f23724 HTTP/1.1" 200 None 2026-03-15 17:04:16,865 - lava_callback - ERROR - Error processing callback for node 69b443861727ff69d6f23724: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:49502 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39160 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51770 - "GET / HTTP/1.0" 200 OK 2026-03-15 17:04:51,366 - lava_callback - INFO - Received callback for node 69b443ab1727ff69d6f23732 INFO: 172.21.0.1:38378 - "POST /node/69b443ab1727ff69d6f23732 HTTP/1.0" 202 Accepted 2026-03-15 17:04:51,371 - lava_callback - INFO - Starting async job submit for node 69b443ab1727ff69d6f23732 2026-03-15 17:04:51,372 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 17:04:51,402 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b443ab1727ff69d6f23732 HTTP/1.1" 200 None 2026-03-15 17:04:51,403 - lava_callback - DEBUG - Processing node 69b443ab1727ff69d6f23732: baseline-arm-clabbe 2026-03-15 17:04:51,404 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b443ab1727ff69d6f23732 2026-03-15 17:04:51,404 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 17:04:51,417 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b443ab1727ff69d6f23732 HTTP/1.1" 200 None 2026-03-15 17:04:51,419 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 17:04:51,447 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aef424ce46d8ec186ab80e HTTP/1.1" 200 None 2026-03-15 17:04:51,449 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 17:04:51,469 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b443ab1727ff69d6f23732 HTTP/1.1" 200 None 2026-03-15 17:04:51,470 - lava_callback - ERROR - Error processing callback for node 69b443ab1727ff69d6f23732: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:38392 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34092 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34096 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42688 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:42700 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60162 - "GET / HTTP/1.0" 200 OK 2026-03-15 17:05:31,352 - lava_callback - INFO - Received callback for node 69b443d11727ff69d6f2373c INFO: 172.21.0.1:43686 - "POST /node/69b443d11727ff69d6f2373c HTTP/1.0" 202 Accepted 2026-03-15 17:05:31,357 - lava_callback - INFO - Starting async job submit for node 69b443d11727ff69d6f2373c 2026-03-15 17:05:31,358 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 17:05:31,372 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b443d11727ff69d6f2373c HTTP/1.1" 200 None 2026-03-15 17:05:31,373 - lava_callback - DEBUG - Processing node 69b443d11727ff69d6f2373c: baseline-arm-clabbe 2026-03-15 17:05:31,373 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b443d11727ff69d6f2373c 2026-03-15 17:05:31,374 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 17:05:31,388 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b443d11727ff69d6f2373c HTTP/1.1" 200 None 2026-03-15 17:05:31,389 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 17:05:31,408 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aef424ce46d8ec186ab80e HTTP/1.1" 200 None 2026-03-15 17:05:31,410 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 17:05:31,435 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b443d11727ff69d6f2373c HTTP/1.1" 200 None 2026-03-15 17:05:31,436 - lava_callback - ERROR - Error processing callback for node 69b443d11727ff69d6f2373c: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:43694 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34394 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50400 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37758 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37774 - "GET / HTTP/1.0" 200 OK 2026-03-15 17:06:11,459 - lava_callback - INFO - Received callback for node 69b443f61727ff69d6f23747 INFO: 172.21.0.1:46962 - "POST /node/69b443f61727ff69d6f23747 HTTP/1.0" 202 Accepted 2026-03-15 17:06:11,465 - lava_callback - INFO - Starting async job submit for node 69b443f61727ff69d6f23747 2026-03-15 17:06:11,466 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 17:06:11,483 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b443f61727ff69d6f23747 HTTP/1.1" 200 None 2026-03-15 17:06:11,484 - lava_callback - DEBUG - Processing node 69b443f61727ff69d6f23747: baseline-arm-clabbe 2026-03-15 17:06:11,485 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b443f61727ff69d6f23747 2026-03-15 17:06:11,485 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 17:06:11,498 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b443f61727ff69d6f23747 HTTP/1.1" 200 None 2026-03-15 17:06:11,500 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 17:06:11,513 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aef424ce46d8ec186ab80e HTTP/1.1" 200 None 2026-03-15 17:06:11,514 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 17:06:11,539 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b443f61727ff69d6f23747 HTTP/1.1" 200 None 2026-03-15 17:06:11,540 - lava_callback - ERROR - Error processing callback for node 69b443f61727ff69d6f23747: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:46968 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:46974 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35956 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56394 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41334 - "GET / HTTP/1.0" 200 OK 2026-03-15 17:06:51,468 - lava_callback - INFO - Received callback for node 69b4441b1727ff69d6f23754 INFO: 172.21.0.1:43312 - "POST /node/69b4441b1727ff69d6f23754 HTTP/1.0" 202 Accepted 2026-03-15 17:06:51,473 - lava_callback - INFO - Starting async job submit for node 69b4441b1727ff69d6f23754 2026-03-15 17:06:51,474 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 17:06:51,503 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b4441b1727ff69d6f23754 HTTP/1.1" 200 None 2026-03-15 17:06:51,504 - lava_callback - DEBUG - Processing node 69b4441b1727ff69d6f23754: baseline-arm-clabbe 2026-03-15 17:06:51,504 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b4441b1727ff69d6f23754 2026-03-15 17:06:51,505 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 17:06:51,523 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b4441b1727ff69d6f23754 HTTP/1.1" 200 None 2026-03-15 17:06:51,524 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 17:06:51,546 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aef424ce46d8ec186ab80e HTTP/1.1" 200 None 2026-03-15 17:06:51,548 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 17:06:51,579 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b4441b1727ff69d6f23754 HTTP/1.1" 200 None 2026-03-15 17:06:51,580 - lava_callback - ERROR - Error processing callback for node 69b4441b1727ff69d6f23754: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:43318 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46364 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46366 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43656 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:43666 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37780 - "GET / HTTP/1.0" 200 OK 2026-03-15 17:07:31,526 - lava_callback - INFO - Received callback for node 69b444421727ff69d6f2375f INFO: 172.21.0.1:51858 - "POST /node/69b444421727ff69d6f2375f HTTP/1.0" 202 Accepted 2026-03-15 17:07:31,531 - lava_callback - INFO - Starting async job submit for node 69b444421727ff69d6f2375f 2026-03-15 17:07:31,532 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 17:07:31,547 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b444421727ff69d6f2375f HTTP/1.1" 200 None 2026-03-15 17:07:31,548 - lava_callback - DEBUG - Processing node 69b444421727ff69d6f2375f: baseline-arm-clabbe 2026-03-15 17:07:31,548 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b444421727ff69d6f2375f 2026-03-15 17:07:31,549 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 17:07:31,562 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b444421727ff69d6f2375f HTTP/1.1" 200 None 2026-03-15 17:07:31,563 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 17:07:31,576 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aef424ce46d8ec186ab80e HTTP/1.1" 200 None 2026-03-15 17:07:31,578 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 17:07:31,600 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b444421727ff69d6f2375f HTTP/1.1" 200 None 2026-03-15 17:07:31,609 - lava_callback - ERROR - Error processing callback for node 69b444421727ff69d6f2375f: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:51868 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54958 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48244 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47860 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47864 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35122 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:35138 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49622 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41666 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56014 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57876 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46914 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46916 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42328 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:42338 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36408 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39418 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54924 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49314 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43840 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43852 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59144 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:59146 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59830 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36484 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38586 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57130 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38698 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38706 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46328 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:46334 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50332 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46442 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33456 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42102 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54260 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54262 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34474 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:34488 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40824 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59260 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44734 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54496 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51502 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51510 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49622 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:49638 - "GET / HTTP/1.0" 200 OK 2026-03-15 17:13:17,369 - lava_callback - INFO - Received callback for node 69b445aa1727ff69d6f23778 INFO: 172.21.0.1:49648 - "POST /node/69b445aa1727ff69d6f23778 HTTP/1.0" 202 Accepted 2026-03-15 17:13:17,374 - lava_callback - INFO - Starting async job submit for node 69b445aa1727ff69d6f23778 2026-03-15 17:13:17,376 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 17:13:17,390 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b445aa1727ff69d6f23778 HTTP/1.1" 200 None 2026-03-15 17:13:17,391 - lava_callback - DEBUG - Processing node 69b445aa1727ff69d6f23778: baseline-arm64-baylibre 2026-03-15 17:13:17,391 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b445aa1727ff69d6f23778 2026-03-15 17:13:17,392 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 17:13:17,432 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b445aa1727ff69d6f23778 HTTP/1.1" 200 None 2026-03-15 17:13:17,433 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 17:13:17,451 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ac4f7446f7ae8ff3364c45 HTTP/1.1" 200 None 2026-03-15 17:13:17,453 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 17:13:17,502 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b445aa1727ff69d6f23778 HTTP/1.1" 200 None 2026-03-15 17:13:17,503 - lava_callback - ERROR - Error processing callback for node 69b445aa1727ff69d6f23778: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:44564 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37642 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52102 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51164 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56964 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56966 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58754 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:58768 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43654 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53536 - "GET / HTTP/1.0" 200 OK 2026-03-15 17:14:37,344 - lava_callback - INFO - Received callback for node 69b445fb1727ff69d6f23783 INFO: 172.21.0.1:53542 - "POST /node/69b445fb1727ff69d6f23783 HTTP/1.0" 202 Accepted 2026-03-15 17:14:37,350 - lava_callback - INFO - Starting async job submit for node 69b445fb1727ff69d6f23783 2026-03-15 17:14:37,351 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 17:14:37,365 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b445fb1727ff69d6f23783 HTTP/1.1" 200 None 2026-03-15 17:14:37,366 - lava_callback - DEBUG - Processing node 69b445fb1727ff69d6f23783: baseline-arm64-baylibre 2026-03-15 17:14:37,366 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b445fb1727ff69d6f23783 2026-03-15 17:14:37,367 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 17:14:37,384 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b445fb1727ff69d6f23783 HTTP/1.1" 200 None 2026-03-15 17:14:37,385 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 17:14:37,421 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ac4f7446f7ae8ff3364c45 HTTP/1.1" 200 None 2026-03-15 17:14:37,423 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 17:14:37,447 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b445fb1727ff69d6f23783 HTTP/1.1" 200 None 2026-03-15 17:14:37,448 - lava_callback - ERROR - Error processing callback for node 69b445fb1727ff69d6f23783: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:34966 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33010 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56842 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56852 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46412 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:46416 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51094 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52768 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60292 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44072 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45766 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45778 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36424 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:36434 - "GET / HTTP/1.0" 200 OK 2026-03-15 17:16:17,376 - lava_callback - INFO - Received callback for node 69b4464c1727ff69d6f23790 INFO: 172.21.0.1:36448 - "POST /node/69b4464c1727ff69d6f23790 HTTP/1.0" 202 Accepted 2026-03-15 17:16:17,382 - lava_callback - INFO - Starting async job submit for node 69b4464c1727ff69d6f23790 2026-03-15 17:16:17,383 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 17:16:17,414 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b4464c1727ff69d6f23790 HTTP/1.1" 200 None 2026-03-15 17:16:17,415 - lava_callback - DEBUG - Processing node 69b4464c1727ff69d6f23790: baseline-arm64-baylibre 2026-03-15 17:16:17,415 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b4464c1727ff69d6f23790 2026-03-15 17:16:17,415 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 17:16:17,429 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b4464c1727ff69d6f23790 HTTP/1.1" 200 None 2026-03-15 17:16:17,431 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 17:16:17,450 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ac4f7446f7ae8ff3364c45 HTTP/1.1" 200 None 2026-03-15 17:16:17,451 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 17:16:17,472 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b4464c1727ff69d6f23790 HTTP/1.1" 200 None 2026-03-15 17:16:17,478 - lava_callback - ERROR - Error processing callback for node 69b4464c1727ff69d6f23790: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:47488 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45560 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40056 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40254 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38208 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38222 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50088 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:50102 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57486 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34942 - "GET / HTTP/1.0" 200 OK 2026-03-15 17:17:37,455 - lava_callback - INFO - Received callback for node 69b446a11727ff69d6f2379d INFO: 172.21.0.1:34950 - "POST /node/69b446a11727ff69d6f2379d HTTP/1.0" 202 Accepted 2026-03-15 17:17:37,461 - lava_callback - INFO - Starting async job submit for node 69b446a11727ff69d6f2379d 2026-03-15 17:17:37,462 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 17:17:37,476 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b446a11727ff69d6f2379d HTTP/1.1" 200 None 2026-03-15 17:17:37,477 - lava_callback - DEBUG - Processing node 69b446a11727ff69d6f2379d: baseline-arm64-baylibre 2026-03-15 17:17:37,477 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b446a11727ff69d6f2379d 2026-03-15 17:17:37,478 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 17:17:37,492 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b446a11727ff69d6f2379d HTTP/1.1" 200 None 2026-03-15 17:17:37,493 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 17:17:37,507 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ac4f7446f7ae8ff3364c45 HTTP/1.1" 200 None 2026-03-15 17:17:37,508 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 17:17:37,535 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b446a11727ff69d6f2379d HTTP/1.1" 200 None 2026-03-15 17:17:37,536 - lava_callback - ERROR - Error processing callback for node 69b446a11727ff69d6f2379d: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:49134 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56970 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41056 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41060 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49592 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:49606 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46952 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40686 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34686 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35238 - "GET / HTTP/1.0" 200 OK 2026-03-15 17:18:57,645 - lava_callback - INFO - Received callback for node 69b446f21727ff69d6f237b3 INFO: 172.21.0.1:35248 - "POST /node/69b446f21727ff69d6f237b3 HTTP/1.0" 202 Accepted 2026-03-15 17:18:57,651 - lava_callback - INFO - Starting async job submit for node 69b446f21727ff69d6f237b3 2026-03-15 17:18:57,652 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 17:18:57,666 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b446f21727ff69d6f237b3 HTTP/1.1" 200 None 2026-03-15 17:18:57,667 - lava_callback - DEBUG - Processing node 69b446f21727ff69d6f237b3: baseline-arm64-baylibre 2026-03-15 17:18:57,667 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b446f21727ff69d6f237b3 2026-03-15 17:18:57,668 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 17:18:57,681 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b446f21727ff69d6f237b3 HTTP/1.1" 200 None 2026-03-15 17:18:57,683 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 17:18:57,710 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ac4f7446f7ae8ff3364c45 HTTP/1.1" 200 None 2026-03-15 17:18:57,712 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 17:18:57,737 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b446f21727ff69d6f237b3 HTTP/1.1" 200 None 2026-03-15 17:18:57,739 - lava_callback - ERROR - Error processing callback for node 69b446f21727ff69d6f237b3: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:55170 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55182 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51838 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:51846 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51536 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60944 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50818 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40136 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60016 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60018 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36082 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:36086 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48560 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34822 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56374 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56258 - "GET / HTTP/1.0" 200 OK 2026-03-15 17:20:57,690 - lava_callback - INFO - Received callback for node 69b447651727ff69d6f237c9 INFO: 172.21.0.1:56274 - "POST /node/69b447651727ff69d6f237c9 HTTP/1.0" 202 Accepted 2026-03-15 17:20:57,696 - lava_callback - INFO - Starting async job submit for node 69b447651727ff69d6f237c9 2026-03-15 17:20:57,697 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 17:20:57,719 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b447651727ff69d6f237c9 HTTP/1.1" 200 None 2026-03-15 17:20:57,720 - lava_callback - DEBUG - Processing node 69b447651727ff69d6f237c9: baseline-arm64-baylibre 2026-03-15 17:20:57,720 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b447651727ff69d6f237c9 2026-03-15 17:20:57,721 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 17:20:57,734 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b447651727ff69d6f237c9 HTTP/1.1" 200 None 2026-03-15 17:20:57,735 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 17:20:57,748 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ac4f7446f7ae8ff3364c45 HTTP/1.1" 200 None 2026-03-15 17:20:57,750 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 17:20:57,774 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b447651727ff69d6f237c9 HTTP/1.1" 200 None 2026-03-15 17:20:57,785 - lava_callback - ERROR - Error processing callback for node 69b447651727ff69d6f237c9: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:50800 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50804 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49998 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:50006 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42502 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53952 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50466 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54340 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34506 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34514 - "GET / HTTP/1.0" 200 OK 2026-03-15 17:22:12,146 - lava_callback - INFO - Received callback for node 69b447c11727ff69d6f237d5 INFO: 172.21.0.1:56170 - "POST /node/69b447c11727ff69d6f237d5 HTTP/1.0" 202 Accepted 2026-03-15 17:22:12,151 - lava_callback - INFO - Starting async job submit for node 69b447c11727ff69d6f237d5 2026-03-15 17:22:12,152 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 17:22:12,167 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b447c11727ff69d6f237d5 HTTP/1.1" 200 None 2026-03-15 17:22:12,168 - lava_callback - DEBUG - Processing node 69b447c11727ff69d6f237d5: baseline-arm64-clabbe 2026-03-15 17:22:12,168 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b447c11727ff69d6f237d5 2026-03-15 17:22:12,169 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 17:22:12,184 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b447c11727ff69d6f237d5 HTTP/1.1" 200 None 2026-03-15 17:22:12,186 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 17:22:12,223 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ac4f7446f7ae8ff3364c45 HTTP/1.1" 200 None 2026-03-15 17:22:12,224 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 17:22:12,266 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b447c11727ff69d6f237d5 HTTP/1.1" 200 None 2026-03-15 17:22:12,275 - lava_callback - ERROR - Error processing callback for node 69b447c11727ff69d6f237d5: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:56174 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:56186 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38394 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39674 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60986 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39594 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40988 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40992 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45622 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:45634 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52164 - "GET / HTTP/1.0" 200 OK 2026-03-15 17:23:32,174 - lava_callback - INFO - Received callback for node 69b448111727ff69d6f237dc INFO: 172.21.0.1:50802 - "POST /node/69b448111727ff69d6f237dc HTTP/1.0" 202 Accepted 2026-03-15 17:23:32,180 - lava_callback - INFO - Starting async job submit for node 69b448111727ff69d6f237dc 2026-03-15 17:23:32,180 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 17:23:32,195 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b448111727ff69d6f237dc HTTP/1.1" 200 None 2026-03-15 17:23:32,196 - lava_callback - DEBUG - Processing node 69b448111727ff69d6f237dc: baseline-arm64-clabbe 2026-03-15 17:23:32,196 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b448111727ff69d6f237dc 2026-03-15 17:23:32,197 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 17:23:32,232 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b448111727ff69d6f237dc HTTP/1.1" 200 None 2026-03-15 17:23:32,233 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 17:23:32,251 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ac4f7446f7ae8ff3364c45 HTTP/1.1" 200 None 2026-03-15 17:23:32,253 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 17:23:32,273 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b448111727ff69d6f237dc HTTP/1.1" 200 None 2026-03-15 17:23:32,275 - lava_callback - ERROR - Error processing callback for node 69b448111727ff69d6f237dc: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:50818 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52946 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60018 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48266 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48278 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53928 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:53942 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55960 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48302 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47716 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58784 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50336 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50350 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38732 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:38746 - "GET / HTTP/1.0" 200 OK 2026-03-15 17:25:17,966 - lava_callback - INFO - Received callback for node 69b4487b1727ff69d6f237ea INFO: 172.21.0.1:38756 - "POST /node/69b4487b1727ff69d6f237ea HTTP/1.0" 202 Accepted 2026-03-15 17:25:17,972 - lava_callback - INFO - Starting async job submit for node 69b4487b1727ff69d6f237ea 2026-03-15 17:25:17,973 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 17:25:17,988 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b4487b1727ff69d6f237ea HTTP/1.1" 200 None 2026-03-15 17:25:17,989 - lava_callback - DEBUG - Processing node 69b4487b1727ff69d6f237ea: baseline-arm64-baylibre 2026-03-15 17:25:17,989 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b4487b1727ff69d6f237ea 2026-03-15 17:25:17,990 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 17:25:18,003 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b4487b1727ff69d6f237ea HTTP/1.1" 200 None 2026-03-15 17:25:18,005 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 17:25:18,019 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aef431ce46d8ec186ab81d HTTP/1.1" 200 None 2026-03-15 17:25:18,020 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 17:25:18,048 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b4487b1727ff69d6f237ea HTTP/1.1" 200 None 2026-03-15 17:25:18,058 - lava_callback - ERROR - Error processing callback for node 69b4487b1727ff69d6f237ea: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:51658 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49368 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35902 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39184 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51934 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51948 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46376 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:46384 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42434 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58534 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56238 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56140 - "GET / HTTP/1.0" 200 OK 2026-03-15 17:26:57,965 - lava_callback - INFO - Received callback for node 69b448d51727ff69d6f237f6 INFO: 172.21.0.1:56154 - "POST /node/69b448d51727ff69d6f237f6 HTTP/1.0" 202 Accepted 2026-03-15 17:26:57,971 - lava_callback - INFO - Starting async job submit for node 69b448d51727ff69d6f237f6 2026-03-15 17:26:57,972 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 17:26:57,996 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b448d51727ff69d6f237f6 HTTP/1.1" 200 None 2026-03-15 17:26:57,997 - lava_callback - DEBUG - Processing node 69b448d51727ff69d6f237f6: baseline-arm64-baylibre 2026-03-15 17:26:57,997 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b448d51727ff69d6f237f6 2026-03-15 17:26:57,998 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 17:26:58,011 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b448d51727ff69d6f237f6 HTTP/1.1" 200 None 2026-03-15 17:26:58,013 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 17:26:58,028 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aef431ce46d8ec186ab81d HTTP/1.1" 200 None 2026-03-15 17:26:58,030 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 17:26:58,061 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b448d51727ff69d6f237f6 HTTP/1.1" 200 None 2026-03-15 17:26:58,062 - lava_callback - ERROR - Error processing callback for node 69b448d51727ff69d6f237f6: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:47526 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47534 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58586 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:58592 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36222 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59202 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56002 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38226 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40826 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40842 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40238 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:40248 - "GET / HTTP/1.0" 200 OK 2026-03-15 17:28:18,094 - lava_callback - INFO - Received callback for node 69b449251727ff69d6f237ff INFO: 172.21.0.1:40262 - "POST /node/69b449251727ff69d6f237ff HTTP/1.0" 202 Accepted 2026-03-15 17:28:18,100 - lava_callback - INFO - Starting async job submit for node 69b449251727ff69d6f237ff 2026-03-15 17:28:18,101 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 17:28:18,117 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b449251727ff69d6f237ff HTTP/1.1" 200 None 2026-03-15 17:28:18,118 - lava_callback - DEBUG - Processing node 69b449251727ff69d6f237ff: baseline-arm64-baylibre 2026-03-15 17:28:18,118 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b449251727ff69d6f237ff 2026-03-15 17:28:18,119 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 17:28:18,132 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b449251727ff69d6f237ff HTTP/1.1" 200 None 2026-03-15 17:28:18,133 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 17:28:18,162 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aef431ce46d8ec186ab81d HTTP/1.1" 200 None 2026-03-15 17:28:18,164 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 17:28:18,184 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b449251727ff69d6f237ff HTTP/1.1" 200 None 2026-03-15 17:28:18,186 - lava_callback - ERROR - Error processing callback for node 69b449251727ff69d6f237ff: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:49198 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52220 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57722 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39630 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49594 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49598 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58516 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:58524 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37828 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43098 - "GET / HTTP/1.0" 200 OK 2026-03-15 17:29:38,117 - lava_callback - INFO - Received callback for node 69b449751727ff69d6f2380c INFO: 172.21.0.1:43102 - "POST /node/69b449751727ff69d6f2380c HTTP/1.0" 202 Accepted 2026-03-15 17:29:38,123 - lava_callback - INFO - Starting async job submit for node 69b449751727ff69d6f2380c 2026-03-15 17:29:38,124 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 17:29:38,139 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b449751727ff69d6f2380c HTTP/1.1" 200 None 2026-03-15 17:29:38,140 - lava_callback - DEBUG - Processing node 69b449751727ff69d6f2380c: baseline-arm64-baylibre 2026-03-15 17:29:38,140 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b449751727ff69d6f2380c 2026-03-15 17:29:38,140 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 17:29:38,154 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b449751727ff69d6f2380c HTTP/1.1" 200 None 2026-03-15 17:29:38,156 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 17:29:38,169 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aef431ce46d8ec186ab81d HTTP/1.1" 200 None 2026-03-15 17:29:38,171 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 17:29:38,198 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b449751727ff69d6f2380c HTTP/1.1" 200 None 2026-03-15 17:29:38,204 - lava_callback - ERROR - Error processing callback for node 69b449751727ff69d6f2380c: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:47708 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56904 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37804 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37814 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46580 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:46584 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34612 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45800 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56110 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48708 - "GET / HTTP/1.0" 200 OK 2026-03-15 17:30:58,255 - lava_callback - INFO - Received callback for node 69b449c51727ff69d6f23819 INFO: 172.21.0.1:48720 - "POST /node/69b449c51727ff69d6f23819 HTTP/1.0" 202 Accepted 2026-03-15 17:30:58,261 - lava_callback - INFO - Starting async job submit for node 69b449c51727ff69d6f23819 2026-03-15 17:30:58,261 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 17:30:58,276 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b449c51727ff69d6f23819 HTTP/1.1" 200 None 2026-03-15 17:30:58,277 - lava_callback - DEBUG - Processing node 69b449c51727ff69d6f23819: baseline-arm64-baylibre 2026-03-15 17:30:58,277 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b449c51727ff69d6f23819 2026-03-15 17:30:58,278 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 17:30:58,291 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b449c51727ff69d6f23819 HTTP/1.1" 200 None 2026-03-15 17:30:58,292 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 17:30:58,313 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aef431ce46d8ec186ab81d HTTP/1.1" 200 None 2026-03-15 17:30:58,314 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 17:30:58,344 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b449c51727ff69d6f23819 HTTP/1.1" 200 None 2026-03-15 17:30:58,346 - lava_callback - ERROR - Error processing callback for node 69b449c51727ff69d6f23819: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:43150 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43154 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37478 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:37492 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48570 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49658 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60242 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33228 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57828 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57836 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59810 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:59814 - "GET / HTTP/1.0" 200 OK 2026-03-15 17:32:18,363 - lava_callback - INFO - Received callback for node 69b44a161727ff69d6f23821 INFO: 172.21.0.1:59826 - "POST /node/69b44a161727ff69d6f23821 HTTP/1.0" 202 Accepted 2026-03-15 17:32:18,368 - lava_callback - INFO - Starting async job submit for node 69b44a161727ff69d6f23821 2026-03-15 17:32:18,369 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 17:32:18,415 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b44a161727ff69d6f23821 HTTP/1.1" 200 None 2026-03-15 17:32:18,416 - lava_callback - DEBUG - Processing node 69b44a161727ff69d6f23821: baseline-arm64-baylibre 2026-03-15 17:32:18,416 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b44a161727ff69d6f23821 2026-03-15 17:32:18,417 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 17:32:18,430 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b44a161727ff69d6f23821 HTTP/1.1" 200 None 2026-03-15 17:32:18,431 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 17:32:18,448 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aef431ce46d8ec186ab81d HTTP/1.1" 200 None 2026-03-15 17:32:18,450 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 17:32:18,486 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b44a161727ff69d6f23821 HTTP/1.1" 200 None 2026-03-15 17:32:18,487 - lava_callback - ERROR - Error processing callback for node 69b44a161727ff69d6f23821: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:35338 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52504 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48698 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56196 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48534 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48540 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50558 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:50566 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52956 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40276 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41720 - "GET / HTTP/1.0" 200 OK 2026-03-15 17:33:52,652 - lava_callback - INFO - Received callback for node 69b44a6d1727ff69d6f2382e INFO: 172.21.0.1:42028 - "POST /node/69b44a6d1727ff69d6f2382e HTTP/1.0" 202 Accepted 2026-03-15 17:33:52,657 - lava_callback - INFO - Starting async job submit for node 69b44a6d1727ff69d6f2382e 2026-03-15 17:33:52,658 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 17:33:52,672 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b44a6d1727ff69d6f2382e HTTP/1.1" 200 None 2026-03-15 17:33:52,673 - lava_callback - DEBUG - Processing node 69b44a6d1727ff69d6f2382e: baseline-arm64-clabbe 2026-03-15 17:33:52,673 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b44a6d1727ff69d6f2382e 2026-03-15 17:33:52,674 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 17:33:52,687 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b44a6d1727ff69d6f2382e HTTP/1.1" 200 None 2026-03-15 17:33:52,689 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 17:33:52,714 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aef431ce46d8ec186ab81d HTTP/1.1" 200 None 2026-03-15 17:33:52,715 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 17:33:52,764 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b44a6d1727ff69d6f2382e HTTP/1.1" 200 None 2026-03-15 17:33:52,774 - lava_callback - ERROR - Error processing callback for node 69b44a6d1727ff69d6f2382e: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:42042 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48872 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48878 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51572 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:51584 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56856 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50148 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38150 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51678 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41550 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41554 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36482 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:36494 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53282 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33038 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60540 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51508 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53592 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53600 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50954 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:50960 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57962 - "GET / HTTP/1.0" 200 OK 2026-03-15 17:36:32,882 - lava_callback - INFO - Received callback for node 69b44b0c1727ff69d6f23840 INFO: 172.21.0.1:55424 - "POST /node/69b44b0c1727ff69d6f23840 HTTP/1.0" 202 Accepted 2026-03-15 17:36:32,888 - lava_callback - INFO - Starting async job submit for node 69b44b0c1727ff69d6f23840 2026-03-15 17:36:32,889 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 17:36:32,914 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b44b0c1727ff69d6f23840 HTTP/1.1" 200 None 2026-03-15 17:36:32,914 - lava_callback - DEBUG - Processing node 69b44b0c1727ff69d6f23840: baseline-arm64-clabbe 2026-03-15 17:36:32,915 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b44b0c1727ff69d6f23840 2026-03-15 17:36:32,915 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 17:36:32,929 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b44b0c1727ff69d6f23840 HTTP/1.1" 200 None 2026-03-15 17:36:32,930 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 17:36:32,945 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aef431ce46d8ec186ab81d HTTP/1.1" 200 None 2026-03-15 17:36:32,947 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 17:36:32,968 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b44b0c1727ff69d6f23840 HTTP/1.1" 200 None 2026-03-15 17:36:32,970 - lava_callback - ERROR - Error processing callback for node 69b44b0c1727ff69d6f23840: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:55436 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49112 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39246 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44960 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44970 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57576 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:57584 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38544 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44772 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47544 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48324 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49742 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49758 - "GET / HTTP/1.0" 200 OK 2026-03-15 17:38:12,808 - lava_callback - INFO - Received callback for node 69b44b6f1727ff69d6f23849 INFO: 172.21.0.1:49442 - "POST /node/69b44b6f1727ff69d6f23849 HTTP/1.0" 202 Accepted 2026-03-15 17:38:12,814 - lava_callback - INFO - Starting async job submit for node 69b44b6f1727ff69d6f23849 2026-03-15 17:38:12,815 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 17:38:12,830 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b44b6f1727ff69d6f23849 HTTP/1.1" 200 None 2026-03-15 17:38:12,831 - lava_callback - DEBUG - Processing node 69b44b6f1727ff69d6f23849: baseline-arm64-clabbe 2026-03-15 17:38:12,831 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b44b6f1727ff69d6f23849 2026-03-15 17:38:12,832 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 17:38:12,853 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b44b6f1727ff69d6f23849 HTTP/1.1" 200 None 2026-03-15 17:38:12,855 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 17:38:12,868 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aef431ce46d8ec186ab81d HTTP/1.1" 200 None 2026-03-15 17:38:12,869 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 17:38:12,913 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b44b6f1727ff69d6f23849 HTTP/1.1" 200 None 2026-03-15 17:38:12,914 - lava_callback - ERROR - Error processing callback for node 69b44b6f1727ff69d6f23849: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:49456 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:49466 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34870 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60902 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48170 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55498 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41180 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41194 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34862 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:34874 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53978 - "GET / HTTP/1.0" 200 OK 2026-03-15 17:39:32,868 - lava_callback - INFO - Received callback for node 69b44bc31727ff69d6f23856 INFO: 172.21.0.1:54814 - "POST /node/69b44bc31727ff69d6f23856 HTTP/1.0" 202 Accepted 2026-03-15 17:39:32,874 - lava_callback - INFO - Starting async job submit for node 69b44bc31727ff69d6f23856 2026-03-15 17:39:32,874 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 17:39:32,891 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b44bc31727ff69d6f23856 HTTP/1.1" 200 None 2026-03-15 17:39:32,892 - lava_callback - DEBUG - Processing node 69b44bc31727ff69d6f23856: baseline-arm64-clabbe 2026-03-15 17:39:32,893 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b44bc31727ff69d6f23856 2026-03-15 17:39:32,893 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 17:39:32,919 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b44bc31727ff69d6f23856 HTTP/1.1" 200 None 2026-03-15 17:39:32,920 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 17:39:32,934 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aef431ce46d8ec186ab81d HTTP/1.1" 200 None 2026-03-15 17:39:32,936 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 17:39:32,958 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b44bc31727ff69d6f23856 HTTP/1.1" 200 None 2026-03-15 17:39:32,965 - lava_callback - ERROR - Error processing callback for node 69b44bc31727ff69d6f23856: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:54816 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35394 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42486 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59552 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59568 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42808 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:42824 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39828 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38752 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45526 - "GET / HTTP/1.0" 200 OK 2026-03-15 17:40:52,929 - lava_callback - INFO - Received callback for node 69b44c171727ff69d6f23864 INFO: 172.21.0.1:44222 - "POST /node/69b44c171727ff69d6f23864 HTTP/1.0" 202 Accepted 2026-03-15 17:40:52,934 - lava_callback - INFO - Starting async job submit for node 69b44c171727ff69d6f23864 2026-03-15 17:40:52,935 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 17:40:52,950 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b44c171727ff69d6f23864 HTTP/1.1" 200 None 2026-03-15 17:40:52,951 - lava_callback - DEBUG - Processing node 69b44c171727ff69d6f23864: baseline-arm64-clabbe 2026-03-15 17:40:52,951 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b44c171727ff69d6f23864 2026-03-15 17:40:52,952 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 17:40:52,966 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b44c171727ff69d6f23864 HTTP/1.1" 200 None 2026-03-15 17:40:52,968 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 17:40:53,012 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aef431ce46d8ec186ab81d HTTP/1.1" 200 None 2026-03-15 17:40:53,014 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 17:40:53,041 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b44c171727ff69d6f23864 HTTP/1.1" 200 None 2026-03-15 17:40:53,043 - lava_callback - ERROR - Error processing callback for node 69b44c171727ff69d6f23864: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:44232 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44098 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44114 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42242 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:42246 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47028 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39860 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59454 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40062 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47132 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47146 - "GET / HTTP/1.0" 200 OK 2026-03-15 17:42:12,979 - lava_callback - INFO - Received callback for node 69b44c6b1727ff69d6f2386b INFO: 172.21.0.1:36794 - "POST /node/69b44c6b1727ff69d6f2386b HTTP/1.0" 202 Accepted 2026-03-15 17:42:12,984 - lava_callback - INFO - Starting async job submit for node 69b44c6b1727ff69d6f2386b 2026-03-15 17:42:12,985 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 17:42:13,000 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b44c6b1727ff69d6f2386b HTTP/1.1" 200 None 2026-03-15 17:42:13,001 - lava_callback - DEBUG - Processing node 69b44c6b1727ff69d6f2386b: baseline-arm64-clabbe 2026-03-15 17:42:13,001 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b44c6b1727ff69d6f2386b 2026-03-15 17:42:13,001 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 17:42:13,015 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b44c6b1727ff69d6f2386b HTTP/1.1" 200 None 2026-03-15 17:42:13,017 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 17:42:13,030 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aef431ce46d8ec186ab81d HTTP/1.1" 200 None 2026-03-15 17:42:13,032 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 17:42:13,052 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b44c6b1727ff69d6f2386b HTTP/1.1" 200 None 2026-03-15 17:42:13,058 - lava_callback - ERROR - Error processing callback for node 69b44c6b1727ff69d6f2386b: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:36798 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:36806 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50872 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33066 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37408 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56852 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57458 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57464 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42346 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:42362 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36410 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57922 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39046 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53274 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38164 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38172 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41758 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:41772 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35678 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54522 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40742 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51078 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57022 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57034 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38816 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:38830 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39458 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37080 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56676 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36350 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41222 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41226 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43376 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:43388 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39052 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41442 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39076 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53516 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57712 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57720 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49934 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:49946 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49698 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47390 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49694 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33670 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55944 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55956 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45306 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:45322 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59170 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54672 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43348 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37632 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54224 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54226 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56976 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:56992 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35280 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44296 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37474 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42592 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51650 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51660 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:32952 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:32964 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47506 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57102 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42882 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44642 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49680 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49688 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38570 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:38572 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40764 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53620 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54338 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36746 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49712 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49722 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51988 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:51994 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48354 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45132 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38970 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47014 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58620 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58632 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50468 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:50482 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35018 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39690 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51436 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44070 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53142 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53146 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58110 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:58112 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55922 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46064 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42934 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36348 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56824 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56834 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34806 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:34814 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45056 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55050 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59432 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57896 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42918 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42932 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48440 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:48442 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55914 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52958 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41440 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57724 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50174 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50188 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51288 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:51300 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34434 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38850 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47168 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40208 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53626 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53642 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51280 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:51284 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39658 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52298 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43360 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39214 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50044 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50060 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44364 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:44378 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60098 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34790 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:32874 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33666 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36438 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36440 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57850 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:57858 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45658 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60758 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56782 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50948 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52946 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52948 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60640 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:60644 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52066 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40562 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47638 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47498 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55432 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55446 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56292 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:56296 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54878 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43166 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55074 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51120 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37906 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37916 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53502 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:53514 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33808 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59322 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59766 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44304 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49932 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49944 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59900 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:59904 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50714 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51766 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36344 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46424 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54600 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54604 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43180 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:43192 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43504 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46818 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37722 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48640 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41252 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41256 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49226 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:49234 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46890 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49146 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46354 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47560 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49606 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49620 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60108 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:60120 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59666 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35050 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47330 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48282 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36860 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36862 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42646 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:42654 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47730 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51588 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50560 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57438 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36552 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36560 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57694 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:57710 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57292 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41570 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34432 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48476 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33858 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33864 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46336 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:46350 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59398 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33146 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60606 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57064 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59680 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59692 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59386 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:59394 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45638 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44854 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34702 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55208 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42500 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42502 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46950 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:46954 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38808 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38458 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53670 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54482 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38806 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38808 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52618 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:52622 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51312 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35708 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42658 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50560 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40052 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40064 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52948 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:52952 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35546 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52144 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42302 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54690 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55464 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55466 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52778 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:52794 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40160 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36816 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43326 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35768 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51206 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51216 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36130 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:36146 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57846 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40356 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53456 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34318 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37924 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37940 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60634 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:60640 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49952 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39612 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55844 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57698 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58010 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58012 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51224 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:51240 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41910 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58034 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50064 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33960 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44654 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44666 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47988 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:47990 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36400 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52532 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52176 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39390 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34372 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34384 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52208 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:52224 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44724 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54570 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56924 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51918 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49182 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49190 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47862 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:47864 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41156 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57180 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49206 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45032 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58640 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58652 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60588 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:60590 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58802 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35730 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53544 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52294 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33520 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33528 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48604 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:48616 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42586 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39938 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58320 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46584 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47318 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47326 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58372 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:58380 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43540 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48812 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36242 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59268 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41424 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41438 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46562 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:46572 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45728 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48244 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47676 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41112 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55626 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55640 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57550 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:57552 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37036 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46714 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45926 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53242 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58242 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58244 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44546 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:44552 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49046 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44166 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39894 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57978 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46582 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46584 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50312 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:50316 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43122 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40514 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37154 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39506 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45970 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45986 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44890 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:44892 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34270 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46892 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45786 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33808 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55470 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55474 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36188 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:36204 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56564 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45502 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53830 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34588 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47594 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47610 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47484 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:47488 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57880 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51552 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42216 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52134 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60698 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60710 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36572 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:36578 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42748 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40186 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36268 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40856 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40522 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40534 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51970 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:51978 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52254 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38846 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44632 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35442 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52984 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53000 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46908 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:46912 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48776 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45232 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34962 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37660 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40532 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40546 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57886 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:57894 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38266 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48414 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44654 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57220 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55590 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55594 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60088 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:60104 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40658 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53564 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36584 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54288 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42870 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42874 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46658 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:46672 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43772 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54642 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57522 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49632 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35928 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35944 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59218 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:59226 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37094 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35780 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55862 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57886 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46458 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46474 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57024 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:57032 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33472 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41808 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39280 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37404 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43048 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43056 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34796 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:34806 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43602 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49598 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39576 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36774 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58354 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58358 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60556 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:60560 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46740 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46938 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44570 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37020 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45058 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45064 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46358 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:46362 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42596 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37096 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48996 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60480 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41422 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41432 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39316 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:39322 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45610 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44068 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33282 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53714 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56058 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56060 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42576 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:42582 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56030 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40998 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39772 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48432 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51324 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51328 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55482 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:55496 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58572 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58258 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39846 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45852 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54816 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54830 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41446 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:41452 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47088 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51314 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51574 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49892 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54104 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54120 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41842 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:41846 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60508 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49748 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60480 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58644 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51026 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51034 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45132 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:45136 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51664 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50192 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40126 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49326 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56872 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56882 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42620 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:42630 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52134 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46162 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51078 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45640 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37228 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37234 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51144 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:51146 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50594 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56962 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51746 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36188 - "GET / HTTP/1.0" 200 OK 2026-03-15 18:51:02,620 - lava_callback - INFO - Received callback for node 69b45c891727ff69d6f238b1 INFO: 172.21.0.1:38684 - "POST /node/69b45c891727ff69d6f238b1 HTTP/1.0" 202 Accepted 2026-03-15 18:51:02,626 - lava_callback - INFO - Starting async job submit for node 69b45c891727ff69d6f238b1 2026-03-15 18:51:02,627 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 18:51:02,663 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b45c891727ff69d6f238b1 HTTP/1.1" 200 None 2026-03-15 18:51:02,664 - lava_callback - DEBUG - Processing node 69b45c891727ff69d6f238b1: baseline-arm-baylibre 2026-03-15 18:51:02,664 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b45c891727ff69d6f238b1 2026-03-15 18:51:02,665 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 18:51:02,687 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b45c891727ff69d6f238b1 HTTP/1.1" 200 None 2026-03-15 18:51:02,689 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 18:51:02,703 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aeba33feb96b28aa34a775 HTTP/1.1" 200 None 2026-03-15 18:51:02,704 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 18:51:02,744 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b45c891727ff69d6f238b1 HTTP/1.1" 200 None 2026-03-15 18:51:02,746 - lava_callback - ERROR - Error processing callback for node 69b45c891727ff69d6f238b1: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:38694 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38696 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46760 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:46776 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48424 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51884 - "GET / HTTP/1.0" 200 OK 2026-03-15 18:51:42,459 - lava_callback - INFO - Received callback for node 69b45caf1727ff69d6f238be INFO: 172.21.0.1:44756 - "POST /node/69b45caf1727ff69d6f238be HTTP/1.0" 202 Accepted 2026-03-15 18:51:42,465 - lava_callback - INFO - Starting async job submit for node 69b45caf1727ff69d6f238be 2026-03-15 18:51:42,466 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 18:51:42,482 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b45caf1727ff69d6f238be HTTP/1.1" 200 None 2026-03-15 18:51:42,482 - lava_callback - DEBUG - Processing node 69b45caf1727ff69d6f238be: baseline-arm-baylibre 2026-03-15 18:51:42,483 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b45caf1727ff69d6f238be 2026-03-15 18:51:42,483 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 18:51:42,502 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b45caf1727ff69d6f238be HTTP/1.1" 200 None 2026-03-15 18:51:42,504 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 18:51:42,522 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aeba33feb96b28aa34a775 HTTP/1.1" 200 None 2026-03-15 18:51:42,524 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 18:51:42,545 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b45caf1727ff69d6f238be HTTP/1.1" 200 None 2026-03-15 18:51:42,546 - lava_callback - ERROR - Error processing callback for node 69b45caf1727ff69d6f238be: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:44766 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60298 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35728 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35740 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46196 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:46200 - "GET / HTTP/1.0" 200 OK 2026-03-15 18:52:22,496 - lava_callback - INFO - Received callback for node 69b45cd31727ff69d6f238c9 INFO: 172.21.0.1:52332 - "POST /node/69b45cd31727ff69d6f238c9 HTTP/1.0" 202 Accepted 2026-03-15 18:52:22,502 - lava_callback - INFO - Starting async job submit for node 69b45cd31727ff69d6f238c9 2026-03-15 18:52:22,503 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 18:52:22,521 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b45cd31727ff69d6f238c9 HTTP/1.1" 200 None 2026-03-15 18:52:22,522 - lava_callback - DEBUG - Processing node 69b45cd31727ff69d6f238c9: baseline-arm-baylibre 2026-03-15 18:52:22,522 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b45cd31727ff69d6f238c9 2026-03-15 18:52:22,522 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 18:52:22,543 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b45cd31727ff69d6f238c9 HTTP/1.1" 200 None 2026-03-15 18:52:22,545 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 18:52:22,559 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aeba33feb96b28aa34a775 HTTP/1.1" 200 None 2026-03-15 18:52:22,560 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 18:52:22,592 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b45cd31727ff69d6f238c9 HTTP/1.1" 200 None 2026-03-15 18:52:22,597 - lava_callback - ERROR - Error processing callback for node 69b45cd31727ff69d6f238c9: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:52348 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59328 - "GET / HTTP/1.0" 200 OK 2026-03-15 18:52:42,492 - lava_callback - INFO - Received callback for node 69b45cf81727ff69d6f238da INFO: 172.21.0.1:49550 - "POST /node/69b45cf81727ff69d6f238da HTTP/1.0" 202 Accepted 2026-03-15 18:52:42,497 - lava_callback - INFO - Starting async job submit for node 69b45cf81727ff69d6f238da 2026-03-15 18:52:42,498 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 18:52:42,520 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b45cf81727ff69d6f238da HTTP/1.1" 200 None 2026-03-15 18:52:42,521 - lava_callback - DEBUG - Processing node 69b45cf81727ff69d6f238da: baseline-arm-baylibre 2026-03-15 18:52:42,521 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b45cf81727ff69d6f238da 2026-03-15 18:52:42,522 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 18:52:42,541 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b45cf81727ff69d6f238da HTTP/1.1" 200 None 2026-03-15 18:52:42,543 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 18:52:42,577 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aeba33feb96b28aa34a775 HTTP/1.1" 200 None 2026-03-15 18:52:42,579 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 18:52:42,607 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b45cf81727ff69d6f238da HTTP/1.1" 200 None 2026-03-15 18:52:42,609 - lava_callback - ERROR - Error processing callback for node 69b45cf81727ff69d6f238da: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:49558 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41298 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55176 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55186 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42226 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:42240 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49956 - "GET / HTTP/1.0" 200 OK 2026-03-15 18:53:36,113 - lava_callback - INFO - Received callback for node 69b45d211727ff69d6f238e3 INFO: 172.21.0.1:41116 - "POST /node/69b45d211727ff69d6f238e3 HTTP/1.0" 202 Accepted 2026-03-15 18:53:36,118 - lava_callback - INFO - Starting async job submit for node 69b45d211727ff69d6f238e3 2026-03-15 18:53:36,119 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 18:53:36,134 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b45d211727ff69d6f238e3 HTTP/1.1" 200 None 2026-03-15 18:53:36,135 - lava_callback - DEBUG - Processing node 69b45d211727ff69d6f238e3: baseline-arm-clabbe 2026-03-15 18:53:36,135 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b45d211727ff69d6f238e3 2026-03-15 18:53:36,136 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 18:53:36,156 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b45d211727ff69d6f238e3 HTTP/1.1" 200 None 2026-03-15 18:53:36,157 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 18:53:36,179 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aeba33feb96b28aa34a775 HTTP/1.1" 200 None 2026-03-15 18:53:36,180 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 18:53:36,200 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b45d211727ff69d6f238e3 HTTP/1.1" 200 None 2026-03-15 18:53:36,201 - lava_callback - ERROR - Error processing callback for node 69b45d211727ff69d6f238e3: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:41124 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60624 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36516 - "GET / HTTP/1.0" 200 OK 2026-03-15 18:54:02,664 - lava_callback - INFO - Received callback for node 69b45d411727ff69d6f238f3 INFO: 172.21.0.1:50778 - "POST /node/69b45d411727ff69d6f238f3 HTTP/1.0" 202 Accepted 2026-03-15 18:54:02,670 - lava_callback - INFO - Starting async job submit for node 69b45d411727ff69d6f238f3 2026-03-15 18:54:02,670 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 18:54:02,685 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b45d411727ff69d6f238f3 HTTP/1.1" 200 None 2026-03-15 18:54:02,686 - lava_callback - DEBUG - Processing node 69b45d411727ff69d6f238f3: baseline-arm-baylibre 2026-03-15 18:54:02,686 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b45d411727ff69d6f238f3 2026-03-15 18:54:02,687 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 18:54:02,701 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b45d411727ff69d6f238f3 HTTP/1.1" 200 None 2026-03-15 18:54:02,703 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 18:54:02,719 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aeba33feb96b28aa34a775 HTTP/1.1" 200 None 2026-03-15 18:54:02,721 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 18:54:02,771 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b45d411727ff69d6f238f3 HTTP/1.1" 200 None 2026-03-15 18:54:02,772 - lava_callback - ERROR - Error processing callback for node 69b45d411727ff69d6f238f3: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:50782 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50794 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39264 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:39268 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51192 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39204 - "GET / HTTP/1.0" 200 OK 2026-03-15 18:54:42,631 - lava_callback - INFO - Received callback for node 69b45d681727ff69d6f23902 INFO: 172.21.0.1:45984 - "POST /node/69b45d681727ff69d6f23902 HTTP/1.0" 202 Accepted 2026-03-15 18:54:42,636 - lava_callback - INFO - Starting async job submit for node 69b45d681727ff69d6f23902 2026-03-15 18:54:42,637 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 18:54:42,665 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b45d681727ff69d6f23902 HTTP/1.1" 200 None 2026-03-15 18:54:42,666 - lava_callback - DEBUG - Processing node 69b45d681727ff69d6f23902: baseline-arm-baylibre 2026-03-15 18:54:42,666 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b45d681727ff69d6f23902 2026-03-15 18:54:42,666 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 18:54:42,684 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b45d681727ff69d6f23902 HTTP/1.1" 200 None 2026-03-15 18:54:42,686 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 18:54:42,713 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aeba33feb96b28aa34a775 HTTP/1.1" 200 None 2026-03-15 18:54:42,715 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 18:54:42,738 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b45d681727ff69d6f23902 HTTP/1.1" 200 None 2026-03-15 18:54:42,741 - lava_callback - ERROR - Error processing callback for node 69b45d681727ff69d6f23902: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:45986 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52220 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37406 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37414 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33010 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:33012 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40388 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58302 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38108 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51648 - "GET / HTTP/1.0" 200 OK 2026-03-15 18:56:02,776 - lava_callback - INFO - Received callback for node 69b45dad1727ff69d6f2391b INFO: 172.21.0.1:51090 - "POST /node/69b45dad1727ff69d6f2391b HTTP/1.0" 202 Accepted 2026-03-15 18:56:02,781 - lava_callback - INFO - Starting async job submit for node 69b45dad1727ff69d6f2391b 2026-03-15 18:56:02,782 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 18:56:02,797 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b45dad1727ff69d6f2391b HTTP/1.1" 200 None 2026-03-15 18:56:02,798 - lava_callback - DEBUG - Processing node 69b45dad1727ff69d6f2391b: baseline-arm-baylibre 2026-03-15 18:56:02,798 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b45dad1727ff69d6f2391b 2026-03-15 18:56:02,799 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 18:56:02,814 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b45dad1727ff69d6f2391b HTTP/1.1" 200 None 2026-03-15 18:56:02,815 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 18:56:02,829 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aeba33feb96b28aa34a775 HTTP/1.1" 200 None 2026-03-15 18:56:02,830 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 18:56:02,860 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b45dad1727ff69d6f2391b HTTP/1.1" 200 None 2026-03-15 18:56:02,862 - lava_callback - ERROR - Error processing callback for node 69b45dad1727ff69d6f2391b: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:51096 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51106 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48042 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:48044 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57062 - "GET / HTTP/1.0" 200 OK 2026-03-15 18:56:36,216 - lava_callback - INFO - Received callback for node 69b45dd51727ff69d6f23926 INFO: 172.21.0.1:51510 - "POST /node/69b45dd51727ff69d6f23926 HTTP/1.0" 202 Accepted 2026-03-15 18:56:36,221 - lava_callback - INFO - Starting async job submit for node 69b45dd51727ff69d6f23926 2026-03-15 18:56:36,222 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 18:56:36,240 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b45dd51727ff69d6f23926 HTTP/1.1" 200 None 2026-03-15 18:56:36,241 - lava_callback - DEBUG - Processing node 69b45dd51727ff69d6f23926: baseline-arm-clabbe 2026-03-15 18:56:36,241 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b45dd51727ff69d6f23926 2026-03-15 18:56:36,242 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 18:56:36,262 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b45dd51727ff69d6f23926 HTTP/1.1" 200 None 2026-03-15 18:56:36,264 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 18:56:36,283 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aeba33feb96b28aa34a775 HTTP/1.1" 200 None 2026-03-15 18:56:36,284 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 18:56:36,343 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b45dd51727ff69d6f23926 HTTP/1.1" 200 None 2026-03-15 18:56:36,350 - lava_callback - ERROR - Error processing callback for node 69b45dd51727ff69d6f23926: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:51516 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43170 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48168 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46794 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46808 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53982 - "GET /api/metrics HTTP/1.0" 200 OK 2026-03-15 18:57:16,180 - lava_callback - INFO - Received callback for node 69b45dfa1727ff69d6f23937 INFO: 172.21.0.1:53990 - "POST /node/69b45dfa1727ff69d6f23937 HTTP/1.0" 202 Accepted 2026-03-15 18:57:16,185 - lava_callback - INFO - Starting async job submit for node 69b45dfa1727ff69d6f23937 2026-03-15 18:57:16,186 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 18:57:16,201 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b45dfa1727ff69d6f23937 HTTP/1.1" 200 None 2026-03-15 18:57:16,202 - lava_callback - DEBUG - Processing node 69b45dfa1727ff69d6f23937: baseline-arm-clabbe 2026-03-15 18:57:16,202 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b45dfa1727ff69d6f23937 2026-03-15 18:57:16,203 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 18:57:16,216 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b45dfa1727ff69d6f23937 HTTP/1.1" 200 None 2026-03-15 18:57:16,218 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 18:57:16,241 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aeba33feb96b28aa34a775 HTTP/1.1" 200 None 2026-03-15 18:57:16,243 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 18:57:16,265 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b45dfa1727ff69d6f23937 HTTP/1.1" 200 None 2026-03-15 18:57:16,267 - lava_callback - ERROR - Error processing callback for node 69b45dfa1727ff69d6f23937: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:54002 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59652 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41328 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51872 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56482 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42122 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42128 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40072 - "GET /api/metrics HTTP/1.0" 200 OK 2026-03-15 18:58:16,240 - lava_callback - INFO - Received callback for node 69b45e421727ff69d6f23951 INFO: 172.21.0.1:40082 - "POST /node/69b45e421727ff69d6f23951 HTTP/1.0" 202 Accepted 2026-03-15 18:58:16,245 - lava_callback - INFO - Starting async job submit for node 69b45e421727ff69d6f23951 2026-03-15 18:58:16,246 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 18:58:16,285 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b45e421727ff69d6f23951 HTTP/1.1" 200 None 2026-03-15 18:58:16,286 - lava_callback - DEBUG - Processing node 69b45e421727ff69d6f23951: baseline-arm-clabbe 2026-03-15 18:58:16,286 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b45e421727ff69d6f23951 2026-03-15 18:58:16,287 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 18:58:16,321 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b45e421727ff69d6f23951 HTTP/1.1" 200 None 2026-03-15 18:58:16,323 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 18:58:16,336 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aeba33feb96b28aa34a775 HTTP/1.1" 200 None 2026-03-15 18:58:16,337 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 18:58:16,389 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b45e421727ff69d6f23951 HTTP/1.1" 200 None 2026-03-15 18:58:16,391 - lava_callback - ERROR - Error processing callback for node 69b45e421727ff69d6f23951: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:40096 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53342 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58680 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60966 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39104 - "GET / HTTP/1.0" 200 OK 2026-03-15 18:59:03,031 - lava_callback - INFO - Received callback for node 69b45e631727ff69d6f2395b INFO: 172.21.0.1:40566 - "POST /node/69b45e631727ff69d6f2395b HTTP/1.0" 202 Accepted 2026-03-15 18:59:03,037 - lava_callback - INFO - Starting async job submit for node 69b45e631727ff69d6f2395b 2026-03-15 18:59:03,037 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 18:59:03,061 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b45e631727ff69d6f2395b HTTP/1.1" 200 None 2026-03-15 18:59:03,062 - lava_callback - DEBUG - Processing node 69b45e631727ff69d6f2395b: baseline-arm-baylibre 2026-03-15 18:59:03,062 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b45e631727ff69d6f2395b 2026-03-15 18:59:03,063 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 18:59:03,086 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b45e631727ff69d6f2395b HTTP/1.1" 200 None 2026-03-15 18:59:03,088 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 18:59:03,110 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aeba33feb96b28aa34a775 HTTP/1.1" 200 None 2026-03-15 18:59:03,111 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 18:59:03,132 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b45e631727ff69d6f2395b HTTP/1.1" 200 None 2026-03-15 18:59:03,133 - lava_callback - ERROR - Error processing callback for node 69b45e631727ff69d6f2395b: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:40576 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40588 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43556 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:43558 - "GET / HTTP/1.0" 200 OK 2026-03-15 18:59:22,903 - lava_callback - INFO - Received callback for node 69b45e881727ff69d6f23964 INFO: 172.21.0.1:47620 - "POST /node/69b45e881727ff69d6f23964 HTTP/1.0" 202 Accepted 2026-03-15 18:59:22,909 - lava_callback - INFO - Starting async job submit for node 69b45e881727ff69d6f23964 2026-03-15 18:59:22,910 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 18:59:22,948 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b45e881727ff69d6f23964 HTTP/1.1" 200 None 2026-03-15 18:59:22,949 - lava_callback - DEBUG - Processing node 69b45e881727ff69d6f23964: baseline-arm-baylibre 2026-03-15 18:59:22,949 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b45e881727ff69d6f23964 2026-03-15 18:59:22,950 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 18:59:22,973 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b45e881727ff69d6f23964 HTTP/1.1" 200 None 2026-03-15 18:59:22,974 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 18:59:22,999 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aeba33feb96b28aa34a775 HTTP/1.1" 200 None 2026-03-15 18:59:23,001 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 18:59:23,021 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b45e881727ff69d6f23964 HTTP/1.1" 200 None 2026-03-15 18:59:23,027 - lava_callback - ERROR - Error processing callback for node 69b45e881727ff69d6f23964: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:47626 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41212 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33152 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45718 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58082 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58092 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34794 - "GET /api/metrics HTTP/1.0" 200 OK 2026-03-15 19:00:16,462 - lava_callback - INFO - Received callback for node 69b45eae1727ff69d6f23973 INFO: 172.21.0.1:34808 - "POST /node/69b45eae1727ff69d6f23973 HTTP/1.0" 202 Accepted 2026-03-15 19:00:16,469 - lava_callback - INFO - Starting async job submit for node 69b45eae1727ff69d6f23973 2026-03-15 19:00:16,470 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 19:00:16,497 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b45eae1727ff69d6f23973 HTTP/1.1" 200 None 2026-03-15 19:00:16,498 - lava_callback - DEBUG - Processing node 69b45eae1727ff69d6f23973: baseline-arm-clabbe 2026-03-15 19:00:16,499 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b45eae1727ff69d6f23973 2026-03-15 19:00:16,499 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 INFO: 172.21.0.1:34810 - "GET / HTTP/1.0" 200 OK 2026-03-15 19:00:16,513 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b45eae1727ff69d6f23973 HTTP/1.1" 200 None 2026-03-15 19:00:16,515 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 19:00:16,531 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aeba33feb96b28aa34a775 HTTP/1.1" 200 None 2026-03-15 19:00:16,533 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 19:00:16,554 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b45eae1727ff69d6f23973 HTTP/1.1" 200 None 2026-03-15 19:00:16,556 - lava_callback - ERROR - Error processing callback for node 69b45eae1727ff69d6f23973: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:58144 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35674 - "GET / HTTP/1.0" 200 OK 2026-03-15 19:00:42,990 - lava_callback - INFO - Received callback for node 69b45ece1727ff69d6f2397f INFO: 172.21.0.1:36034 - "POST /node/69b45ece1727ff69d6f2397f HTTP/1.0" 202 Accepted 2026-03-15 19:00:42,996 - lava_callback - INFO - Starting async job submit for node 69b45ece1727ff69d6f2397f 2026-03-15 19:00:42,997 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 19:00:43,014 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b45ece1727ff69d6f2397f HTTP/1.1" 200 None 2026-03-15 19:00:43,015 - lava_callback - DEBUG - Processing node 69b45ece1727ff69d6f2397f: baseline-arm-baylibre 2026-03-15 19:00:43,015 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b45ece1727ff69d6f2397f 2026-03-15 19:00:43,016 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 19:00:43,040 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b45ece1727ff69d6f2397f HTTP/1.1" 200 None 2026-03-15 19:00:43,042 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 19:00:43,055 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b35934974c91e64560e49d HTTP/1.1" 200 None 2026-03-15 19:00:43,056 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 19:00:43,092 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b45ece1727ff69d6f2397f HTTP/1.1" 200 None 2026-03-15 19:00:43,093 - lava_callback - ERROR - Error processing callback for node 69b45ece1727ff69d6f2397f: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:36046 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36756 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59564 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59580 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35050 - "GET /api/metrics HTTP/1.0" 200 OK 2026-03-15 19:01:16,436 - lava_callback - INFO - Received callback for node 69b45ef71727ff69d6f2398a INFO: 172.21.0.1:35056 - "POST /node/69b45ef71727ff69d6f2398a HTTP/1.0" 202 Accepted 2026-03-15 19:01:16,441 - lava_callback - INFO - Starting async job submit for node 69b45ef71727ff69d6f2398a 2026-03-15 19:01:16,442 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 INFO: 172.21.0.1:35066 - "GET / HTTP/1.0" 200 OK 2026-03-15 19:01:16,520 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b45ef71727ff69d6f2398a HTTP/1.1" 200 None 2026-03-15 19:01:16,521 - lava_callback - DEBUG - Processing node 69b45ef71727ff69d6f2398a: baseline-arm-clabbe 2026-03-15 19:01:16,521 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b45ef71727ff69d6f2398a 2026-03-15 19:01:16,522 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 19:01:16,548 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b45ef71727ff69d6f2398a HTTP/1.1" 200 None 2026-03-15 19:01:16,549 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 19:01:16,563 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aeba33feb96b28aa34a775 HTTP/1.1" 200 None 2026-03-15 19:01:16,565 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 19:01:16,585 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b45ef71727ff69d6f2398a HTTP/1.1" 200 None 2026-03-15 19:01:16,587 - lava_callback - ERROR - Error processing callback for node 69b45ef71727ff69d6f2398a: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:41656 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59220 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60656 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48820 - "GET / HTTP/1.0" 200 OK 2026-03-15 19:02:03,064 - lava_callback - INFO - Received callback for node 69b45f1a1727ff69d6f23997 INFO: 172.21.0.1:51694 - "POST /node/69b45f1a1727ff69d6f23997 HTTP/1.0" 202 Accepted 2026-03-15 19:02:03,069 - lava_callback - INFO - Starting async job submit for node 69b45f1a1727ff69d6f23997 2026-03-15 19:02:03,070 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 19:02:03,084 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b45f1a1727ff69d6f23997 HTTP/1.1" 200 None 2026-03-15 19:02:03,085 - lava_callback - DEBUG - Processing node 69b45f1a1727ff69d6f23997: baseline-arm-baylibre 2026-03-15 19:02:03,085 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b45f1a1727ff69d6f23997 2026-03-15 19:02:03,086 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 19:02:03,122 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b45f1a1727ff69d6f23997 HTTP/1.1" 200 None 2026-03-15 19:02:03,124 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 19:02:03,175 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aeba33feb96b28aa34a775 HTTP/1.1" 200 None 2026-03-15 19:02:03,177 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 19:02:03,203 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b45f1a1727ff69d6f23997 HTTP/1.1" 200 None 2026-03-15 19:02:03,205 - lava_callback - ERROR - Error processing callback for node 69b45f1a1727ff69d6f23997: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:51706 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51712 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40518 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:40524 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52358 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47360 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43680 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51618 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53378 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53392 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59104 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:59114 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53424 - "GET / HTTP/1.0" 200 OK 2026-03-15 19:03:36,492 - lava_callback - INFO - Received callback for node 69b45f841727ff69d6f239bb INFO: 172.21.0.1:39464 - "POST /node/69b45f841727ff69d6f239bb HTTP/1.0" 202 Accepted 2026-03-15 19:03:36,498 - lava_callback - INFO - Starting async job submit for node 69b45f841727ff69d6f239bb 2026-03-15 19:03:36,498 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 INFO: 172.21.0.1:39478 - "GET / HTTP/1.0" 200 OK 2026-03-15 19:03:36,514 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b45f841727ff69d6f239bb HTTP/1.1" 200 None 2026-03-15 19:03:36,515 - lava_callback - DEBUG - Processing node 69b45f841727ff69d6f239bb: baseline-arm-clabbe 2026-03-15 19:03:36,515 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b45f841727ff69d6f239bb 2026-03-15 19:03:36,516 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 19:03:36,530 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b45f841727ff69d6f239bb HTTP/1.1" 200 None 2026-03-15 19:03:36,531 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 19:03:36,544 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b35934974c91e64560e49d HTTP/1.1" 200 None 2026-03-15 19:03:36,546 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 19:03:36,573 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b45f841727ff69d6f239bb HTTP/1.1" 200 None 2026-03-15 19:03:36,575 - lava_callback - ERROR - Error processing callback for node 69b45f841727ff69d6f239bb: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:45456 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59548 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56756 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56768 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49592 - "GET /api/metrics HTTP/1.0" 200 OK 2026-03-15 19:04:16,475 - lava_callback - INFO - Received callback for node 69b45fa81727ff69d6f239c7 INFO: 172.21.0.1:49596 - "POST /node/69b45fa81727ff69d6f239c7 HTTP/1.0" 202 Accepted 2026-03-15 19:04:16,481 - lava_callback - INFO - Starting async job submit for node 69b45fa81727ff69d6f239c7 2026-03-15 19:04:16,482 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 19:04:16,496 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b45fa81727ff69d6f239c7 HTTP/1.1" 200 None 2026-03-15 19:04:16,497 - lava_callback - DEBUG - Processing node 69b45fa81727ff69d6f239c7: baseline-arm-clabbe 2026-03-15 19:04:16,498 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b45fa81727ff69d6f239c7 2026-03-15 19:04:16,498 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 19:04:16,522 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b45fa81727ff69d6f239c7 HTTP/1.1" 200 None INFO: 172.21.0.1:49606 - "GET / HTTP/1.0" 200 OK 2026-03-15 19:04:16,524 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 19:04:16,538 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aeba33feb96b28aa34a775 HTTP/1.1" 200 None 2026-03-15 19:04:16,540 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 19:04:16,560 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b45fa81727ff69d6f239c7 HTTP/1.1" 200 None 2026-03-15 19:04:16,561 - lava_callback - ERROR - Error processing callback for node 69b45fa81727ff69d6f239c7: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:43358 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41220 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41088 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40194 - "GET / HTTP/1.0" 200 OK 2026-03-15 19:04:56,517 - lava_callback - INFO - Received callback for node 69b45fcc1727ff69d6f239d2 INFO: 172.21.0.1:40208 - "POST /node/69b45fcc1727ff69d6f239d2 HTTP/1.0" 202 Accepted 2026-03-15 19:04:56,522 - lava_callback - INFO - Starting async job submit for node 69b45fcc1727ff69d6f239d2 2026-03-15 19:04:56,523 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 19:04:56,538 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b45fcc1727ff69d6f239d2 HTTP/1.1" 200 None 2026-03-15 19:04:56,539 - lava_callback - DEBUG - Processing node 69b45fcc1727ff69d6f239d2: baseline-arm-clabbe 2026-03-15 19:04:56,540 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b45fcc1727ff69d6f239d2 2026-03-15 19:04:56,540 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 19:04:56,555 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b45fcc1727ff69d6f239d2 HTTP/1.1" 200 None 2026-03-15 19:04:56,556 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 19:04:56,576 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aeba33feb96b28aa34a775 HTTP/1.1" 200 None 2026-03-15 19:04:56,578 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 19:04:56,599 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b45fcc1727ff69d6f239d2 HTTP/1.1" 200 None 2026-03-15 19:04:56,610 - lava_callback - ERROR - Error processing callback for node 69b45fcc1727ff69d6f239d2: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:42916 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42932 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35944 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:35958 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42442 - "GET / HTTP/1.0" 200 OK 2026-03-15 19:05:36,484 - lava_callback - INFO - Received callback for node 69b45ff11727ff69d6f239da INFO: 172.21.0.1:37798 - "POST /node/69b45ff11727ff69d6f239da HTTP/1.0" 202 Accepted 2026-03-15 19:05:36,490 - lava_callback - INFO - Starting async job submit for node 69b45ff11727ff69d6f239da 2026-03-15 19:05:36,490 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 19:05:36,505 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b45ff11727ff69d6f239da HTTP/1.1" 200 None 2026-03-15 19:05:36,506 - lava_callback - DEBUG - Processing node 69b45ff11727ff69d6f239da: baseline-arm-clabbe 2026-03-15 19:05:36,507 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b45ff11727ff69d6f239da 2026-03-15 19:05:36,507 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 INFO: 172.21.0.1:37800 - "GET / HTTP/1.0" 200 OK 2026-03-15 19:05:36,555 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b45ff11727ff69d6f239da HTTP/1.1" 200 None 2026-03-15 19:05:36,557 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 19:05:36,571 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b35934974c91e64560e49d HTTP/1.1" 200 None 2026-03-15 19:05:36,573 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 19:05:36,594 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b45ff11727ff69d6f239da HTTP/1.1" 200 None 2026-03-15 19:05:36,595 - lava_callback - ERROR - Error processing callback for node 69b45ff11727ff69d6f239da: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:34374 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58052 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58296 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58312 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47552 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:47566 - "GET / HTTP/1.0" 200 OK 2026-03-15 19:06:16,564 - lava_callback - INFO - Received callback for node 69b460151727ff69d6f239e9 INFO: 172.21.0.1:47578 - "POST /node/69b460151727ff69d6f239e9 HTTP/1.0" 202 Accepted 2026-03-15 19:06:16,570 - lava_callback - INFO - Starting async job submit for node 69b460151727ff69d6f239e9 2026-03-15 19:06:16,571 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 19:06:16,587 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b460151727ff69d6f239e9 HTTP/1.1" 200 None 2026-03-15 19:06:16,588 - lava_callback - DEBUG - Processing node 69b460151727ff69d6f239e9: baseline-arm-clabbe 2026-03-15 19:06:16,588 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b460151727ff69d6f239e9 2026-03-15 19:06:16,589 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 19:06:16,602 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b460151727ff69d6f239e9 HTTP/1.1" 200 None 2026-03-15 19:06:16,604 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 19:06:16,617 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aeba33feb96b28aa34a775 HTTP/1.1" 200 None 2026-03-15 19:06:16,618 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 19:06:16,682 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b460151727ff69d6f239e9 HTTP/1.1" 200 None 2026-03-15 19:06:16,684 - lava_callback - ERROR - Error processing callback for node 69b460151727ff69d6f239e9: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:48000 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49964 - "GET / HTTP/1.0" 200 OK 2026-03-15 19:06:36,548 - lava_callback - INFO - Received callback for node 69b4603a1727ff69d6f239f2 INFO: 172.21.0.1:49970 - "POST /node/69b4603a1727ff69d6f239f2 HTTP/1.0" 202 Accepted 2026-03-15 19:06:36,553 - lava_callback - INFO - Starting async job submit for node 69b4603a1727ff69d6f239f2 2026-03-15 19:06:36,554 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 19:06:36,586 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b4603a1727ff69d6f239f2 HTTP/1.1" 200 None 2026-03-15 19:06:36,587 - lava_callback - DEBUG - Processing node 69b4603a1727ff69d6f239f2: baseline-arm-clabbe 2026-03-15 19:06:36,587 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b4603a1727ff69d6f239f2 2026-03-15 19:06:36,588 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 19:06:36,613 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b4603a1727ff69d6f239f2 HTTP/1.1" 200 None 2026-03-15 19:06:36,614 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 19:06:36,628 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aeba33feb96b28aa34a775 HTTP/1.1" 200 None 2026-03-15 19:06:36,630 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 19:06:36,661 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b4603a1727ff69d6f239f2 HTTP/1.1" 200 None 2026-03-15 19:06:36,666 - lava_callback - ERROR - Error processing callback for node 69b4603a1727ff69d6f239f2: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:55844 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56746 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42106 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42118 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46104 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:46106 - "GET / HTTP/1.0" 200 OK 2026-03-15 19:07:16,586 - lava_callback - INFO - Received callback for node 69b4605e1727ff69d6f239fd INFO: 172.21.0.1:46116 - "POST /node/69b4605e1727ff69d6f239fd HTTP/1.0" 202 Accepted 2026-03-15 19:07:16,592 - lava_callback - INFO - Starting async job submit for node 69b4605e1727ff69d6f239fd 2026-03-15 19:07:16,593 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 19:07:16,618 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b4605e1727ff69d6f239fd HTTP/1.1" 200 None 2026-03-15 19:07:16,619 - lava_callback - DEBUG - Processing node 69b4605e1727ff69d6f239fd: baseline-arm-clabbe 2026-03-15 19:07:16,619 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b4605e1727ff69d6f239fd 2026-03-15 19:07:16,620 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 19:07:16,633 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b4605e1727ff69d6f239fd HTTP/1.1" 200 None 2026-03-15 19:07:16,634 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 19:07:16,647 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b35934974c91e64560e49d HTTP/1.1" 200 None 2026-03-15 19:07:16,649 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 19:07:16,669 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b4605e1727ff69d6f239fd HTTP/1.1" 200 None 2026-03-15 19:07:16,670 - lava_callback - ERROR - Error processing callback for node 69b4605e1727ff69d6f239fd: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:53548 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43554 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34238 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38678 - "GET / HTTP/1.0" 200 OK 2026-03-15 19:07:56,618 - lava_callback - INFO - Received callback for node 69b460831727ff69d6f23a04 INFO: 172.21.0.1:38684 - "POST /node/69b460831727ff69d6f23a04 HTTP/1.0" 202 Accepted 2026-03-15 19:07:56,623 - lava_callback - INFO - Starting async job submit for node 69b460831727ff69d6f23a04 2026-03-15 19:07:56,624 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 19:07:56,638 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b460831727ff69d6f23a04 HTTP/1.1" 200 None 2026-03-15 19:07:56,639 - lava_callback - DEBUG - Processing node 69b460831727ff69d6f23a04: baseline-arm-clabbe 2026-03-15 19:07:56,639 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b460831727ff69d6f23a04 2026-03-15 19:07:56,640 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 19:07:56,653 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b460831727ff69d6f23a04 HTTP/1.1" 200 None 2026-03-15 19:07:56,654 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 19:07:56,668 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b35934974c91e64560e49d HTTP/1.1" 200 None 2026-03-15 19:07:56,670 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 19:07:56,690 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b460831727ff69d6f23a04 HTTP/1.1" 200 None 2026-03-15 19:07:56,691 - lava_callback - ERROR - Error processing callback for node 69b460831727ff69d6f23a04: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:56888 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56896 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40422 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:40424 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52006 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47416 - "GET / HTTP/1.0" 200 OK 2026-03-15 19:08:36,670 - lava_callback - INFO - Received callback for node 69b460a81727ff69d6f23a0d INFO: 172.21.0.1:47418 - "POST /node/69b460a81727ff69d6f23a0d HTTP/1.0" 202 Accepted 2026-03-15 19:08:36,675 - lava_callback - INFO - Starting async job submit for node 69b460a81727ff69d6f23a0d 2026-03-15 19:08:36,676 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 19:08:36,692 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b460a81727ff69d6f23a0d HTTP/1.1" 200 None 2026-03-15 19:08:36,693 - lava_callback - DEBUG - Processing node 69b460a81727ff69d6f23a0d: baseline-arm-clabbe 2026-03-15 19:08:36,693 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b460a81727ff69d6f23a0d 2026-03-15 19:08:36,694 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 19:08:36,708 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b460a81727ff69d6f23a0d HTTP/1.1" 200 None 2026-03-15 19:08:36,709 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 19:08:36,741 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b35934974c91e64560e49d HTTP/1.1" 200 None 2026-03-15 19:08:36,743 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 19:08:36,763 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b460a81727ff69d6f23a0d HTTP/1.1" 200 None 2026-03-15 19:08:36,764 - lava_callback - ERROR - Error processing callback for node 69b460a81727ff69d6f23a0d: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:36266 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37020 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43322 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43336 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47584 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:47598 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60202 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38496 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44166 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58278 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55764 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55768 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51608 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:51618 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45786 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36612 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37004 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33124 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38952 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38966 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55896 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:55906 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58942 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59646 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48082 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54610 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48216 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48218 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53700 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:53704 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54302 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47076 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35578 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41538 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49350 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49358 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43042 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:43044 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57982 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38098 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59652 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41302 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35422 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35436 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44012 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:44024 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33270 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49936 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36960 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46052 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42882 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42892 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49878 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:49888 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45648 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58608 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56300 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50172 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51016 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51020 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43062 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:43070 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47174 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44000 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39604 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53042 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40896 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40900 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34092 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:34094 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39106 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36420 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44516 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54264 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52708 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52714 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40668 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:40674 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53990 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60488 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60802 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40178 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55442 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55444 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55154 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:55158 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36714 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48428 - "GET / HTTP/1.0" 200 OK 2026-03-15 19:19:44,130 - lava_callback - INFO - Received callback for node 69b4633d1727ff69d6f23a50 INFO: 172.21.0.1:59768 - "POST /node/69b4633d1727ff69d6f23a50 HTTP/1.0" 202 Accepted 2026-03-15 19:19:44,135 - lava_callback - INFO - Starting async job submit for node 69b4633d1727ff69d6f23a50 2026-03-15 19:19:44,136 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 19:19:44,152 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b4633d1727ff69d6f23a50 HTTP/1.1" 200 None 2026-03-15 19:19:44,153 - lava_callback - DEBUG - Processing node 69b4633d1727ff69d6f23a50: baseline-arm64-baylibre 2026-03-15 19:19:44,153 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b4633d1727ff69d6f23a50 2026-03-15 19:19:44,154 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 19:19:44,167 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b4633d1727ff69d6f23a50 HTTP/1.1" 200 None 2026-03-15 19:19:44,169 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 19:19:44,182 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b1960ba26b422765ba3717 HTTP/1.1" 200 None 2026-03-15 19:19:44,184 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 19:19:44,204 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b4633d1727ff69d6f23a50 HTTP/1.1" 200 None 2026-03-15 19:19:44,205 - lava_callback - ERROR - Error processing callback for node 69b4633d1727ff69d6f23a50: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:59780 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60830 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34390 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34400 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34292 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:34296 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59126 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41398 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54580 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55176 - "GET / HTTP/1.0" 200 OK 2026-03-15 19:21:04,372 - lava_callback - INFO - Received callback for node 69b463931727ff69d6f23a5d INFO: 172.21.0.1:54272 - "POST /node/69b463931727ff69d6f23a5d HTTP/1.0" 202 Accepted 2026-03-15 19:21:04,377 - lava_callback - INFO - Starting async job submit for node 69b463931727ff69d6f23a5d 2026-03-15 19:21:04,378 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 19:21:04,417 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b463931727ff69d6f23a5d HTTP/1.1" 200 None 2026-03-15 19:21:04,417 - lava_callback - DEBUG - Processing node 69b463931727ff69d6f23a5d: baseline-arm64-baylibre 2026-03-15 19:21:04,418 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b463931727ff69d6f23a5d 2026-03-15 19:21:04,418 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 19:21:04,432 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b463931727ff69d6f23a5d HTTP/1.1" 200 None 2026-03-15 19:21:04,433 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 19:21:04,446 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b1960ba26b422765ba3717 HTTP/1.1" 200 None 2026-03-15 19:21:04,448 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 19:21:04,468 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b463931727ff69d6f23a5d HTTP/1.1" 200 None 2026-03-15 19:21:04,470 - lava_callback - ERROR - Error processing callback for node 69b463931727ff69d6f23a5d: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:54288 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54290 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35408 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:35414 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39218 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47036 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42370 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57254 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40804 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40814 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55210 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:55212 - "GET / HTTP/1.0" 200 OK 2026-03-15 19:22:24,173 - lava_callback - INFO - Received callback for node 69b463e31727ff69d6f23a6c INFO: 172.21.0.1:57536 - "POST /node/69b463e31727ff69d6f23a6c HTTP/1.0" 202 Accepted 2026-03-15 19:22:24,179 - lava_callback - INFO - Starting async job submit for node 69b463e31727ff69d6f23a6c 2026-03-15 19:22:24,180 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 19:22:24,195 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b463e31727ff69d6f23a6c HTTP/1.1" 200 None 2026-03-15 19:22:24,195 - lava_callback - DEBUG - Processing node 69b463e31727ff69d6f23a6c: baseline-arm64-baylibre 2026-03-15 19:22:24,196 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b463e31727ff69d6f23a6c 2026-03-15 19:22:24,196 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 19:22:24,210 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b463e31727ff69d6f23a6c HTTP/1.1" 200 None 2026-03-15 19:22:24,211 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 19:22:24,230 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b1960ba26b422765ba3717 HTTP/1.1" 200 None 2026-03-15 19:22:24,232 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 19:22:24,253 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b463e31727ff69d6f23a6c HTTP/1.1" 200 None 2026-03-15 19:22:24,254 - lava_callback - ERROR - Error processing callback for node 69b463e31727ff69d6f23a6c: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:57540 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:32844 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44058 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53646 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35626 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35638 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58744 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:58760 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59878 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36990 - "GET / HTTP/1.0" 200 OK 2026-03-15 19:23:44,272 - lava_callback - INFO - Received callback for node 69b464301727ff69d6f23a74 INFO: 172.21.0.1:49724 - "POST /node/69b464301727ff69d6f23a74 HTTP/1.0" 202 Accepted 2026-03-15 19:23:44,278 - lava_callback - INFO - Starting async job submit for node 69b464301727ff69d6f23a74 2026-03-15 19:23:44,279 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 19:23:44,294 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b464301727ff69d6f23a74 HTTP/1.1" 200 None 2026-03-15 19:23:44,295 - lava_callback - DEBUG - Processing node 69b464301727ff69d6f23a74: baseline-arm64-baylibre 2026-03-15 19:23:44,296 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b464301727ff69d6f23a74 2026-03-15 19:23:44,296 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 19:23:44,311 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b464301727ff69d6f23a74 HTTP/1.1" 200 None 2026-03-15 19:23:44,313 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 19:23:44,331 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b1960ba26b422765ba3717 HTTP/1.1" 200 None 2026-03-15 19:23:44,333 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 19:23:44,357 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b464301727ff69d6f23a74 HTTP/1.1" 200 None 2026-03-15 19:23:44,358 - lava_callback - ERROR - Error processing callback for node 69b464301727ff69d6f23a74: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:49732 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36762 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57064 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57080 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42088 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:42092 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55510 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33474 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57498 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37978 - "GET / HTTP/1.0" 200 OK 2026-03-15 19:25:04,423 - lava_callback - INFO - Received callback for node 69b4647c1727ff69d6f23a80 INFO: 172.21.0.1:57064 - "POST /node/69b4647c1727ff69d6f23a80 HTTP/1.0" 202 Accepted 2026-03-15 19:25:04,429 - lava_callback - INFO - Starting async job submit for node 69b4647c1727ff69d6f23a80 2026-03-15 19:25:04,430 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 19:25:04,467 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b4647c1727ff69d6f23a80 HTTP/1.1" 200 None 2026-03-15 19:25:04,468 - lava_callback - DEBUG - Processing node 69b4647c1727ff69d6f23a80: baseline-arm64-baylibre 2026-03-15 19:25:04,468 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b4647c1727ff69d6f23a80 2026-03-15 19:25:04,468 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 19:25:04,482 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b4647c1727ff69d6f23a80 HTTP/1.1" 200 None 2026-03-15 19:25:04,483 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 19:25:04,516 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b1960ba26b422765ba3717 HTTP/1.1" 200 None 2026-03-15 19:25:04,518 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 19:25:04,539 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b4647c1727ff69d6f23a80 HTTP/1.1" 200 None 2026-03-15 19:25:04,545 - lava_callback - ERROR - Error processing callback for node 69b4647c1727ff69d6f23a80: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:57076 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57082 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39094 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:39102 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38860 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57430 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51628 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48760 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34918 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34924 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35618 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:35632 - "GET / HTTP/1.0" 200 OK 2026-03-15 19:26:24,530 - lava_callback - INFO - Received callback for node 69b464d31727ff69d6f23a8c INFO: 172.21.0.1:37562 - "POST /node/69b464d31727ff69d6f23a8c HTTP/1.0" 202 Accepted 2026-03-15 19:26:24,536 - lava_callback - INFO - Starting async job submit for node 69b464d31727ff69d6f23a8c 2026-03-15 19:26:24,537 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 19:26:24,552 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b464d31727ff69d6f23a8c HTTP/1.1" 200 None 2026-03-15 19:26:24,553 - lava_callback - DEBUG - Processing node 69b464d31727ff69d6f23a8c: baseline-arm64-baylibre 2026-03-15 19:26:24,553 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b464d31727ff69d6f23a8c 2026-03-15 19:26:24,554 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 19:26:24,568 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b464d31727ff69d6f23a8c HTTP/1.1" 200 None 2026-03-15 19:26:24,569 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 19:26:24,595 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b1960ba26b422765ba3717 HTTP/1.1" 200 None 2026-03-15 19:26:24,597 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 19:26:24,618 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b464d31727ff69d6f23a8c HTTP/1.1" 200 None 2026-03-15 19:26:24,619 - lava_callback - ERROR - Error processing callback for node 69b464d31727ff69d6f23a8c: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:37568 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37716 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33856 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37496 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45118 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45134 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45214 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:45226 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56376 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52620 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58364 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54298 - "GET / HTTP/1.0" 200 OK 2026-03-15 19:27:57,524 - lava_callback - INFO - Received callback for node 69b465311727ff69d6f23a96 INFO: 172.21.0.1:54312 - "POST /node/69b465311727ff69d6f23a96 HTTP/1.0" 202 Accepted 2026-03-15 19:27:57,529 - lava_callback - INFO - Starting async job submit for node 69b465311727ff69d6f23a96 2026-03-15 19:27:57,530 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 19:27:57,562 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b465311727ff69d6f23a96 HTTP/1.1" 200 None 2026-03-15 19:27:57,563 - lava_callback - DEBUG - Processing node 69b465311727ff69d6f23a96: baseline-arm64-clabbe 2026-03-15 19:27:57,563 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b465311727ff69d6f23a96 2026-03-15 19:27:57,564 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 19:27:57,584 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b465311727ff69d6f23a96 HTTP/1.1" 200 None 2026-03-15 19:27:57,586 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 19:27:57,602 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b1960ba26b422765ba3717 HTTP/1.1" 200 None 2026-03-15 19:27:57,604 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 19:27:57,624 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b465311727ff69d6f23a96 HTTP/1.1" 200 None 2026-03-15 19:27:57,626 - lava_callback - ERROR - Error processing callback for node 69b465311727ff69d6f23a96: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:44898 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44912 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54808 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:54822 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44476 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39546 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49170 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38858 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40212 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40226 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45282 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:45286 - "GET / HTTP/1.0" 200 OK 2026-03-15 19:29:17,554 - lava_callback - INFO - Received callback for node 69b465891727ff69d6f23aa2 INFO: 172.21.0.1:45288 - "POST /node/69b465891727ff69d6f23aa2 HTTP/1.0" 202 Accepted 2026-03-15 19:29:17,560 - lava_callback - INFO - Starting async job submit for node 69b465891727ff69d6f23aa2 2026-03-15 19:29:17,561 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 19:29:17,580 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b465891727ff69d6f23aa2 HTTP/1.1" 200 None 2026-03-15 19:29:17,580 - lava_callback - DEBUG - Processing node 69b465891727ff69d6f23aa2: baseline-arm64-clabbe 2026-03-15 19:29:17,581 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b465891727ff69d6f23aa2 2026-03-15 19:29:17,581 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 19:29:17,595 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b465891727ff69d6f23aa2 HTTP/1.1" 200 None 2026-03-15 19:29:17,596 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 19:29:17,620 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b1960ba26b422765ba3717 HTTP/1.1" 200 None 2026-03-15 19:29:17,621 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 19:29:17,642 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b465891727ff69d6f23aa2 HTTP/1.1" 200 None 2026-03-15 19:29:17,643 - lava_callback - ERROR - Error processing callback for node 69b465891727ff69d6f23aa2: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:49684 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39056 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34064 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56834 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59894 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59896 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52180 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:52192 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41400 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39018 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59480 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36096 - "GET / HTTP/1.0" 200 OK 2026-03-15 19:30:57,660 - lava_callback - INFO - Received callback for node 69b465e11727ff69d6f23aae INFO: 172.21.0.1:36108 - "POST /node/69b465e11727ff69d6f23aae HTTP/1.0" 202 Accepted 2026-03-15 19:30:57,666 - lava_callback - INFO - Starting async job submit for node 69b465e11727ff69d6f23aae 2026-03-15 19:30:57,667 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 19:30:57,681 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b465e11727ff69d6f23aae HTTP/1.1" 200 None 2026-03-15 19:30:57,682 - lava_callback - DEBUG - Processing node 69b465e11727ff69d6f23aae: baseline-arm64-clabbe 2026-03-15 19:30:57,682 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b465e11727ff69d6f23aae 2026-03-15 19:30:57,683 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 19:30:57,697 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b465e11727ff69d6f23aae HTTP/1.1" 200 None 2026-03-15 19:30:57,699 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 19:30:57,713 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b1960ba26b422765ba3717 HTTP/1.1" 200 None 2026-03-15 19:30:57,715 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 19:30:57,763 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b465e11727ff69d6f23aae HTTP/1.1" 200 None 2026-03-15 19:30:57,765 - lava_callback - ERROR - Error processing callback for node 69b465e11727ff69d6f23aae: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:42800 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42804 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59476 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:59484 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50028 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33130 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45858 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40654 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46374 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46378 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56530 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:56532 - "GET / HTTP/1.0" 200 OK 2026-03-15 19:32:17,685 - lava_callback - INFO - Received callback for node 69b466391727ff69d6f23ab9 INFO: 172.21.0.1:56536 - "POST /node/69b466391727ff69d6f23ab9 HTTP/1.0" 202 Accepted 2026-03-15 19:32:17,691 - lava_callback - INFO - Starting async job submit for node 69b466391727ff69d6f23ab9 2026-03-15 19:32:17,691 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 19:32:17,706 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b466391727ff69d6f23ab9 HTTP/1.1" 200 None 2026-03-15 19:32:17,707 - lava_callback - DEBUG - Processing node 69b466391727ff69d6f23ab9: baseline-arm64-clabbe 2026-03-15 19:32:17,707 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b466391727ff69d6f23ab9 2026-03-15 19:32:17,708 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 19:32:17,721 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b466391727ff69d6f23ab9 HTTP/1.1" 200 None 2026-03-15 19:32:17,723 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 19:32:17,751 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b1960ba26b422765ba3717 HTTP/1.1" 200 None 2026-03-15 19:32:17,752 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 19:32:17,780 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b466391727ff69d6f23ab9 HTTP/1.1" 200 None 2026-03-15 19:32:17,789 - lava_callback - ERROR - Error processing callback for node 69b466391727ff69d6f23ab9: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:39804 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44948 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35220 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58742 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34162 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34166 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50820 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:50836 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44408 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41924 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54180 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54790 - "GET / HTTP/1.0" 200 OK 2026-03-15 19:33:57,743 - lava_callback - INFO - Received callback for node 69b466911727ff69d6f23ac3 INFO: 172.21.0.1:54794 - "POST /node/69b466911727ff69d6f23ac3 HTTP/1.0" 202 Accepted 2026-03-15 19:33:57,749 - lava_callback - INFO - Starting async job submit for node 69b466911727ff69d6f23ac3 2026-03-15 19:33:57,750 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 19:33:57,765 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b466911727ff69d6f23ac3 HTTP/1.1" 200 None 2026-03-15 19:33:57,766 - lava_callback - DEBUG - Processing node 69b466911727ff69d6f23ac3: baseline-arm64-clabbe 2026-03-15 19:33:57,766 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b466911727ff69d6f23ac3 2026-03-15 19:33:57,767 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 19:33:57,808 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b466911727ff69d6f23ac3 HTTP/1.1" 200 None 2026-03-15 19:33:57,809 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 19:33:57,823 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b1960ba26b422765ba3717 HTTP/1.1" 200 None 2026-03-15 19:33:57,824 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 19:33:57,897 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b466911727ff69d6f23ac3 HTTP/1.1" 200 None 2026-03-15 19:33:57,899 - lava_callback - ERROR - Error processing callback for node 69b466911727ff69d6f23ac3: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:35316 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35328 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47348 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:47354 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33608 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47310 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53674 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44770 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46562 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46570 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49438 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:49444 - "GET / HTTP/1.0" 200 OK 2026-03-15 19:35:17,778 - lava_callback - INFO - Received callback for node 69b466ea1727ff69d6f23adc INFO: 172.21.0.1:49454 - "POST /node/69b466ea1727ff69d6f23adc HTTP/1.0" 202 Accepted 2026-03-15 19:35:17,783 - lava_callback - INFO - Starting async job submit for node 69b466ea1727ff69d6f23adc 2026-03-15 19:35:17,784 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 19:35:17,828 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b466ea1727ff69d6f23adc HTTP/1.1" 200 None 2026-03-15 19:35:17,829 - lava_callback - DEBUG - Processing node 69b466ea1727ff69d6f23adc: baseline-arm64-clabbe 2026-03-15 19:35:17,829 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b466ea1727ff69d6f23adc 2026-03-15 19:35:17,830 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 19:35:17,867 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b466ea1727ff69d6f23adc HTTP/1.1" 200 None 2026-03-15 19:35:17,869 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 19:35:17,884 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b1960ba26b422765ba3717 HTTP/1.1" 200 None 2026-03-15 19:35:17,885 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 19:35:17,907 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b466ea1727ff69d6f23adc HTTP/1.1" 200 None 2026-03-15 19:35:17,917 - lava_callback - ERROR - Error processing callback for node 69b466ea1727ff69d6f23adc: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:33538 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49776 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44518 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42742 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37062 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37068 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52390 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:52402 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42212 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38044 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33114 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35618 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44816 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44830 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55702 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:55710 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42854 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44866 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55974 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42570 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37186 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37190 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34876 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:34882 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53224 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52384 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58928 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35608 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50076 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50084 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52030 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:52046 - "GET / HTTP/1.0" 200 OK 2026-03-15 19:39:25,189 - lava_callback - INFO - Received callback for node 69b467e51727ff69d6f23b1b INFO: 172.21.0.1:35888 - "POST /node/69b467e51727ff69d6f23b1b HTTP/1.0" 202 Accepted 2026-03-15 19:39:25,194 - lava_callback - INFO - Starting async job submit for node 69b467e51727ff69d6f23b1b 2026-03-15 19:39:25,195 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 19:39:25,210 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b467e51727ff69d6f23b1b HTTP/1.1" 200 None 2026-03-15 19:39:25,211 - lava_callback - DEBUG - Processing node 69b467e51727ff69d6f23b1b: baseline-arm64-baylibre 2026-03-15 19:39:25,212 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b467e51727ff69d6f23b1b 2026-03-15 19:39:25,212 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 19:39:25,238 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b467e51727ff69d6f23b1b HTTP/1.1" 200 None 2026-03-15 19:39:25,239 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 19:39:25,252 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aeba41feb96b28aa34a78b HTTP/1.1" 200 None 2026-03-15 19:39:25,254 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 19:39:25,279 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b467e51727ff69d6f23b1b HTTP/1.1" 200 None 2026-03-15 19:39:25,284 - lava_callback - ERROR - Error processing callback for node 69b467e51727ff69d6f23b1b: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:35900 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46260 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42042 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34448 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39376 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39384 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35590 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:35598 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:32796 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42004 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41810 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42750 - "GET / HTTP/1.0" 200 OK 2026-03-15 19:41:05,264 - lava_callback - INFO - Received callback for node 69b4683f1727ff69d6f23b28 INFO: 172.21.0.1:51236 - "POST /node/69b4683f1727ff69d6f23b28 HTTP/1.0" 202 Accepted 2026-03-15 19:41:05,269 - lava_callback - INFO - Starting async job submit for node 69b4683f1727ff69d6f23b28 2026-03-15 19:41:05,270 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 19:41:05,321 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b4683f1727ff69d6f23b28 HTTP/1.1" 200 None 2026-03-15 19:41:05,322 - lava_callback - DEBUG - Processing node 69b4683f1727ff69d6f23b28: baseline-arm64-baylibre 2026-03-15 19:41:05,322 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b4683f1727ff69d6f23b28 2026-03-15 19:41:05,323 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 19:41:05,348 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b4683f1727ff69d6f23b28 HTTP/1.1" 200 None 2026-03-15 19:41:05,349 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 19:41:05,384 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b3594d974c91e64560e4b2 HTTP/1.1" 200 None 2026-03-15 19:41:05,385 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 19:41:05,417 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b4683f1727ff69d6f23b28 HTTP/1.1" 200 None 2026-03-15 19:41:05,419 - lava_callback - ERROR - Error processing callback for node 69b4683f1727ff69d6f23b28: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:51238 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51242 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48120 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:48134 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56140 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44266 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50206 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53044 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42926 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42942 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42104 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:42118 - "GET / HTTP/1.0" 200 OK 2026-03-15 19:42:25,361 - lava_callback - INFO - Received callback for node 69b468901727ff69d6f23b31 INFO: 172.21.0.1:45528 - "POST /node/69b468901727ff69d6f23b31 HTTP/1.0" 202 Accepted 2026-03-15 19:42:25,366 - lava_callback - INFO - Starting async job submit for node 69b468901727ff69d6f23b31 2026-03-15 19:42:25,367 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 19:42:25,382 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b468901727ff69d6f23b31 HTTP/1.1" 200 None 2026-03-15 19:42:25,383 - lava_callback - DEBUG - Processing node 69b468901727ff69d6f23b31: baseline-arm64-baylibre 2026-03-15 19:42:25,383 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b468901727ff69d6f23b31 2026-03-15 19:42:25,384 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 19:42:25,397 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b468901727ff69d6f23b31 HTTP/1.1" 200 None 2026-03-15 19:42:25,399 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 19:42:25,418 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aeba41feb96b28aa34a78b HTTP/1.1" 200 None 2026-03-15 19:42:25,420 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 19:42:25,452 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b468901727ff69d6f23b31 HTTP/1.1" 200 None 2026-03-15 19:42:25,457 - lava_callback - ERROR - Error processing callback for node 69b468901727ff69d6f23b31: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:45534 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60588 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34954 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53708 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59572 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59586 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55838 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:55842 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37812 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53104 - "GET / HTTP/1.0" 200 OK 2026-03-15 19:43:45,812 - lava_callback - INFO - Received callback for node 69b468e61727ff69d6f23b3e INFO: 172.21.0.1:60274 - "POST /node/69b468e61727ff69d6f23b3e HTTP/1.0" 202 Accepted 2026-03-15 19:43:45,818 - lava_callback - INFO - Starting async job submit for node 69b468e61727ff69d6f23b3e 2026-03-15 19:43:45,818 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 19:43:45,833 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b468e61727ff69d6f23b3e HTTP/1.1" 200 None 2026-03-15 19:43:45,834 - lava_callback - DEBUG - Processing node 69b468e61727ff69d6f23b3e: baseline-arm64-baylibre 2026-03-15 19:43:45,834 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b468e61727ff69d6f23b3e 2026-03-15 19:43:45,835 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 19:43:45,848 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b468e61727ff69d6f23b3e HTTP/1.1" 200 None 2026-03-15 19:43:45,850 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 19:43:45,877 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b3594d974c91e64560e4b2 HTTP/1.1" 200 None 2026-03-15 19:43:45,879 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 19:43:45,906 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b468e61727ff69d6f23b3e HTTP/1.1" 200 None 2026-03-15 19:43:45,907 - lava_callback - ERROR - Error processing callback for node 69b468e61727ff69d6f23b3e: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:60288 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42586 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50434 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50436 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49740 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:49746 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40988 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51046 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59204 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56684 - "GET / HTTP/1.0" 200 OK 2026-03-15 19:45:05,523 - lava_callback - INFO - Received callback for node 69b469371727ff69d6f23b4a INFO: 172.21.0.1:49874 - "POST /node/69b469371727ff69d6f23b4a HTTP/1.0" 202 Accepted 2026-03-15 19:45:05,528 - lava_callback - INFO - Starting async job submit for node 69b469371727ff69d6f23b4a 2026-03-15 19:45:05,529 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 19:45:05,564 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b469371727ff69d6f23b4a HTTP/1.1" 200 None 2026-03-15 19:45:05,565 - lava_callback - DEBUG - Processing node 69b469371727ff69d6f23b4a: baseline-arm64-baylibre 2026-03-15 19:45:05,565 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b469371727ff69d6f23b4a 2026-03-15 19:45:05,565 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 19:45:05,584 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b469371727ff69d6f23b4a HTTP/1.1" 200 None 2026-03-15 19:45:05,586 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 19:45:05,603 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aeba41feb96b28aa34a78b HTTP/1.1" 200 None 2026-03-15 19:45:05,605 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 19:45:05,648 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b469371727ff69d6f23b4a HTTP/1.1" 200 None 2026-03-15 19:45:05,650 - lava_callback - ERROR - Error processing callback for node 69b469371727ff69d6f23b4a: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:49886 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49890 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52956 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:52966 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36288 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40402 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38804 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36680 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56156 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56170 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56082 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:56098 - "GET / HTTP/1.0" 200 OK 2026-03-15 19:46:25,534 - lava_callback - INFO - Received callback for node 69b4698b1727ff69d6f23b5b INFO: 172.21.0.1:52952 - "POST /node/69b4698b1727ff69d6f23b5b HTTP/1.0" 202 Accepted 2026-03-15 19:46:25,539 - lava_callback - INFO - Starting async job submit for node 69b4698b1727ff69d6f23b5b 2026-03-15 19:46:25,540 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 19:46:25,556 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b4698b1727ff69d6f23b5b HTTP/1.1" 200 None 2026-03-15 19:46:25,557 - lava_callback - DEBUG - Processing node 69b4698b1727ff69d6f23b5b: baseline-arm64-baylibre 2026-03-15 19:46:25,557 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b4698b1727ff69d6f23b5b 2026-03-15 19:46:25,557 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 19:46:25,575 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b4698b1727ff69d6f23b5b HTTP/1.1" 200 None 2026-03-15 19:46:25,577 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 19:46:25,590 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aeba41feb96b28aa34a78b HTTP/1.1" 200 None 2026-03-15 19:46:25,591 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 19:46:25,612 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b4698b1727ff69d6f23b5b HTTP/1.1" 200 None 2026-03-15 19:46:25,614 - lava_callback - ERROR - Error processing callback for node 69b4698b1727ff69d6f23b5b: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:52966 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56630 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41374 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50026 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41834 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41842 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36072 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:36076 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54682 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:32942 - "GET / HTTP/1.0" 200 OK 2026-03-15 19:47:45,854 - lava_callback - INFO - Received callback for node 69b469da1727ff69d6f23b64 INFO: 172.21.0.1:43046 - "POST /node/69b469da1727ff69d6f23b64 HTTP/1.0" 202 Accepted 2026-03-15 19:47:45,859 - lava_callback - INFO - Starting async job submit for node 69b469da1727ff69d6f23b64 2026-03-15 19:47:45,860 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 19:47:45,874 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b469da1727ff69d6f23b64 HTTP/1.1" 200 None 2026-03-15 19:47:45,875 - lava_callback - DEBUG - Processing node 69b469da1727ff69d6f23b64: baseline-arm64-baylibre 2026-03-15 19:47:45,875 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b469da1727ff69d6f23b64 2026-03-15 19:47:45,876 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 19:47:45,897 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b469da1727ff69d6f23b64 HTTP/1.1" 200 None 2026-03-15 19:47:45,899 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 19:47:45,913 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b3594d974c91e64560e4b2 HTTP/1.1" 200 None 2026-03-15 19:47:45,914 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 19:47:45,935 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b469da1727ff69d6f23b64 HTTP/1.1" 200 None 2026-03-15 19:47:45,937 - lava_callback - ERROR - Error processing callback for node 69b469da1727ff69d6f23b64: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:43054 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37212 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52766 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52768 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58768 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:58774 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33372 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50040 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59766 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54896 - "GET / HTTP/1.0" 200 OK 2026-03-15 19:49:05,728 - lava_callback - INFO - Received callback for node 69b46a251727ff69d6f23b75 INFO: 172.21.0.1:37324 - "POST /node/69b46a251727ff69d6f23b75 HTTP/1.0" 202 Accepted 2026-03-15 19:49:05,734 - lava_callback - INFO - Starting async job submit for node 69b46a251727ff69d6f23b75 2026-03-15 19:49:05,735 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 19:49:05,757 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b46a251727ff69d6f23b75 HTTP/1.1" 200 None 2026-03-15 19:49:05,757 - lava_callback - DEBUG - Processing node 69b46a251727ff69d6f23b75: baseline-arm64-baylibre 2026-03-15 19:49:05,758 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b46a251727ff69d6f23b75 2026-03-15 19:49:05,758 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 19:49:05,772 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b46a251727ff69d6f23b75 HTTP/1.1" 200 None 2026-03-15 19:49:05,774 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 19:49:05,787 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aeba41feb96b28aa34a78b HTTP/1.1" 200 None 2026-03-15 19:49:05,789 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 19:49:05,817 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b46a251727ff69d6f23b75 HTTP/1.1" 200 None 2026-03-15 19:49:05,818 - lava_callback - ERROR - Error processing callback for node 69b46a251727ff69d6f23b75: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:37338 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37344 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41082 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:41084 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39190 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56376 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44624 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:32982 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56640 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56644 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56322 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:56326 - "GET / HTTP/1.0" 200 OK 2026-03-15 19:50:25,806 - lava_callback - INFO - Received callback for node 69b46a7d1727ff69d6f23b84 INFO: 172.21.0.1:34194 - "POST /node/69b46a7d1727ff69d6f23b84 HTTP/1.0" 202 Accepted 2026-03-15 19:50:25,815 - lava_callback - INFO - Starting async job submit for node 69b46a7d1727ff69d6f23b84 2026-03-15 19:50:25,816 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 19:50:25,851 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b46a7d1727ff69d6f23b84 HTTP/1.1" 200 None 2026-03-15 19:50:25,853 - lava_callback - DEBUG - Processing node 69b46a7d1727ff69d6f23b84: baseline-arm64-baylibre 2026-03-15 19:50:25,853 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b46a7d1727ff69d6f23b84 2026-03-15 19:50:25,854 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 19:50:25,891 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b46a7d1727ff69d6f23b84 HTTP/1.1" 200 None 2026-03-15 19:50:25,893 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 19:50:25,919 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aeba41feb96b28aa34a78b HTTP/1.1" 200 None 2026-03-15 19:50:25,921 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 19:50:25,947 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b46a7d1727ff69d6f23b84 HTTP/1.1" 200 None 2026-03-15 19:50:25,953 - lava_callback - ERROR - Error processing callback for node 69b46a7d1727ff69d6f23b84: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:34198 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35916 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56160 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40894 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37326 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37330 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58790 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:58802 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45626 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50110 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47524 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36620 - "GET / HTTP/1.0" 200 OK 2026-03-15 19:52:06,052 - lava_callback - INFO - Received callback for node 69b46ad11727ff69d6f23b94 INFO: 172.21.0.1:47954 - "POST /node/69b46ad11727ff69d6f23b94 HTTP/1.0" 202 Accepted 2026-03-15 19:52:06,058 - lava_callback - INFO - Starting async job submit for node 69b46ad11727ff69d6f23b94 2026-03-15 19:52:06,059 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 19:52:06,074 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b46ad11727ff69d6f23b94 HTTP/1.1" 200 None 2026-03-15 19:52:06,075 - lava_callback - DEBUG - Processing node 69b46ad11727ff69d6f23b94: baseline-arm64-baylibre 2026-03-15 19:52:06,076 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b46ad11727ff69d6f23b94 2026-03-15 19:52:06,076 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 19:52:06,094 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b46ad11727ff69d6f23b94 HTTP/1.1" 200 None 2026-03-15 19:52:06,095 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 19:52:06,108 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aeba41feb96b28aa34a78b HTTP/1.1" 200 None 2026-03-15 19:52:06,110 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 19:52:06,134 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b46ad11727ff69d6f23b94 HTTP/1.1" 200 None 2026-03-15 19:52:06,136 - lava_callback - ERROR - Error processing callback for node 69b46ad11727ff69d6f23b94: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:47958 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47972 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36042 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:36056 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58806 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39364 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52180 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40714 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48466 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48480 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33054 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:33064 - "GET / HTTP/1.0" 200 OK 2026-03-15 19:53:18,434 - lava_callback - INFO - Received callback for node 69b46b2b1727ff69d6f23ba8 INFO: 172.21.0.1:33070 - "POST /node/69b46b2b1727ff69d6f23ba8 HTTP/1.0" 202 Accepted 2026-03-15 19:53:18,439 - lava_callback - INFO - Starting async job submit for node 69b46b2b1727ff69d6f23ba8 2026-03-15 19:53:18,440 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 19:53:18,455 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b46b2b1727ff69d6f23ba8 HTTP/1.1" 200 None 2026-03-15 19:53:18,455 - lava_callback - DEBUG - Processing node 69b46b2b1727ff69d6f23ba8: baseline-arm64-clabbe 2026-03-15 19:53:18,456 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b46b2b1727ff69d6f23ba8 2026-03-15 19:53:18,456 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 19:53:18,469 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b46b2b1727ff69d6f23ba8 HTTP/1.1" 200 None 2026-03-15 19:53:18,470 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 19:53:18,495 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b3594d974c91e64560e4b2 HTTP/1.1" 200 None 2026-03-15 19:53:18,496 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 19:53:18,517 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b46b2b1727ff69d6f23ba8 HTTP/1.1" 200 None 2026-03-15 19:53:18,521 - lava_callback - ERROR - Error processing callback for node 69b46b2b1727ff69d6f23ba8: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:58752 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60844 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34130 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51278 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58876 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58880 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44164 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:44178 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47436 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39206 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33092 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60226 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44616 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44622 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54260 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:54264 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33852 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57010 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47954 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55238 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59222 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59224 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38246 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:38254 - "GET / HTTP/1.0" 200 OK 2026-03-15 19:56:18,595 - lava_callback - INFO - Received callback for node 69b46bd21727ff69d6f23bbe INFO: 172.21.0.1:38266 - "POST /node/69b46bd21727ff69d6f23bbe HTTP/1.0" 202 Accepted 2026-03-15 19:56:18,601 - lava_callback - INFO - Starting async job submit for node 69b46bd21727ff69d6f23bbe 2026-03-15 19:56:18,602 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 19:56:18,616 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b46bd21727ff69d6f23bbe HTTP/1.1" 200 None 2026-03-15 19:56:18,617 - lava_callback - DEBUG - Processing node 69b46bd21727ff69d6f23bbe: baseline-arm64-clabbe 2026-03-15 19:56:18,618 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b46bd21727ff69d6f23bbe 2026-03-15 19:56:18,618 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 19:56:18,656 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b46bd21727ff69d6f23bbe HTTP/1.1" 200 None 2026-03-15 19:56:18,657 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 19:56:18,671 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aeba41feb96b28aa34a78b HTTP/1.1" 200 None 2026-03-15 19:56:18,673 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 19:56:18,698 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b46bd21727ff69d6f23bbe HTTP/1.1" 200 None 2026-03-15 19:56:18,700 - lava_callback - ERROR - Error processing callback for node 69b46bd21727ff69d6f23bbe: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:52848 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35462 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48366 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54132 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41644 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41652 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34366 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:34380 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49234 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41748 - "GET / HTTP/1.0" 200 OK 2026-03-15 19:57:38,630 - lava_callback - INFO - Received callback for node 69b46c271727ff69d6f23bcc INFO: 172.21.0.1:41758 - "POST /node/69b46c271727ff69d6f23bcc HTTP/1.0" 202 Accepted 2026-03-15 19:57:38,635 - lava_callback - INFO - Starting async job submit for node 69b46c271727ff69d6f23bcc 2026-03-15 19:57:38,636 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 19:57:38,663 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b46c271727ff69d6f23bcc HTTP/1.1" 200 None 2026-03-15 19:57:38,664 - lava_callback - DEBUG - Processing node 69b46c271727ff69d6f23bcc: baseline-arm64-clabbe 2026-03-15 19:57:38,664 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b46c271727ff69d6f23bcc 2026-03-15 19:57:38,665 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 19:57:38,700 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b46c271727ff69d6f23bcc HTTP/1.1" 200 None 2026-03-15 19:57:38,701 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 19:57:38,756 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b3594d974c91e64560e4b2 HTTP/1.1" 200 None 2026-03-15 19:57:38,758 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 19:57:38,781 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b46c271727ff69d6f23bcc HTTP/1.1" 200 None 2026-03-15 19:57:38,787 - lava_callback - ERROR - Error processing callback for node 69b46c271727ff69d6f23bcc: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:44286 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40536 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52058 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52072 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44888 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:44892 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42808 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42014 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48612 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58652 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53472 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53486 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59140 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:59150 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41066 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37870 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44960 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34670 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52922 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52928 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36318 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:36322 - "GET / HTTP/1.0" 200 OK 2026-03-15 20:00:18,879 - lava_callback - INFO - Received callback for node 69b46cc91727ff69d6f23bf1 INFO: 172.21.0.1:36326 - "POST /node/69b46cc91727ff69d6f23bf1 HTTP/1.0" 202 Accepted 2026-03-15 20:00:18,884 - lava_callback - INFO - Starting async job submit for node 69b46cc91727ff69d6f23bf1 2026-03-15 20:00:18,885 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 20:00:18,920 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b46cc91727ff69d6f23bf1 HTTP/1.1" 200 None 2026-03-15 20:00:18,921 - lava_callback - DEBUG - Processing node 69b46cc91727ff69d6f23bf1: baseline-arm64-clabbe 2026-03-15 20:00:18,922 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b46cc91727ff69d6f23bf1 2026-03-15 20:00:18,922 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 20:00:18,936 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b46cc91727ff69d6f23bf1 HTTP/1.1" 200 None 2026-03-15 20:00:18,937 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 20:00:18,958 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aeba41feb96b28aa34a78b HTTP/1.1" 200 None 2026-03-15 20:00:18,960 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 20:00:18,989 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b46cc91727ff69d6f23bf1 HTTP/1.1" 200 None 2026-03-15 20:00:18,991 - lava_callback - ERROR - Error processing callback for node 69b46cc91727ff69d6f23bf1: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:39628 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46642 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49468 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54276 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57846 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57858 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43346 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:43348 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33800 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48468 - "GET / HTTP/1.0" 200 OK 2026-03-15 20:01:38,824 - lava_callback - INFO - Received callback for node 69b46d1c1727ff69d6f23c02 INFO: 172.21.0.1:48474 - "POST /node/69b46d1c1727ff69d6f23c02 HTTP/1.0" 202 Accepted 2026-03-15 20:01:38,829 - lava_callback - INFO - Starting async job submit for node 69b46d1c1727ff69d6f23c02 2026-03-15 20:01:38,830 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 20:01:38,854 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b46d1c1727ff69d6f23c02 HTTP/1.1" 200 None 2026-03-15 20:01:38,855 - lava_callback - DEBUG - Processing node 69b46d1c1727ff69d6f23c02: baseline-arm64-clabbe 2026-03-15 20:01:38,855 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b46d1c1727ff69d6f23c02 2026-03-15 20:01:38,856 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 20:01:38,869 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b46d1c1727ff69d6f23c02 HTTP/1.1" 200 None 2026-03-15 20:01:38,870 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 20:01:38,884 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aeba41feb96b28aa34a78b HTTP/1.1" 200 None 2026-03-15 20:01:38,885 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 20:01:38,929 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b46d1c1727ff69d6f23c02 HTTP/1.1" 200 None 2026-03-15 20:01:38,934 - lava_callback - ERROR - Error processing callback for node 69b46d1c1727ff69d6f23c02: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:35040 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36312 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34472 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34482 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39870 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:39884 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34038 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53016 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41130 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50700 - "GET / HTTP/1.0" 200 OK 2026-03-15 20:03:06,486 - lava_callback - INFO - Received callback for node 69b46d681727ff69d6f23c0f INFO: 172.21.0.1:54024 - "POST /node/69b46d681727ff69d6f23c0f HTTP/1.0" 202 Accepted 2026-03-15 20:03:06,492 - lava_callback - INFO - Starting async job submit for node 69b46d681727ff69d6f23c0f 2026-03-15 20:03:06,493 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 INFO: 172.21.0.1:54028 - "GET / HTTP/1.0" 200 OK 2026-03-15 20:03:06,519 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b46d681727ff69d6f23c0f HTTP/1.1" 200 None 2026-03-15 20:03:06,521 - lava_callback - DEBUG - Processing node 69b46d681727ff69d6f23c0f: baseline-arm64-baylibre 2026-03-15 20:03:06,521 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b46d681727ff69d6f23c0f 2026-03-15 20:03:06,522 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 20:03:06,537 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b46d681727ff69d6f23c0f HTTP/1.1" 200 None 2026-03-15 20:03:06,538 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 20:03:06,577 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aeba41feb96b28aa34a78b HTTP/1.1" 200 None 2026-03-15 20:03:06,578 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 20:03:06,608 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b46d681727ff69d6f23c0f HTTP/1.1" 200 None 2026-03-15 20:03:06,614 - lava_callback - ERROR - Error processing callback for node 69b46d681727ff69d6f23c0f: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:54036 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56948 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:56960 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36344 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48900 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44520 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55372 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49976 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49992 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46494 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:46510 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56816 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33998 - "GET / HTTP/1.0" 200 OK 2026-03-15 20:04:38,916 - lava_callback - INFO - Received callback for node 69b46dc21727ff69d6f23c1f INFO: 172.21.0.1:34002 - "POST /node/69b46dc21727ff69d6f23c1f HTTP/1.0" 202 Accepted 2026-03-15 20:04:38,922 - lava_callback - INFO - Starting async job submit for node 69b46dc21727ff69d6f23c1f 2026-03-15 20:04:38,922 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 20:04:38,946 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b46dc21727ff69d6f23c1f HTTP/1.1" 200 None 2026-03-15 20:04:38,947 - lava_callback - DEBUG - Processing node 69b46dc21727ff69d6f23c1f: baseline-arm64-clabbe 2026-03-15 20:04:38,947 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b46dc21727ff69d6f23c1f 2026-03-15 20:04:38,948 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 20:04:38,961 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b46dc21727ff69d6f23c1f HTTP/1.1" 200 None 2026-03-15 20:04:38,963 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 20:04:38,977 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b3594d974c91e64560e4b2 HTTP/1.1" 200 None 2026-03-15 20:04:38,978 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 20:04:39,018 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b46dc21727ff69d6f23c1f HTTP/1.1" 200 None 2026-03-15 20:04:39,024 - lava_callback - ERROR - Error processing callback for node 69b46dc21727ff69d6f23c1f: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:43056 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37594 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49082 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49098 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35746 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:35748 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57690 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50286 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59654 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43164 - "GET / HTTP/1.0" 200 OK 2026-03-15 20:05:58,978 - lava_callback - INFO - Received callback for node 69b46e171727ff69d6f23c30 INFO: 172.21.0.1:43172 - "POST /node/69b46e171727ff69d6f23c30 HTTP/1.0" 202 Accepted 2026-03-15 20:05:58,983 - lava_callback - INFO - Starting async job submit for node 69b46e171727ff69d6f23c30 2026-03-15 20:05:58,984 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 20:05:58,999 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b46e171727ff69d6f23c30 HTTP/1.1" 200 None 2026-03-15 20:05:59,000 - lava_callback - DEBUG - Processing node 69b46e171727ff69d6f23c30: baseline-arm64-clabbe 2026-03-15 20:05:59,001 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b46e171727ff69d6f23c30 2026-03-15 20:05:59,001 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 20:05:59,040 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b46e171727ff69d6f23c30 HTTP/1.1" 200 None 2026-03-15 20:05:59,042 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 20:05:59,096 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aeba41feb96b28aa34a78b HTTP/1.1" 200 None 2026-03-15 20:05:59,097 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 20:05:59,124 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b46e171727ff69d6f23c30 HTTP/1.1" 200 None 2026-03-15 20:05:59,126 - lava_callback - ERROR - Error processing callback for node 69b46e171727ff69d6f23c30: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:55728 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55744 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51226 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:51240 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43586 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60162 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56398 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36204 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57402 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57414 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60122 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:60126 - "GET / HTTP/1.0" 200 OK 2026-03-15 20:07:19,019 - lava_callback - INFO - Received callback for node 69b46e6d1727ff69d6f23c37 INFO: 172.21.0.1:60128 - "POST /node/69b46e6d1727ff69d6f23c37 HTTP/1.0" 202 Accepted 2026-03-15 20:07:19,025 - lava_callback - INFO - Starting async job submit for node 69b46e6d1727ff69d6f23c37 2026-03-15 20:07:19,026 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 20:07:19,044 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b46e6d1727ff69d6f23c37 HTTP/1.1" 200 None 2026-03-15 20:07:19,044 - lava_callback - DEBUG - Processing node 69b46e6d1727ff69d6f23c37: baseline-arm64-clabbe 2026-03-15 20:07:19,045 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b46e6d1727ff69d6f23c37 2026-03-15 20:07:19,045 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 20:07:19,069 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b46e6d1727ff69d6f23c37 HTTP/1.1" 200 None 2026-03-15 20:07:19,071 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 20:07:19,090 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aeba41feb96b28aa34a78b HTTP/1.1" 200 None 2026-03-15 20:07:19,092 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 20:07:19,113 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b46e6d1727ff69d6f23c37 HTTP/1.1" 200 None 2026-03-15 20:07:19,114 - lava_callback - ERROR - Error processing callback for node 69b46e6d1727ff69d6f23c37: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:39488 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35044 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33476 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40982 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42304 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42316 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38110 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:38118 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42578 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43500 - "GET / HTTP/1.0" 200 OK 2026-03-15 20:08:39,050 - lava_callback - INFO - Received callback for node 69b46ec11727ff69d6f23c46 INFO: 172.21.0.1:43504 - "POST /node/69b46ec11727ff69d6f23c46 HTTP/1.0" 202 Accepted 2026-03-15 20:08:39,055 - lava_callback - INFO - Starting async job submit for node 69b46ec11727ff69d6f23c46 2026-03-15 20:08:39,056 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 20:08:39,070 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b46ec11727ff69d6f23c46 HTTP/1.1" 200 None 2026-03-15 20:08:39,071 - lava_callback - DEBUG - Processing node 69b46ec11727ff69d6f23c46: baseline-arm64-clabbe 2026-03-15 20:08:39,071 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b46ec11727ff69d6f23c46 2026-03-15 20:08:39,072 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 20:08:39,085 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b46ec11727ff69d6f23c46 HTTP/1.1" 200 None 2026-03-15 20:08:39,086 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 20:08:39,100 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b3594d974c91e64560e4b2 HTTP/1.1" 200 None 2026-03-15 20:08:39,102 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 20:08:39,133 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b46ec11727ff69d6f23c46 HTTP/1.1" 200 None 2026-03-15 20:08:39,135 - lava_callback - ERROR - Error processing callback for node 69b46ec11727ff69d6f23c46: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:34608 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59422 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39534 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39544 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59334 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:59342 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45510 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45642 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34952 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39950 - "GET / HTTP/1.0" 200 OK 2026-03-15 20:09:59,104 - lava_callback - INFO - Received callback for node 69b46f141727ff69d6f23c54 INFO: 172.21.0.1:39954 - "POST /node/69b46f141727ff69d6f23c54 HTTP/1.0" 202 Accepted 2026-03-15 20:09:59,109 - lava_callback - INFO - Starting async job submit for node 69b46f141727ff69d6f23c54 2026-03-15 20:09:59,110 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 20:09:59,155 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b46f141727ff69d6f23c54 HTTP/1.1" 200 None 2026-03-15 20:09:59,157 - lava_callback - DEBUG - Processing node 69b46f141727ff69d6f23c54: baseline-arm64-clabbe 2026-03-15 20:09:59,157 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b46f141727ff69d6f23c54 2026-03-15 20:09:59,157 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 20:09:59,172 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b46f141727ff69d6f23c54 HTTP/1.1" 200 None 2026-03-15 20:09:59,173 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 20:09:59,187 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b3594d974c91e64560e4b2 HTTP/1.1" 200 None 2026-03-15 20:09:59,188 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 20:09:59,211 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b46f141727ff69d6f23c54 HTTP/1.1" 200 None 2026-03-15 20:09:59,212 - lava_callback - ERROR - Error processing callback for node 69b46f141727ff69d6f23c54: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:42230 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42246 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56938 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:56952 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45506 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45268 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58652 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59638 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57816 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57830 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45080 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:45082 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42066 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34714 - "GET / HTTP/1.0" 200 OK 2026-03-15 20:11:39,308 - lava_callback - INFO - Received callback for node 69b46f681727ff69d6f23c61 INFO: 172.21.0.1:34724 - "POST /node/69b46f681727ff69d6f23c61 HTTP/1.0" 202 Accepted 2026-03-15 20:11:39,314 - lava_callback - INFO - Starting async job submit for node 69b46f681727ff69d6f23c61 2026-03-15 20:11:39,315 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 20:11:39,350 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b46f681727ff69d6f23c61 HTTP/1.1" 200 None 2026-03-15 20:11:39,351 - lava_callback - DEBUG - Processing node 69b46f681727ff69d6f23c61: baseline-arm64-clabbe 2026-03-15 20:11:39,351 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b46f681727ff69d6f23c61 2026-03-15 20:11:39,352 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 20:11:39,365 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b46f681727ff69d6f23c61 HTTP/1.1" 200 None 2026-03-15 20:11:39,366 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 20:11:39,380 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aeba41feb96b28aa34a78b HTTP/1.1" 200 None 2026-03-15 20:11:39,382 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 20:11:39,431 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b46f681727ff69d6f23c61 HTTP/1.1" 200 None 2026-03-15 20:11:39,439 - lava_callback - ERROR - Error processing callback for node 69b46f681727ff69d6f23c61: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:43742 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53396 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40450 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40456 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47366 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:47378 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44042 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38440 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55820 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46658 - "GET / HTTP/1.0" 200 OK 2026-03-15 20:12:59,203 - lava_callback - INFO - Received callback for node 69b46fbd1727ff69d6f23c72 INFO: 172.21.0.1:46672 - "POST /node/69b46fbd1727ff69d6f23c72 HTTP/1.0" 202 Accepted 2026-03-15 20:12:59,209 - lava_callback - INFO - Starting async job submit for node 69b46fbd1727ff69d6f23c72 2026-03-15 20:12:59,210 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 20:12:59,233 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b46fbd1727ff69d6f23c72 HTTP/1.1" 200 None 2026-03-15 20:12:59,234 - lava_callback - DEBUG - Processing node 69b46fbd1727ff69d6f23c72: baseline-arm64-clabbe 2026-03-15 20:12:59,234 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b46fbd1727ff69d6f23c72 2026-03-15 20:12:59,235 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 20:12:59,251 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b46fbd1727ff69d6f23c72 HTTP/1.1" 200 None 2026-03-15 20:12:59,252 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 20:12:59,266 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aeba41feb96b28aa34a78b HTTP/1.1" 200 None 2026-03-15 20:12:59,267 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 20:12:59,287 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b46fbd1727ff69d6f23c72 HTTP/1.1" 200 None 2026-03-15 20:12:59,295 - lava_callback - ERROR - Error processing callback for node 69b46fbd1727ff69d6f23c72: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:54022 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54028 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39682 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:39696 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58180 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50456 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50808 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55276 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46940 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46950 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59812 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:59826 - "GET / HTTP/1.0" 200 OK 2026-03-15 20:14:19,354 - lava_callback - INFO - Received callback for node 69b4700f1727ff69d6f23c7a INFO: 172.21.0.1:59832 - "POST /node/69b4700f1727ff69d6f23c7a HTTP/1.0" 202 Accepted 2026-03-15 20:14:19,359 - lava_callback - INFO - Starting async job submit for node 69b4700f1727ff69d6f23c7a 2026-03-15 20:14:19,360 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 20:14:19,397 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b4700f1727ff69d6f23c7a HTTP/1.1" 200 None 2026-03-15 20:14:19,398 - lava_callback - DEBUG - Processing node 69b4700f1727ff69d6f23c7a: baseline-arm64-clabbe 2026-03-15 20:14:19,398 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b4700f1727ff69d6f23c7a 2026-03-15 20:14:19,399 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 20:14:19,413 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b4700f1727ff69d6f23c7a HTTP/1.1" 200 None 2026-03-15 20:14:19,414 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 20:14:19,433 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aeba41feb96b28aa34a78b HTTP/1.1" 200 None 2026-03-15 20:14:19,434 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 20:14:19,456 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b4700f1727ff69d6f23c7a HTTP/1.1" 200 None 2026-03-15 20:14:19,457 - lava_callback - ERROR - Error processing callback for node 69b4700f1727ff69d6f23c7a: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:50606 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56018 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51814 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53978 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52286 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52290 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37538 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:37540 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60378 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57182 - "GET / HTTP/1.0" 200 OK 2026-03-15 20:15:39,408 - lava_callback - INFO - Received callback for node 69b470611727ff69d6f23c87 INFO: 172.21.0.1:57198 - "POST /node/69b470611727ff69d6f23c87 HTTP/1.0" 202 Accepted 2026-03-15 20:15:39,414 - lava_callback - INFO - Starting async job submit for node 69b470611727ff69d6f23c87 2026-03-15 20:15:39,415 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 20:15:39,453 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b470611727ff69d6f23c87 HTTP/1.1" 200 None 2026-03-15 20:15:39,454 - lava_callback - DEBUG - Processing node 69b470611727ff69d6f23c87: baseline-arm64-clabbe 2026-03-15 20:15:39,454 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b470611727ff69d6f23c87 2026-03-15 20:15:39,455 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 20:15:39,490 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b470611727ff69d6f23c87 HTTP/1.1" 200 None 2026-03-15 20:15:39,492 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 20:15:39,515 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aeba41feb96b28aa34a78b HTTP/1.1" 200 None 2026-03-15 20:15:39,516 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 20:15:39,538 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b470611727ff69d6f23c87 HTTP/1.1" 200 None 2026-03-15 20:15:39,544 - lava_callback - ERROR - Error processing callback for node 69b470611727ff69d6f23c87: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:35730 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41228 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45878 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45882 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52072 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:52074 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37970 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48000 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57096 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47824 - "GET / HTTP/1.0" 200 OK 2026-03-15 20:16:59,487 - lava_callback - INFO - Received callback for node 69b470b61727ff69d6f23cac INFO: 172.21.0.1:47828 - "POST /node/69b470b61727ff69d6f23cac HTTP/1.0" 202 Accepted 2026-03-15 20:16:59,492 - lava_callback - INFO - Starting async job submit for node 69b470b61727ff69d6f23cac 2026-03-15 20:16:59,493 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 20:16:59,508 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b470b61727ff69d6f23cac HTTP/1.1" 200 None 2026-03-15 20:16:59,509 - lava_callback - DEBUG - Processing node 69b470b61727ff69d6f23cac: baseline-arm64-clabbe 2026-03-15 20:16:59,509 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b470b61727ff69d6f23cac 2026-03-15 20:16:59,510 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 20:16:59,523 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b470b61727ff69d6f23cac HTTP/1.1" 200 None 2026-03-15 20:16:59,525 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 20:16:59,538 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b3594d974c91e64560e4b2 HTTP/1.1" 200 None 2026-03-15 20:16:59,539 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 20:16:59,562 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b470b61727ff69d6f23cac HTTP/1.1" 200 None 2026-03-15 20:16:59,563 - lava_callback - ERROR - Error processing callback for node 69b470b61727ff69d6f23cac: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:45156 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45158 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57428 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:57442 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40110 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52652 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33180 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33342 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45716 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45724 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33952 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:33956 - "GET / HTTP/1.0" 200 OK 2026-03-15 20:18:19,559 - lava_callback - INFO - Received callback for node 69b471081727ff69d6f23cd6 INFO: 172.21.0.1:33968 - "POST /node/69b471081727ff69d6f23cd6 HTTP/1.0" 202 Accepted 2026-03-15 20:18:19,564 - lava_callback - INFO - Starting async job submit for node 69b471081727ff69d6f23cd6 2026-03-15 20:18:19,565 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 20:18:19,608 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b471081727ff69d6f23cd6 HTTP/1.1" 200 None 2026-03-15 20:18:19,609 - lava_callback - DEBUG - Processing node 69b471081727ff69d6f23cd6: baseline-arm64-clabbe 2026-03-15 20:18:19,609 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b471081727ff69d6f23cd6 2026-03-15 20:18:19,609 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 20:18:19,623 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b471081727ff69d6f23cd6 HTTP/1.1" 200 None 2026-03-15 20:18:19,624 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 20:18:19,647 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aeba41feb96b28aa34a78b HTTP/1.1" 200 None 2026-03-15 20:18:19,649 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 20:18:19,676 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b471081727ff69d6f23cd6 HTTP/1.1" 200 None 2026-03-15 20:18:19,686 - lava_callback - ERROR - Error processing callback for node 69b471081727ff69d6f23cd6: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:42386 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35170 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50442 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54072 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41402 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41414 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38110 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:38126 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54270 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48450 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37780 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:32860 - "GET / HTTP/1.0" 200 OK 2026-03-15 20:19:59,604 - lava_callback - INFO - Received callback for node 69b471601727ff69d6f23ce7 INFO: 172.21.0.1:32870 - "POST /node/69b471601727ff69d6f23ce7 HTTP/1.0" 202 Accepted 2026-03-15 20:19:59,609 - lava_callback - INFO - Starting async job submit for node 69b471601727ff69d6f23ce7 2026-03-15 20:19:59,610 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 20:19:59,625 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b471601727ff69d6f23ce7 HTTP/1.1" 200 None 2026-03-15 20:19:59,625 - lava_callback - DEBUG - Processing node 69b471601727ff69d6f23ce7: baseline-arm64-clabbe 2026-03-15 20:19:59,626 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b471601727ff69d6f23ce7 2026-03-15 20:19:59,626 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 20:19:59,657 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b471601727ff69d6f23ce7 HTTP/1.1" 200 None 2026-03-15 20:19:59,659 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 20:19:59,684 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aeba41feb96b28aa34a78b HTTP/1.1" 200 None 2026-03-15 20:19:59,685 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 20:19:59,717 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b471601727ff69d6f23ce7 HTTP/1.1" 200 None 2026-03-15 20:19:59,739 - lava_callback - ERROR - Error processing callback for node 69b471601727ff69d6f23ce7: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:36204 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36212 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56366 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:56378 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59812 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44454 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36078 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54158 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39410 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39422 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54636 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:54640 - "GET / HTTP/1.0" 200 OK 2026-03-15 20:21:19,701 - lava_callback - INFO - Received callback for node 69b471b41727ff69d6f23cf0 INFO: 172.21.0.1:49576 - "POST /node/69b471b41727ff69d6f23cf0 HTTP/1.0" 202 Accepted 2026-03-15 20:21:19,707 - lava_callback - INFO - Starting async job submit for node 69b471b41727ff69d6f23cf0 2026-03-15 20:21:19,708 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 20:21:19,728 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b471b41727ff69d6f23cf0 HTTP/1.1" 200 None 2026-03-15 20:21:19,729 - lava_callback - DEBUG - Processing node 69b471b41727ff69d6f23cf0: baseline-arm64-clabbe 2026-03-15 20:21:19,729 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b471b41727ff69d6f23cf0 2026-03-15 20:21:19,729 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 20:21:19,751 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b471b41727ff69d6f23cf0 HTTP/1.1" 200 None 2026-03-15 20:21:19,753 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 20:21:19,766 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aeba41feb96b28aa34a78b HTTP/1.1" 200 None 2026-03-15 20:21:19,767 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 20:21:19,787 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b471b41727ff69d6f23cf0 HTTP/1.1" 200 None 2026-03-15 20:21:19,789 - lava_callback - ERROR - Error processing callback for node 69b471b41727ff69d6f23cf0: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:49584 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40760 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37792 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37490 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52968 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52982 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54590 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:54594 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36646 - "GET / HTTP/1.0" 200 OK 2026-03-15 20:22:27,546 - lava_callback - INFO - Received callback for node 69b471f21727ff69d6f23d01 INFO: 172.21.0.1:36658 - "POST /node/69b471f21727ff69d6f23d01 HTTP/1.0" 202 Accepted 2026-03-15 20:22:27,552 - lava_callback - INFO - Starting async job submit for node 69b471f21727ff69d6f23d01 2026-03-15 20:22:27,553 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 20:22:27,568 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b471f21727ff69d6f23d01 HTTP/1.1" 200 None 2026-03-15 20:22:27,569 - lava_callback - DEBUG - Processing node 69b471f21727ff69d6f23d01: baseline-arm-baylibre 2026-03-15 20:22:27,569 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b471f21727ff69d6f23d01 2026-03-15 20:22:27,570 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 20:22:27,583 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b471f21727ff69d6f23d01 HTTP/1.1" 200 None 2026-03-15 20:22:27,585 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 20:22:27,607 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aeba33feb96b28aa34a775 HTTP/1.1" 200 None 2026-03-15 20:22:27,608 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 20:22:27,645 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b471f21727ff69d6f23d01 HTTP/1.1" 200 None 2026-03-15 20:22:27,646 - lava_callback - ERROR - Error processing callback for node 69b471f21727ff69d6f23d01: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:43188 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44312 - "GET / HTTP/1.0" 200 OK 2026-03-15 20:22:47,510 - lava_callback - INFO - Received callback for node 69b472151727ff69d6f23d11 INFO: 172.21.0.1:44316 - "POST /node/69b472151727ff69d6f23d11 HTTP/1.0" 202 Accepted 2026-03-15 20:22:47,516 - lava_callback - INFO - Starting async job submit for node 69b472151727ff69d6f23d11 2026-03-15 20:22:47,517 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 20:22:47,531 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b472151727ff69d6f23d11 HTTP/1.1" 200 None 2026-03-15 20:22:47,532 - lava_callback - DEBUG - Processing node 69b472151727ff69d6f23d11: baseline-arm-baylibre 2026-03-15 20:22:47,532 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b472151727ff69d6f23d11 2026-03-15 20:22:47,533 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 20:22:47,551 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b472151727ff69d6f23d11 HTTP/1.1" 200 None 2026-03-15 20:22:47,553 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 20:22:47,566 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aeba33feb96b28aa34a775 HTTP/1.1" 200 None 2026-03-15 20:22:47,568 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 20:22:47,588 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b472151727ff69d6f23d11 HTTP/1.1" 200 None 2026-03-15 20:22:47,594 - lava_callback - ERROR - Error processing callback for node 69b472151727ff69d6f23d11: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:49662 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60418 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60426 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50514 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:50520 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59296 - "GET / HTTP/1.0" 200 OK 2026-03-15 20:23:27,561 - lava_callback - INFO - Received callback for node 69b472391727ff69d6f23d1c INFO: 172.21.0.1:59306 - "POST /node/69b472391727ff69d6f23d1c HTTP/1.0" 202 Accepted 2026-03-15 20:23:27,567 - lava_callback - INFO - Starting async job submit for node 69b472391727ff69d6f23d1c 2026-03-15 20:23:27,568 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 20:23:27,600 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b472391727ff69d6f23d1c HTTP/1.1" 200 None 2026-03-15 20:23:27,601 - lava_callback - DEBUG - Processing node 69b472391727ff69d6f23d1c: baseline-arm-baylibre 2026-03-15 20:23:27,601 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b472391727ff69d6f23d1c 2026-03-15 20:23:27,602 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 20:23:27,615 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b472391727ff69d6f23d1c HTTP/1.1" 200 None 2026-03-15 20:23:27,617 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 20:23:27,638 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aeba33feb96b28aa34a775 HTTP/1.1" 200 None 2026-03-15 20:23:27,640 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 20:23:27,661 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b472391727ff69d6f23d1c HTTP/1.1" 200 None 2026-03-15 20:23:27,667 - lava_callback - ERROR - Error processing callback for node 69b472391727ff69d6f23d1c: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:60706 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35592 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46810 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48476 - "GET / HTTP/1.0" 200 OK 2026-03-15 20:24:07,643 - lava_callback - INFO - Received callback for node 69b4725d1727ff69d6f23d27 INFO: 172.21.0.1:48482 - "POST /node/69b4725d1727ff69d6f23d27 HTTP/1.0" 202 Accepted 2026-03-15 20:24:07,649 - lava_callback - INFO - Starting async job submit for node 69b4725d1727ff69d6f23d27 2026-03-15 20:24:07,650 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 20:24:07,676 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b4725d1727ff69d6f23d27 HTTP/1.1" 200 None 2026-03-15 20:24:07,677 - lava_callback - DEBUG - Processing node 69b4725d1727ff69d6f23d27: baseline-arm-baylibre 2026-03-15 20:24:07,677 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b4725d1727ff69d6f23d27 2026-03-15 20:24:07,678 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 20:24:07,692 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b4725d1727ff69d6f23d27 HTTP/1.1" 200 None 2026-03-15 20:24:07,693 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 20:24:07,721 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aeba33feb96b28aa34a775 HTTP/1.1" 200 None 2026-03-15 20:24:07,722 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 20:24:07,744 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b4725d1727ff69d6f23d27 HTTP/1.1" 200 None 2026-03-15 20:24:07,745 - lava_callback - ERROR - Error processing callback for node 69b4725d1727ff69d6f23d27: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:48496 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40072 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:40082 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43966 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57558 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37868 - "GET / HTTP/1.0" 200 OK 2026-03-15 20:24:47,615 - lava_callback - INFO - Received callback for node 69b472811727ff69d6f23d30 INFO: 172.21.0.1:37884 - "POST /node/69b472811727ff69d6f23d30 HTTP/1.0" 202 Accepted 2026-03-15 20:24:47,621 - lava_callback - INFO - Starting async job submit for node 69b472811727ff69d6f23d30 2026-03-15 20:24:47,621 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 20:24:47,673 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b472811727ff69d6f23d30 HTTP/1.1" 200 None 2026-03-15 20:24:47,674 - lava_callback - DEBUG - Processing node 69b472811727ff69d6f23d30: baseline-arm-baylibre 2026-03-15 20:24:47,674 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b472811727ff69d6f23d30 2026-03-15 20:24:47,675 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 20:24:47,689 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b472811727ff69d6f23d30 HTTP/1.1" 200 None 2026-03-15 20:24:47,691 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 20:24:47,705 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aeba33feb96b28aa34a775 HTTP/1.1" 200 None 2026-03-15 20:24:47,706 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 20:24:47,727 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b472811727ff69d6f23d30 HTTP/1.1" 200 None 2026-03-15 20:24:47,732 - lava_callback - ERROR - Error processing callback for node 69b472811727ff69d6f23d30: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:49042 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46128 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46132 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38594 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:38610 - "GET / HTTP/1.0" 200 OK 2026-03-15 20:25:19,847 - lava_callback - INFO - Received callback for node 69b472a61727ff69d6f23d39 INFO: 172.21.0.1:53958 - "POST /node/69b472a61727ff69d6f23d39 HTTP/1.0" 202 Accepted 2026-03-15 20:25:19,852 - lava_callback - INFO - Starting async job submit for node 69b472a61727ff69d6f23d39 2026-03-15 20:25:19,853 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 20:25:19,891 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b472a61727ff69d6f23d39 HTTP/1.1" 200 None 2026-03-15 20:25:19,892 - lava_callback - DEBUG - Processing node 69b472a61727ff69d6f23d39: baseline-arm-clabbe 2026-03-15 20:25:19,892 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b472a61727ff69d6f23d39 2026-03-15 20:25:19,893 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 20:25:19,906 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b472a61727ff69d6f23d39 HTTP/1.1" 200 None 2026-03-15 20:25:19,908 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 20:25:19,921 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aeba33feb96b28aa34a775 HTTP/1.1" 200 None 2026-03-15 20:25:19,922 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 20:25:19,943 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b472a61727ff69d6f23d39 HTTP/1.1" 200 None 2026-03-15 20:25:19,949 - lava_callback - ERROR - Error processing callback for node 69b472a61727ff69d6f23d39: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:53966 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46760 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40478 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59836 - "GET / HTTP/1.0" 200 OK 2026-03-15 20:25:59,872 - lava_callback - INFO - Received callback for node 69b472ca1727ff69d6f23d44 INFO: 172.21.0.1:51700 - "POST /node/69b472ca1727ff69d6f23d44 HTTP/1.0" 202 Accepted 2026-03-15 20:25:59,877 - lava_callback - INFO - Starting async job submit for node 69b472ca1727ff69d6f23d44 2026-03-15 20:25:59,878 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 20:25:59,921 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b472ca1727ff69d6f23d44 HTTP/1.1" 200 None 2026-03-15 20:25:59,922 - lava_callback - DEBUG - Processing node 69b472ca1727ff69d6f23d44: baseline-arm-clabbe 2026-03-15 20:25:59,922 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b472ca1727ff69d6f23d44 2026-03-15 20:25:59,923 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 20:25:59,938 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b472ca1727ff69d6f23d44 HTTP/1.1" 200 None 2026-03-15 20:25:59,939 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 20:25:59,967 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aeba33feb96b28aa34a775 HTTP/1.1" 200 None 2026-03-15 20:25:59,969 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 20:26:00,014 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b472ca1727ff69d6f23d44 HTTP/1.1" 200 None 2026-03-15 20:26:00,016 - lava_callback - ERROR - Error processing callback for node 69b472ca1727ff69d6f23d44: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:51714 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51726 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39000 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:39004 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45676 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43374 - "GET / HTTP/1.0" 200 OK 2026-03-15 20:26:39,921 - lava_callback - INFO - Received callback for node 69b472f01727ff69d6f23d4b INFO: 172.21.0.1:58406 - "POST /node/69b472f01727ff69d6f23d4b HTTP/1.0" 202 Accepted 2026-03-15 20:26:39,926 - lava_callback - INFO - Starting async job submit for node 69b472f01727ff69d6f23d4b 2026-03-15 20:26:39,927 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 20:26:39,941 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b472f01727ff69d6f23d4b HTTP/1.1" 200 None 2026-03-15 20:26:39,942 - lava_callback - DEBUG - Processing node 69b472f01727ff69d6f23d4b: baseline-arm-clabbe 2026-03-15 20:26:39,942 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b472f01727ff69d6f23d4b 2026-03-15 20:26:39,943 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 20:26:39,956 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b472f01727ff69d6f23d4b HTTP/1.1" 200 None 2026-03-15 20:26:39,958 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 20:26:39,972 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aeba33feb96b28aa34a775 HTTP/1.1" 200 None 2026-03-15 20:26:39,973 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 20:26:40,010 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b472f01727ff69d6f23d4b HTTP/1.1" 200 None 2026-03-15 20:26:40,012 - lava_callback - ERROR - Error processing callback for node 69b472f01727ff69d6f23d4b: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:58414 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47142 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47934 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47950 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49448 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:49450 - "GET / HTTP/1.0" 200 OK 2026-03-15 20:27:19,928 - lava_callback - INFO - Received callback for node 69b473141727ff69d6f23d54 INFO: 172.21.0.1:45616 - "POST /node/69b473141727ff69d6f23d54 HTTP/1.0" 202 Accepted 2026-03-15 20:27:19,933 - lava_callback - INFO - Starting async job submit for node 69b473141727ff69d6f23d54 2026-03-15 20:27:19,934 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 20:27:19,949 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b473141727ff69d6f23d54 HTTP/1.1" 200 None 2026-03-15 20:27:19,950 - lava_callback - DEBUG - Processing node 69b473141727ff69d6f23d54: baseline-arm-clabbe 2026-03-15 20:27:19,950 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b473141727ff69d6f23d54 2026-03-15 20:27:19,950 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 20:27:19,983 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b473141727ff69d6f23d54 HTTP/1.1" 200 None 2026-03-15 20:27:19,985 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 20:27:19,998 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aeba33feb96b28aa34a775 HTTP/1.1" 200 None 2026-03-15 20:27:20,000 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 20:27:20,021 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b473141727ff69d6f23d54 HTTP/1.1" 200 None 2026-03-15 20:27:20,022 - lava_callback - ERROR - Error processing callback for node 69b473141727ff69d6f23d54: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:45628 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42836 - "GET / HTTP/1.0" 200 OK 2026-03-15 20:27:39,987 - lava_callback - INFO - Received callback for node 69b473391727ff69d6f23d5d INFO: 172.21.0.1:45142 - "POST /node/69b473391727ff69d6f23d5d HTTP/1.0" 202 Accepted 2026-03-15 20:27:39,992 - lava_callback - INFO - Starting async job submit for node 69b473391727ff69d6f23d5d 2026-03-15 20:27:39,993 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 20:27:40,008 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b473391727ff69d6f23d5d HTTP/1.1" 200 None 2026-03-15 20:27:40,009 - lava_callback - DEBUG - Processing node 69b473391727ff69d6f23d5d: baseline-arm-clabbe 2026-03-15 20:27:40,009 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b473391727ff69d6f23d5d 2026-03-15 20:27:40,010 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 20:27:40,023 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b473391727ff69d6f23d5d HTTP/1.1" 200 None 2026-03-15 20:27:40,024 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 20:27:40,041 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aeba33feb96b28aa34a775 HTTP/1.1" 200 None 2026-03-15 20:27:40,043 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 20:27:40,075 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b473391727ff69d6f23d5d HTTP/1.1" 200 None 2026-03-15 20:27:40,081 - lava_callback - ERROR - Error processing callback for node 69b473391727ff69d6f23d5d: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:45156 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34210 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56472 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56482 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57568 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:57584 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45276 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51890 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33416 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35304 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52468 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52484 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35528 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:35534 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53296 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54316 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55598 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33052 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49968 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46362 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46372 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:46378 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59568 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37986 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59790 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44494 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57770 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56836 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56838 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:56850 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34738 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52320 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34160 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37780 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58132 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37566 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37576 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:37586 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59514 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51352 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54630 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50298 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59632 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57728 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57734 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:57744 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45710 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34230 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57870 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42732 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58084 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35918 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35926 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:35940 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36938 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43366 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39804 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40222 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46838 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43788 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43790 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:43796 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47376 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49568 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33516 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41468 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35594 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43774 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43776 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:43778 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47444 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49846 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56798 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57744 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36514 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55420 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55428 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:55432 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33014 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37090 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44462 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58606 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46578 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52638 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52650 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:52656 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41964 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39834 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52748 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33084 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54468 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59160 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59164 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:59180 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35204 - "GET / HTTP/1.0" 200 OK 2026-03-15 20:39:28,782 - lava_callback - INFO - Received callback for node 69b475ef1727ff69d6f23d8e INFO: 172.21.0.1:35210 - "POST /node/69b475ef1727ff69d6f23d8e HTTP/1.0" 202 Accepted 2026-03-15 20:39:28,788 - lava_callback - INFO - Starting async job submit for node 69b475ef1727ff69d6f23d8e 2026-03-15 20:39:28,789 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 20:39:28,802 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b475ef1727ff69d6f23d8e HTTP/1.1" 200 None 2026-03-15 20:39:28,803 - lava_callback - DEBUG - Processing node 69b475ef1727ff69d6f23d8e: baseline-arm-baylibre 2026-03-15 20:39:28,804 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b475ef1727ff69d6f23d8e 2026-03-15 20:39:28,804 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 20:39:28,817 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b475ef1727ff69d6f23d8e HTTP/1.1" 200 None 2026-03-15 20:39:28,819 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 20:39:28,832 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b3c7f91727ff69d6f21d89 HTTP/1.1" 200 None 2026-03-15 20:39:28,834 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 20:39:28,856 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b475ef1727ff69d6f23d8e HTTP/1.1" 200 None 2026-03-15 20:39:28,862 - lava_callback - ERROR - Error processing callback for node 69b475ef1727ff69d6f23d8e: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:50688 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45828 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59996 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46406 - "GET / HTTP/1.0" 200 OK 2026-03-15 20:40:08,452 - lava_callback - INFO - Received callback for node 69b476141727ff69d6f23d97 INFO: 172.21.0.1:46420 - "POST /node/69b476141727ff69d6f23d97 HTTP/1.0" 202 Accepted 2026-03-15 20:40:08,458 - lava_callback - INFO - Starting async job submit for node 69b476141727ff69d6f23d97 2026-03-15 20:40:08,459 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 20:40:08,473 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b476141727ff69d6f23d97 HTTP/1.1" 200 None 2026-03-15 20:40:08,474 - lava_callback - DEBUG - Processing node 69b476141727ff69d6f23d97: baseline-arm-baylibre 2026-03-15 20:40:08,474 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b476141727ff69d6f23d97 2026-03-15 20:40:08,475 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 20:40:08,501 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b476141727ff69d6f23d97 HTTP/1.1" 200 None 2026-03-15 20:40:08,502 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 20:40:08,515 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b3c7f91727ff69d6f21d89 HTTP/1.1" 200 None 2026-03-15 20:40:08,517 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 20:40:08,542 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b476141727ff69d6f23d97 HTTP/1.1" 200 None 2026-03-15 20:40:08,543 - lava_callback - ERROR - Error processing callback for node 69b476141727ff69d6f23d97: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:55248 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55258 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:55264 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33784 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54790 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55034 - "GET / HTTP/1.0" 200 OK 2026-03-15 20:40:48,580 - lava_callback - INFO - Received callback for node 69b476451727ff69d6f23da5 INFO: 172.21.0.1:55042 - "POST /node/69b476451727ff69d6f23da5 HTTP/1.0" 202 Accepted 2026-03-15 20:40:48,586 - lava_callback - INFO - Starting async job submit for node 69b476451727ff69d6f23da5 2026-03-15 20:40:48,587 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 20:40:48,601 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b476451727ff69d6f23da5 HTTP/1.1" 200 None 2026-03-15 20:40:48,602 - lava_callback - DEBUG - Processing node 69b476451727ff69d6f23da5: baseline-arm-baylibre 2026-03-15 20:40:48,602 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b476451727ff69d6f23da5 2026-03-15 20:40:48,603 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 20:40:48,617 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b476451727ff69d6f23da5 HTTP/1.1" 200 None 2026-03-15 20:40:48,618 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 20:40:48,641 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b3c7f91727ff69d6f21d89 HTTP/1.1" 200 None 2026-03-15 20:40:48,642 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 20:40:48,663 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b476451727ff69d6f23da5 HTTP/1.1" 200 None 2026-03-15 20:40:48,665 - lava_callback - ERROR - Error processing callback for node 69b476451727ff69d6f23da5: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:52624 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39742 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44270 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44274 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:44284 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38250 - "GET / HTTP/1.0" 200 OK 2026-03-15 20:41:28,540 - lava_callback - INFO - Received callback for node 69b476691727ff69d6f23db2 INFO: 172.21.0.1:38258 - "POST /node/69b476691727ff69d6f23db2 HTTP/1.0" 202 Accepted 2026-03-15 20:41:28,545 - lava_callback - INFO - Starting async job submit for node 69b476691727ff69d6f23db2 2026-03-15 20:41:28,546 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 20:41:28,582 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b476691727ff69d6f23db2 HTTP/1.1" 200 None 2026-03-15 20:41:28,582 - lava_callback - DEBUG - Processing node 69b476691727ff69d6f23db2: baseline-arm-baylibre 2026-03-15 20:41:28,583 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b476691727ff69d6f23db2 2026-03-15 20:41:28,583 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 20:41:28,617 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b476691727ff69d6f23db2 HTTP/1.1" 200 None 2026-03-15 20:41:28,618 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 20:41:28,632 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b3c7f91727ff69d6f21d89 HTTP/1.1" 200 None 2026-03-15 20:41:28,633 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 20:41:28,653 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b476691727ff69d6f23db2 HTTP/1.1" 200 None 2026-03-15 20:41:28,655 - lava_callback - ERROR - Error processing callback for node 69b476691727ff69d6f23db2: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:55850 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44032 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35192 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59958 - "GET / HTTP/1.0" 200 OK 2026-03-15 20:42:08,627 - lava_callback - INFO - Received callback for node 69b4768d1727ff69d6f23dbb INFO: 172.21.0.1:59972 - "POST /node/69b4768d1727ff69d6f23dbb HTTP/1.0" 202 Accepted 2026-03-15 20:42:08,633 - lava_callback - INFO - Starting async job submit for node 69b4768d1727ff69d6f23dbb 2026-03-15 20:42:08,634 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 20:42:08,649 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b4768d1727ff69d6f23dbb HTTP/1.1" 200 None 2026-03-15 20:42:08,650 - lava_callback - DEBUG - Processing node 69b4768d1727ff69d6f23dbb: baseline-arm-baylibre 2026-03-15 20:42:08,650 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b4768d1727ff69d6f23dbb 2026-03-15 20:42:08,651 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 20:42:08,667 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b4768d1727ff69d6f23dbb HTTP/1.1" 200 None 2026-03-15 20:42:08,669 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 20:42:08,682 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b3c7f91727ff69d6f21d89 HTTP/1.1" 200 None 2026-03-15 20:42:08,684 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 20:42:08,712 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b4768d1727ff69d6f23dbb HTTP/1.1" 200 None 2026-03-15 20:42:08,713 - lava_callback - ERROR - Error processing callback for node 69b4768d1727ff69d6f23dbb: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:50300 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50310 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:50318 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36254 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56034 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60716 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44490 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35380 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56926 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56930 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:56932 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48510 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37626 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43128 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50548 - "GET / HTTP/1.0" 200 OK 2026-03-15 20:44:00,719 - lava_callback - INFO - Received callback for node 69b477071727ff69d6f23ddf INFO: 172.21.0.1:35356 - "POST /node/69b477071727ff69d6f23ddf HTTP/1.0" 202 Accepted 2026-03-15 20:44:00,725 - lava_callback - INFO - Starting async job submit for node 69b477071727ff69d6f23ddf 2026-03-15 20:44:00,725 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 20:44:00,740 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b477071727ff69d6f23ddf HTTP/1.1" 200 None 2026-03-15 20:44:00,741 - lava_callback - DEBUG - Processing node 69b477071727ff69d6f23ddf: baseline-arm-clabbe 2026-03-15 20:44:00,741 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b477071727ff69d6f23ddf 2026-03-15 20:44:00,741 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 20:44:00,754 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b477071727ff69d6f23ddf HTTP/1.1" 200 None 2026-03-15 20:44:00,756 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 20:44:00,769 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b3c7f91727ff69d6f21d89 HTTP/1.1" 200 None 2026-03-15 20:44:00,771 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 20:44:00,791 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b477071727ff69d6f23ddf HTTP/1.1" 200 None 2026-03-15 20:44:00,796 - lava_callback - ERROR - Error processing callback for node 69b477071727ff69d6f23ddf: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:35360 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50954 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50960 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:50968 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33764 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48150 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50150 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37444 - "GET / HTTP/1.0" 200 OK 2026-03-15 20:45:00,728 - lava_callback - INFO - Received callback for node 69b477391727ff69d6f23def INFO: 172.21.0.1:39826 - "POST /node/69b477391727ff69d6f23def HTTP/1.0" 202 Accepted 2026-03-15 20:45:00,734 - lava_callback - INFO - Starting async job submit for node 69b477391727ff69d6f23def 2026-03-15 20:45:00,734 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 20:45:00,761 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b477391727ff69d6f23def HTTP/1.1" 200 None 2026-03-15 20:45:00,762 - lava_callback - DEBUG - Processing node 69b477391727ff69d6f23def: baseline-arm-clabbe 2026-03-15 20:45:00,762 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b477391727ff69d6f23def 2026-03-15 20:45:00,763 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 20:45:00,776 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b477391727ff69d6f23def HTTP/1.1" 200 None 2026-03-15 20:45:00,778 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 20:45:00,791 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b3c7f91727ff69d6f21d89 HTTP/1.1" 200 None 2026-03-15 20:45:00,792 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 20:45:00,818 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b477391727ff69d6f23def HTTP/1.1" 200 None 2026-03-15 20:45:00,819 - lava_callback - ERROR - Error processing callback for node 69b477391727ff69d6f23def: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:39840 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55268 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55274 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:55276 - "GET / HTTP/1.0" 200 OK 2026-03-15 20:45:20,700 - lava_callback - INFO - Received callback for node 69b4775d1727ff69d6f23dfa INFO: 172.21.0.1:55268 - "POST /node/69b4775d1727ff69d6f23dfa HTTP/1.0" 202 Accepted 2026-03-15 20:45:20,706 - lava_callback - INFO - Starting async job submit for node 69b4775d1727ff69d6f23dfa 2026-03-15 20:45:20,707 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 20:45:20,721 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b4775d1727ff69d6f23dfa HTTP/1.1" 200 None 2026-03-15 20:45:20,722 - lava_callback - DEBUG - Processing node 69b4775d1727ff69d6f23dfa: baseline-arm-clabbe 2026-03-15 20:45:20,722 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b4775d1727ff69d6f23dfa 2026-03-15 20:45:20,723 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 20:45:20,736 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b4775d1727ff69d6f23dfa HTTP/1.1" 200 None 2026-03-15 20:45:20,737 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 20:45:20,751 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b3c7f91727ff69d6f21d89 HTTP/1.1" 200 None 2026-03-15 20:45:20,753 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 20:45:20,776 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b4775d1727ff69d6f23dfa HTTP/1.1" 200 None 2026-03-15 20:45:20,777 - lava_callback - ERROR - Error processing callback for node 69b4775d1727ff69d6f23dfa: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:55278 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55198 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42202 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36852 - "GET / HTTP/1.0" 200 OK 2026-03-15 20:46:00,748 - lava_callback - INFO - Received callback for node 69b477821727ff69d6f23e03 INFO: 172.21.0.1:60872 - "POST /node/69b477821727ff69d6f23e03 HTTP/1.0" 202 Accepted 2026-03-15 20:46:00,756 - lava_callback - INFO - Starting async job submit for node 69b477821727ff69d6f23e03 2026-03-15 20:46:00,758 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 20:46:00,777 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b477821727ff69d6f23e03 HTTP/1.1" 200 None 2026-03-15 20:46:00,779 - lava_callback - DEBUG - Processing node 69b477821727ff69d6f23e03: baseline-arm-clabbe 2026-03-15 20:46:00,779 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b477821727ff69d6f23e03 2026-03-15 20:46:00,780 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 20:46:00,797 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b477821727ff69d6f23e03 HTTP/1.1" 200 None 2026-03-15 20:46:00,799 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 20:46:00,820 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b3c7f91727ff69d6f21d89 HTTP/1.1" 200 None 2026-03-15 20:46:00,822 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 20:46:00,851 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b477821727ff69d6f23e03 HTTP/1.1" 200 None 2026-03-15 20:46:00,852 - lava_callback - ERROR - Error processing callback for node 69b477821727ff69d6f23e03: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:60884 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39826 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39838 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:39842 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42428 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59946 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58656 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45312 - "GET / HTTP/1.0" 200 OK 2026-03-15 20:47:00,793 - lava_callback - INFO - Received callback for node 69b477b11727ff69d6f23e14 INFO: 172.21.0.1:47008 - "POST /node/69b477b11727ff69d6f23e14 HTTP/1.0" 202 Accepted 2026-03-15 20:47:00,798 - lava_callback - INFO - Starting async job submit for node 69b477b11727ff69d6f23e14 2026-03-15 20:47:00,800 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 20:47:00,818 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b477b11727ff69d6f23e14 HTTP/1.1" 200 None 2026-03-15 20:47:00,819 - lava_callback - DEBUG - Processing node 69b477b11727ff69d6f23e14: baseline-arm-clabbe 2026-03-15 20:47:00,819 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b477b11727ff69d6f23e14 2026-03-15 20:47:00,820 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 20:47:00,833 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b477b11727ff69d6f23e14 HTTP/1.1" 200 None 2026-03-15 20:47:00,834 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 20:47:00,848 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b3c7f91727ff69d6f21d89 HTTP/1.1" 200 None 2026-03-15 20:47:00,849 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 20:47:00,870 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b477b11727ff69d6f23e14 HTTP/1.1" 200 None 2026-03-15 20:47:00,877 - lava_callback - ERROR - Error processing callback for node 69b477b11727ff69d6f23e14: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:47018 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56540 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56542 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:56550 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57376 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50884 - "GET / HTTP/1.0" 200 OK 2026-03-15 20:47:40,804 - lava_callback - INFO - Received callback for node 69b477d61727ff69d6f23e1e INFO: 172.21.0.1:42588 - "POST /node/69b477d61727ff69d6f23e1e HTTP/1.0" 202 Accepted 2026-03-15 20:47:40,810 - lava_callback - INFO - Starting async job submit for node 69b477d61727ff69d6f23e1e 2026-03-15 20:47:40,811 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 20:47:40,826 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b477d61727ff69d6f23e1e HTTP/1.1" 200 None 2026-03-15 20:47:40,827 - lava_callback - DEBUG - Processing node 69b477d61727ff69d6f23e1e: baseline-arm-clabbe 2026-03-15 20:47:40,827 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b477d61727ff69d6f23e1e 2026-03-15 20:47:40,827 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 20:47:40,841 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b477d61727ff69d6f23e1e HTTP/1.1" 200 None 2026-03-15 20:47:40,842 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 20:47:40,857 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b12591a870a1dc3343ba82 HTTP/1.1" 200 None 2026-03-15 20:47:40,859 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 20:47:40,879 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b477d61727ff69d6f23e1e HTTP/1.1" 200 None 2026-03-15 20:47:40,881 - lava_callback - ERROR - Error processing callback for node 69b477d61727ff69d6f23e1e: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:42592 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55464 - "GET / HTTP/1.0" 200 OK 2026-03-15 20:48:00,839 - lava_callback - INFO - Received callback for node 69b477fb1727ff69d6f23e28 INFO: 172.21.0.1:33212 - "POST /node/69b477fb1727ff69d6f23e28 HTTP/1.0" 202 Accepted 2026-03-15 20:48:00,845 - lava_callback - INFO - Starting async job submit for node 69b477fb1727ff69d6f23e28 2026-03-15 20:48:00,845 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 20:48:00,860 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b477fb1727ff69d6f23e28 HTTP/1.1" 200 None 2026-03-15 20:48:00,861 - lava_callback - DEBUG - Processing node 69b477fb1727ff69d6f23e28: baseline-arm-clabbe 2026-03-15 20:48:00,861 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b477fb1727ff69d6f23e28 2026-03-15 20:48:00,861 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 20:48:00,875 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b477fb1727ff69d6f23e28 HTTP/1.1" 200 None 2026-03-15 20:48:00,876 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 20:48:00,890 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b12591a870a1dc3343ba82 HTTP/1.1" 200 None 2026-03-15 20:48:00,891 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 20:48:00,912 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b477fb1727ff69d6f23e28 HTTP/1.1" 200 None 2026-03-15 20:48:00,917 - lava_callback - ERROR - Error processing callback for node 69b477fb1727ff69d6f23e28: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:33218 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56698 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56712 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:56722 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49862 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41622 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33450 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52950 - "GET / HTTP/1.0" 200 OK 2026-03-15 20:49:00,873 - lava_callback - INFO - Received callback for node 69b478291727ff69d6f23e38 INFO: 172.21.0.1:51190 - "POST /node/69b478291727ff69d6f23e38 HTTP/1.0" 202 Accepted 2026-03-15 20:49:00,878 - lava_callback - INFO - Starting async job submit for node 69b478291727ff69d6f23e38 2026-03-15 20:49:00,879 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 20:49:00,897 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b478291727ff69d6f23e38 HTTP/1.1" 200 None 2026-03-15 20:49:00,898 - lava_callback - DEBUG - Processing node 69b478291727ff69d6f23e38: baseline-arm-clabbe 2026-03-15 20:49:00,899 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b478291727ff69d6f23e38 2026-03-15 20:49:00,899 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 20:49:00,931 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b478291727ff69d6f23e38 HTTP/1.1" 200 None 2026-03-15 20:49:00,933 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 20:49:00,947 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b12591a870a1dc3343ba82 HTTP/1.1" 200 None 2026-03-15 20:49:00,948 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 20:49:00,968 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b478291727ff69d6f23e38 HTTP/1.1" 200 None 2026-03-15 20:49:00,969 - lava_callback - ERROR - Error processing callback for node 69b478291727ff69d6f23e38: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:51200 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50274 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50284 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:50286 - "GET / HTTP/1.0" 200 OK 2026-03-15 20:49:20,853 - lava_callback - INFO - Received callback for node 69b4784d1727ff69d6f23e45 INFO: 172.21.0.1:49186 - "POST /node/69b4784d1727ff69d6f23e45 HTTP/1.0" 202 Accepted 2026-03-15 20:49:20,858 - lava_callback - INFO - Starting async job submit for node 69b4784d1727ff69d6f23e45 2026-03-15 20:49:20,859 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 20:49:20,875 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b4784d1727ff69d6f23e45 HTTP/1.1" 200 None 2026-03-15 20:49:20,876 - lava_callback - DEBUG - Processing node 69b4784d1727ff69d6f23e45: baseline-arm-clabbe 2026-03-15 20:49:20,876 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b4784d1727ff69d6f23e45 2026-03-15 20:49:20,877 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 20:49:20,890 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b4784d1727ff69d6f23e45 HTTP/1.1" 200 None 2026-03-15 20:49:20,892 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 20:49:20,904 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b12591a870a1dc3343ba82 HTTP/1.1" 200 None 2026-03-15 20:49:20,906 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 20:49:20,926 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b4784d1727ff69d6f23e45 HTTP/1.1" 200 None 2026-03-15 20:49:20,934 - lava_callback - ERROR - Error processing callback for node 69b4784d1727ff69d6f23e45: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:49200 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50538 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34602 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39020 - "GET / HTTP/1.0" 200 OK 2026-03-15 20:50:00,946 - lava_callback - INFO - Received callback for node 69b478711727ff69d6f23e50 INFO: 172.21.0.1:50976 - "POST /node/69b478711727ff69d6f23e50 HTTP/1.0" 202 Accepted 2026-03-15 20:50:00,951 - lava_callback - INFO - Starting async job submit for node 69b478711727ff69d6f23e50 2026-03-15 20:50:00,952 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 20:50:00,967 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b478711727ff69d6f23e50 HTTP/1.1" 200 None 2026-03-15 20:50:00,968 - lava_callback - DEBUG - Processing node 69b478711727ff69d6f23e50: baseline-arm-clabbe 2026-03-15 20:50:00,968 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b478711727ff69d6f23e50 2026-03-15 20:50:00,969 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 20:50:00,982 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b478711727ff69d6f23e50 HTTP/1.1" 200 None 2026-03-15 20:50:00,983 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 20:50:00,996 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b12591a870a1dc3343ba82 HTTP/1.1" 200 None 2026-03-15 20:50:00,997 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 20:50:01,020 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b478711727ff69d6f23e50 HTTP/1.1" 200 None 2026-03-15 20:50:01,026 - lava_callback - ERROR - Error processing callback for node 69b478711727ff69d6f23e50: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:50988 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53520 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53530 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:53540 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60526 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35622 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58928 - "GET / HTTP/1.0" 200 OK 2026-03-15 20:50:49,693 - lava_callback - INFO - Received callback for node 69b4789b1727ff69d6f23e5e INFO: 172.21.0.1:58930 - "POST /node/69b4789b1727ff69d6f23e5e HTTP/1.0" 202 Accepted 2026-03-15 20:50:49,699 - lava_callback - INFO - Starting async job submit for node 69b4789b1727ff69d6f23e5e 2026-03-15 20:50:49,699 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 20:50:49,714 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b4789b1727ff69d6f23e5e HTTP/1.1" 200 None 2026-03-15 20:50:49,715 - lava_callback - DEBUG - Processing node 69b4789b1727ff69d6f23e5e: baseline-arm64-baylibre 2026-03-15 20:50:49,715 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b4789b1727ff69d6f23e5e 2026-03-15 20:50:49,716 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 20:50:49,734 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b4789b1727ff69d6f23e5e HTTP/1.1" 200 None 2026-03-15 20:50:49,735 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 20:50:49,750 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aeba41feb96b28aa34a78b HTTP/1.1" 200 None 2026-03-15 20:50:49,751 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 20:50:49,772 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b4789b1727ff69d6f23e5e HTTP/1.1" 200 None 2026-03-15 20:50:49,781 - lava_callback - ERROR - Error processing callback for node 69b4789b1727ff69d6f23e5e: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:55744 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49266 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53052 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53068 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:53074 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53088 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43402 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49832 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49836 - "GET /favicon.ico HTTP/1.0" 404 Not Found INFO: 172.21.0.1:49852 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36756 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40308 - "GET /robots.txt HTTP/1.0" 404 Not Found INFO: 172.21.0.1:40310 - "GET / HTTP/1.0" 200 OK 2026-03-15 20:52:00,998 - lava_callback - INFO - Received callback for node 69b478e71727ff69d6f23e7f INFO: 172.21.0.1:54014 - "POST /node/69b478e71727ff69d6f23e7f HTTP/1.0" 202 Accepted 2026-03-15 20:52:01,005 - lava_callback - INFO - Starting async job submit for node 69b478e71727ff69d6f23e7f 2026-03-15 20:52:01,005 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 20:52:01,021 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b478e71727ff69d6f23e7f HTTP/1.1" 200 None 2026-03-15 20:52:01,022 - lava_callback - DEBUG - Processing node 69b478e71727ff69d6f23e7f: baseline-arm-clabbe 2026-03-15 20:52:01,022 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b478e71727ff69d6f23e7f 2026-03-15 20:52:01,023 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 20:52:01,054 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b478e71727ff69d6f23e7f HTTP/1.1" 200 None 2026-03-15 20:52:01,056 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 20:52:01,070 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b12591a870a1dc3343ba82 HTTP/1.1" 200 None 2026-03-15 20:52:01,072 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 20:52:01,096 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b478e71727ff69d6f23e7f HTTP/1.1" 200 None 2026-03-15 20:52:01,097 - lava_callback - ERROR - Error processing callback for node 69b478e71727ff69d6f23e7f: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:54026 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40992 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41006 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:41022 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54860 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59742 - "GET / HTTP/1.0" 200 OK 2026-03-15 20:52:41,023 - lava_callback - INFO - Received callback for node 69b4790c1727ff69d6f23e8b INFO: 172.21.0.1:57830 - "POST /node/69b4790c1727ff69d6f23e8b HTTP/1.0" 202 Accepted 2026-03-15 20:52:41,028 - lava_callback - INFO - Starting async job submit for node 69b4790c1727ff69d6f23e8b 2026-03-15 20:52:41,029 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 20:52:41,044 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b4790c1727ff69d6f23e8b HTTP/1.1" 200 None 2026-03-15 20:52:41,044 - lava_callback - DEBUG - Processing node 69b4790c1727ff69d6f23e8b: baseline-arm-clabbe 2026-03-15 20:52:41,045 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b4790c1727ff69d6f23e8b 2026-03-15 20:52:41,045 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 20:52:41,067 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b4790c1727ff69d6f23e8b HTTP/1.1" 200 None 2026-03-15 20:52:41,069 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 20:52:41,082 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b12591a870a1dc3343ba82 HTTP/1.1" 200 None 2026-03-15 20:52:41,084 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 20:52:41,114 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b4790c1727ff69d6f23e8b HTTP/1.1" 200 None 2026-03-15 20:52:41,115 - lava_callback - ERROR - Error processing callback for node 69b4790c1727ff69d6f23e8b: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:57842 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40542 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56238 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50960 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50964 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:50976 - "GET / HTTP/1.0" 200 OK 2026-03-15 20:53:21,087 - lava_callback - INFO - Received callback for node 69b479311727ff69d6f23e9a INFO: 172.21.0.1:47622 - "POST /node/69b479311727ff69d6f23e9a HTTP/1.0" 202 Accepted 2026-03-15 20:53:21,093 - lava_callback - INFO - Starting async job submit for node 69b479311727ff69d6f23e9a 2026-03-15 20:53:21,093 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 20:53:21,108 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b479311727ff69d6f23e9a HTTP/1.1" 200 None 2026-03-15 20:53:21,109 - lava_callback - DEBUG - Processing node 69b479311727ff69d6f23e9a: baseline-arm-clabbe 2026-03-15 20:53:21,109 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b479311727ff69d6f23e9a 2026-03-15 20:53:21,109 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 20:53:21,130 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b479311727ff69d6f23e9a HTTP/1.1" 200 None 2026-03-15 20:53:21,131 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 20:53:21,149 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b12591a870a1dc3343ba82 HTTP/1.1" 200 None 2026-03-15 20:53:21,151 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 20:53:21,173 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b479311727ff69d6f23e9a HTTP/1.1" 200 None 2026-03-15 20:53:21,178 - lava_callback - ERROR - Error processing callback for node 69b479311727ff69d6f23e9a: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:47638 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42872 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39480 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38020 - "GET / HTTP/1.0" 200 OK 2026-03-15 20:54:01,060 - lava_callback - INFO - Received callback for node 69b479551727ff69d6f23ea7 INFO: 172.21.0.1:47546 - "POST /node/69b479551727ff69d6f23ea7 HTTP/1.0" 202 Accepted 2026-03-15 20:54:01,065 - lava_callback - INFO - Starting async job submit for node 69b479551727ff69d6f23ea7 2026-03-15 20:54:01,066 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 20:54:01,086 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b479551727ff69d6f23ea7 HTTP/1.1" 200 None 2026-03-15 20:54:01,086 - lava_callback - DEBUG - Processing node 69b479551727ff69d6f23ea7: baseline-arm-clabbe 2026-03-15 20:54:01,087 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b479551727ff69d6f23ea7 2026-03-15 20:54:01,087 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 20:54:01,101 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b479551727ff69d6f23ea7 HTTP/1.1" 200 None 2026-03-15 20:54:01,103 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 20:54:01,116 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b12591a870a1dc3343ba82 HTTP/1.1" 200 None 2026-03-15 20:54:01,117 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 20:54:01,144 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b479551727ff69d6f23ea7 HTTP/1.1" 200 None 2026-03-15 20:54:01,148 - lava_callback - ERROR - Error processing callback for node 69b479551727ff69d6f23ea7: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:47550 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47698 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47712 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:47714 - "GET / HTTP/1.0" 200 OK 2026-03-15 20:54:21,100 - lava_callback - INFO - Received callback for node 69b479791727ff69d6f23eb5 INFO: 172.21.0.1:41168 - "POST /node/69b479791727ff69d6f23eb5 HTTP/1.0" 202 Accepted 2026-03-15 20:54:21,105 - lava_callback - INFO - Starting async job submit for node 69b479791727ff69d6f23eb5 2026-03-15 20:54:21,106 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 20:54:21,125 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b479791727ff69d6f23eb5 HTTP/1.1" 200 None 2026-03-15 20:54:21,126 - lava_callback - DEBUG - Processing node 69b479791727ff69d6f23eb5: baseline-arm-clabbe 2026-03-15 20:54:21,127 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b479791727ff69d6f23eb5 2026-03-15 20:54:21,127 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 20:54:21,142 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b479791727ff69d6f23eb5 HTTP/1.1" 200 None 2026-03-15 20:54:21,143 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 20:54:21,156 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b12591a870a1dc3343ba82 HTTP/1.1" 200 None 2026-03-15 20:54:21,158 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 20:54:21,178 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b479791727ff69d6f23eb5 HTTP/1.1" 200 None 2026-03-15 20:54:21,179 - lava_callback - ERROR - Error processing callback for node 69b479791727ff69d6f23eb5: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:41174 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37912 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42270 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48622 - "GET / HTTP/1.0" 200 OK 2026-03-15 20:55:01,041 - lava_callback - INFO - Received callback for node 69b4799d1727ff69d6f23ebe INFO: 172.21.0.1:39834 - "POST /node/69b4799d1727ff69d6f23ebe HTTP/1.0" 202 Accepted 2026-03-15 20:55:01,046 - lava_callback - INFO - Starting async job submit for node 69b4799d1727ff69d6f23ebe 2026-03-15 20:55:01,047 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 20:55:01,066 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b4799d1727ff69d6f23ebe HTTP/1.1" 200 None 2026-03-15 20:55:01,067 - lava_callback - DEBUG - Processing node 69b4799d1727ff69d6f23ebe: baseline-arm-clabbe 2026-03-15 20:55:01,067 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b4799d1727ff69d6f23ebe 2026-03-15 20:55:01,068 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 20:55:01,084 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b4799d1727ff69d6f23ebe HTTP/1.1" 200 None 2026-03-15 20:55:01,085 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 20:55:01,103 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b12591a870a1dc3343ba82 HTTP/1.1" 200 None 2026-03-15 20:55:01,105 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 20:55:01,127 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b4799d1727ff69d6f23ebe HTTP/1.1" 200 None 2026-03-15 20:55:01,132 - lava_callback - ERROR - Error processing callback for node 69b4799d1727ff69d6f23ebe: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:39840 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44556 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44568 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:44582 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33116 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37596 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48864 - "GET / HTTP/1.0" 200 OK 2026-03-15 20:55:49,369 - lava_callback - INFO - Received callback for node 69b479c71727ff69d6f23ec9 INFO: 172.21.0.1:48880 - "POST /node/69b479c71727ff69d6f23ec9 HTTP/1.0" 202 Accepted 2026-03-15 20:55:49,374 - lava_callback - INFO - Starting async job submit for node 69b479c71727ff69d6f23ec9 2026-03-15 20:55:49,375 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 20:55:49,401 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b479c71727ff69d6f23ec9 HTTP/1.1" 200 None 2026-03-15 20:55:49,402 - lava_callback - DEBUG - Processing node 69b479c71727ff69d6f23ec9: baseline-arm64-baylibre 2026-03-15 20:55:49,402 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b479c71727ff69d6f23ec9 2026-03-15 20:55:49,403 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 20:55:49,415 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b479c71727ff69d6f23ec9 HTTP/1.1" 200 None 2026-03-15 20:55:49,417 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 20:55:49,434 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aeba41feb96b28aa34a78b HTTP/1.1" 200 None 2026-03-15 20:55:49,436 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 20:55:49,461 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b479c71727ff69d6f23ec9 HTTP/1.1" 200 None 2026-03-15 20:55:49,463 - lava_callback - ERROR - Error processing callback for node 69b479c71727ff69d6f23ec9: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:36900 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58744 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38580 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38586 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:38590 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60248 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55738 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46972 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46976 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50428 - "GET /favicon.ico HTTP/1.0" 404 Not Found INFO: 172.21.0.1:50444 - "GET / HTTP/1.0" 200 OK 2026-03-15 20:57:01,236 - lava_callback - INFO - Received callback for node 69b47a151727ff69d6f23ee9 INFO: 172.21.0.1:51090 - "POST /node/69b47a151727ff69d6f23ee9 HTTP/1.0" 202 Accepted 2026-03-15 20:57:01,241 - lava_callback - INFO - Starting async job submit for node 69b47a151727ff69d6f23ee9 2026-03-15 20:57:01,242 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 20:57:01,260 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b47a151727ff69d6f23ee9 HTTP/1.1" 200 None 2026-03-15 20:57:01,261 - lava_callback - DEBUG - Processing node 69b47a151727ff69d6f23ee9: baseline-arm-clabbe 2026-03-15 20:57:01,261 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b47a151727ff69d6f23ee9 2026-03-15 20:57:01,262 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 20:57:01,287 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b47a151727ff69d6f23ee9 HTTP/1.1" 200 None 2026-03-15 20:57:01,288 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 20:57:01,302 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b12591a870a1dc3343ba82 HTTP/1.1" 200 None 2026-03-15 20:57:01,303 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 20:57:01,324 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b47a151727ff69d6f23ee9 HTTP/1.1" 200 None 2026-03-15 20:57:01,326 - lava_callback - ERROR - Error processing callback for node 69b47a151727ff69d6f23ee9: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:51102 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51608 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51622 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:51632 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44596 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48560 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39696 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37120 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60342 - "GET /security.txt HTTP/1.0" 404 Not Found INFO: 172.21.0.1:60350 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33954 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33962 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:33964 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51146 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37906 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38208 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41770 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39088 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36572 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36582 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:36586 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52210 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48142 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60472 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37986 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43442 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49868 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49870 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:49872 - "GET / HTTP/1.0" 200 OK 2026-03-15 21:00:21,295 - lava_callback - INFO - Received callback for node 69b47ae21727ff69d6f23f28 INFO: 172.21.0.1:43052 - "POST /node/69b47ae21727ff69d6f23f28 HTTP/1.0" 202 Accepted 2026-03-15 21:00:21,300 - lava_callback - INFO - Starting async job submit for node 69b47ae21727ff69d6f23f28 2026-03-15 21:00:21,301 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 21:00:21,317 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b47ae21727ff69d6f23f28 HTTP/1.1" 200 None 2026-03-15 21:00:21,318 - lava_callback - DEBUG - Processing node 69b47ae21727ff69d6f23f28: baseline-arm-clabbe 2026-03-15 21:00:21,318 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b47ae21727ff69d6f23f28 2026-03-15 21:00:21,319 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 21:00:21,333 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b47ae21727ff69d6f23f28 HTTP/1.1" 200 None 2026-03-15 21:00:21,335 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 21:00:21,349 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b12591a870a1dc3343ba82 HTTP/1.1" 200 None 2026-03-15 21:00:21,350 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 21:00:21,380 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b47ae21727ff69d6f23f28 HTTP/1.1" 200 None 2026-03-15 21:00:21,381 - lava_callback - ERROR - Error processing callback for node 69b47ae21727ff69d6f23f28: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:43058 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34730 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59110 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57824 - "GET / HTTP/1.0" 200 OK 2026-03-15 21:01:01,304 - lava_callback - INFO - Received callback for node 69b47b061727ff69d6f23f31 INFO: 172.21.0.1:51222 - "POST /node/69b47b061727ff69d6f23f31 HTTP/1.0" 202 Accepted 2026-03-15 21:01:01,309 - lava_callback - INFO - Starting async job submit for node 69b47b061727ff69d6f23f31 2026-03-15 21:01:01,310 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 21:01:01,325 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b47b061727ff69d6f23f31 HTTP/1.1" 200 None 2026-03-15 21:01:01,326 - lava_callback - DEBUG - Processing node 69b47b061727ff69d6f23f31: baseline-arm-clabbe 2026-03-15 21:01:01,326 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b47b061727ff69d6f23f31 2026-03-15 21:01:01,327 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 21:01:01,344 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b47b061727ff69d6f23f31 HTTP/1.1" 200 None 2026-03-15 21:01:01,345 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 21:01:01,359 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b12591a870a1dc3343ba82 HTTP/1.1" 200 None 2026-03-15 21:01:01,360 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 21:01:01,380 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b47b061727ff69d6f23f31 HTTP/1.1" 200 None 2026-03-15 21:01:01,382 - lava_callback - ERROR - Error processing callback for node 69b47b061727ff69d6f23f31: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:51234 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37392 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37406 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:37414 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36326 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59484 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51922 - "GET / HTTP/1.0" 200 OK 2026-03-15 21:01:49,704 - lava_callback - INFO - Received callback for node 69b47b311727ff69d6f23f3c INFO: 172.21.0.1:57710 - "POST /node/69b47b311727ff69d6f23f3c HTTP/1.0" 202 Accepted 2026-03-15 21:01:49,709 - lava_callback - INFO - Starting async job submit for node 69b47b311727ff69d6f23f3c 2026-03-15 21:01:49,710 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 21:01:49,732 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b47b311727ff69d6f23f3c HTTP/1.1" 200 None 2026-03-15 21:01:49,733 - lava_callback - DEBUG - Processing node 69b47b311727ff69d6f23f3c: baseline-arm64-baylibre 2026-03-15 21:01:49,733 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b47b311727ff69d6f23f3c 2026-03-15 21:01:49,734 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 21:01:49,748 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b47b311727ff69d6f23f3c HTTP/1.1" 200 None 2026-03-15 21:01:49,750 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 21:01:49,763 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aeba41feb96b28aa34a78b HTTP/1.1" 200 None 2026-03-15 21:01:49,765 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 21:01:49,785 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b47b311727ff69d6f23f3c HTTP/1.1" 200 None 2026-03-15 21:01:49,786 - lava_callback - ERROR - Error processing callback for node 69b47b311727ff69d6f23f3c: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:57712 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44738 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60484 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60488 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:60494 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49182 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48998 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44082 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34784 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36446 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54076 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54080 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:54096 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52482 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39990 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38654 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33266 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55840 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49514 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49518 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:49522 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60954 - "GET / HTTP/1.0" 200 OK 2026-03-15 21:04:29,853 - lava_callback - INFO - Received callback for node 69b47bda1727ff69d6f23f5a INFO: 172.21.0.1:41946 - "POST /node/69b47bda1727ff69d6f23f5a HTTP/1.0" 202 Accepted 2026-03-15 21:04:29,859 - lava_callback - INFO - Starting async job submit for node 69b47bda1727ff69d6f23f5a 2026-03-15 21:04:29,860 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 21:04:29,879 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b47bda1727ff69d6f23f5a HTTP/1.1" 200 None 2026-03-15 21:04:29,880 - lava_callback - DEBUG - Processing node 69b47bda1727ff69d6f23f5a: baseline-arm64-baylibre 2026-03-15 21:04:29,881 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b47bda1727ff69d6f23f5a 2026-03-15 21:04:29,881 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 21:04:29,901 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b47bda1727ff69d6f23f5a HTTP/1.1" 200 None 2026-03-15 21:04:29,902 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 21:04:29,916 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aeba41feb96b28aa34a78b HTTP/1.1" 200 None 2026-03-15 21:04:29,918 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 21:04:29,951 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b47bda1727ff69d6f23f5a HTTP/1.1" 200 None 2026-03-15 21:04:29,953 - lava_callback - ERROR - Error processing callback for node 69b47bda1727ff69d6f23f5a: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:41950 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60016 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42446 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59144 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48024 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48034 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:48046 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40454 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36736 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36572 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33442 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34286 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39210 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39216 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:39218 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42328 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49216 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41866 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49254 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46096 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46444 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46450 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:46464 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49570 - "GET / HTTP/1.0" 200 OK 2026-03-15 21:07:30,114 - lava_callback - INFO - Received callback for node 69b47c821727ff69d6f23f91 INFO: 172.21.0.1:45232 - "POST /node/69b47c821727ff69d6f23f91 HTTP/1.0" 202 Accepted 2026-03-15 21:07:30,119 - lava_callback - INFO - Starting async job submit for node 69b47c821727ff69d6f23f91 2026-03-15 21:07:30,120 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 21:07:30,134 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b47c821727ff69d6f23f91 HTTP/1.1" 200 None 2026-03-15 21:07:30,135 - lava_callback - DEBUG - Processing node 69b47c821727ff69d6f23f91: baseline-arm64-baylibre 2026-03-15 21:07:30,135 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b47c821727ff69d6f23f91 2026-03-15 21:07:30,136 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 21:07:30,151 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b47c821727ff69d6f23f91 HTTP/1.1" 200 None 2026-03-15 21:07:30,153 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 21:07:30,174 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aeba41feb96b28aa34a78b HTTP/1.1" 200 None 2026-03-15 21:07:30,176 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 21:07:30,204 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b47c821727ff69d6f23f91 HTTP/1.1" 200 None 2026-03-15 21:07:30,206 - lava_callback - ERROR - Error processing callback for node 69b47c821727ff69d6f23f91: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:45244 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39880 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47678 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49326 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40750 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40752 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:40760 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45966 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37132 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60286 - "GET / HTTP/1.0" 200 OK 2026-03-15 21:08:50,152 - lava_callback - INFO - Received callback for node 69b47cd31727ff69d6f23fa6 INFO: 172.21.0.1:45692 - "POST /node/69b47cd31727ff69d6f23fa6 HTTP/1.0" 202 Accepted 2026-03-15 21:08:50,158 - lava_callback - INFO - Starting async job submit for node 69b47cd31727ff69d6f23fa6 2026-03-15 21:08:50,159 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 21:08:50,182 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b47cd31727ff69d6f23fa6 HTTP/1.1" 200 None 2026-03-15 21:08:50,183 - lava_callback - DEBUG - Processing node 69b47cd31727ff69d6f23fa6: baseline-arm64-baylibre 2026-03-15 21:08:50,183 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b47cd31727ff69d6f23fa6 2026-03-15 21:08:50,184 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 21:08:50,197 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b47cd31727ff69d6f23fa6 HTTP/1.1" 200 None 2026-03-15 21:08:50,199 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 21:08:50,213 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b3c8061727ff69d6f21d98 HTTP/1.1" 200 None 2026-03-15 21:08:50,214 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 21:08:50,235 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b47cd31727ff69d6f23fa6 HTTP/1.1" 200 None 2026-03-15 21:08:50,237 - lava_callback - ERROR - Error processing callback for node 69b47cd31727ff69d6f23fa6: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:45706 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42716 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49686 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49694 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:49700 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56020 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57808 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47838 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42154 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37516 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54930 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54934 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:54950 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53492 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52504 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37710 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42602 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39858 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33102 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33118 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:33128 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53692 - "GET / HTTP/1.0" 200 OK 2026-03-15 21:11:30,682 - lava_callback - INFO - Received callback for node 69b47d7f1727ff69d6f23fc5 INFO: 172.21.0.1:37546 - "POST /node/69b47d7f1727ff69d6f23fc5 HTTP/1.0" 202 Accepted 2026-03-15 21:11:30,688 - lava_callback - INFO - Starting async job submit for node 69b47d7f1727ff69d6f23fc5 2026-03-15 21:11:30,689 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 21:11:30,703 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b47d7f1727ff69d6f23fc5 HTTP/1.1" 200 None 2026-03-15 21:11:30,704 - lava_callback - DEBUG - Processing node 69b47d7f1727ff69d6f23fc5: baseline-arm64-baylibre 2026-03-15 21:11:30,704 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b47d7f1727ff69d6f23fc5 2026-03-15 21:11:30,705 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 21:11:30,724 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b47d7f1727ff69d6f23fc5 HTTP/1.1" 200 None 2026-03-15 21:11:30,725 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 21:11:30,739 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aeba41feb96b28aa34a78b HTTP/1.1" 200 None 2026-03-15 21:11:30,741 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 21:11:30,767 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b47d7f1727ff69d6f23fc5 HTTP/1.1" 200 None 2026-03-15 21:11:30,768 - lava_callback - ERROR - Error processing callback for node 69b47d7f1727ff69d6f23fc5: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:37554 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44632 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47156 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43782 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35666 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35676 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:35684 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45232 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42248 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58228 - "GET / HTTP/1.0" 200 OK 2026-03-15 21:12:50,367 - lava_callback - INFO - Received callback for node 69b47dcf1727ff69d6f23fd7 INFO: 172.21.0.1:38394 - "POST /node/69b47dcf1727ff69d6f23fd7 HTTP/1.0" 202 Accepted 2026-03-15 21:12:50,372 - lava_callback - INFO - Starting async job submit for node 69b47dcf1727ff69d6f23fd7 2026-03-15 21:12:50,373 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 21:12:50,398 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b47dcf1727ff69d6f23fd7 HTTP/1.1" 200 None 2026-03-15 21:12:50,399 - lava_callback - DEBUG - Processing node 69b47dcf1727ff69d6f23fd7: baseline-arm64-baylibre 2026-03-15 21:12:50,399 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b47dcf1727ff69d6f23fd7 2026-03-15 21:12:50,400 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 21:12:50,413 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b47dcf1727ff69d6f23fd7 HTTP/1.1" 200 None 2026-03-15 21:12:50,415 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 21:12:50,429 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b3c8061727ff69d6f21d98 HTTP/1.1" 200 None 2026-03-15 21:12:50,431 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 21:12:50,452 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b47dcf1727ff69d6f23fd7 HTTP/1.1" 200 None 2026-03-15 21:12:50,458 - lava_callback - ERROR - Error processing callback for node 69b47dcf1727ff69d6f23fd7: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:38406 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49850 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43536 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43538 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:43546 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41946 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57562 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52220 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47918 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50116 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50768 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50772 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:50788 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44768 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53850 - "GET / HTTP/1.0" 200 OK 2026-03-15 21:14:41,989 - lava_callback - INFO - Received callback for node 69b47e2b1727ff69d6f23feb INFO: 172.21.0.1:37076 - "POST /node/69b47e2b1727ff69d6f23feb HTTP/1.0" 202 Accepted 2026-03-15 21:14:41,995 - lava_callback - INFO - Starting async job submit for node 69b47e2b1727ff69d6f23feb 2026-03-15 21:14:41,996 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 21:14:42,013 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b47e2b1727ff69d6f23feb HTTP/1.1" 200 None 2026-03-15 21:14:42,013 - lava_callback - DEBUG - Processing node 69b47e2b1727ff69d6f23feb: baseline-arm64-clabbe 2026-03-15 21:14:42,014 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b47e2b1727ff69d6f23feb 2026-03-15 21:14:42,014 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 21:14:42,030 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b47e2b1727ff69d6f23feb HTTP/1.1" 200 None 2026-03-15 21:14:42,032 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 21:14:42,046 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aeba41feb96b28aa34a78b HTTP/1.1" 200 None 2026-03-15 21:14:42,047 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 21:14:42,076 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b47e2b1727ff69d6f23feb HTTP/1.1" 200 None 2026-03-15 21:14:42,083 - lava_callback - ERROR - Error processing callback for node 69b47e2b1727ff69d6f23feb: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:37090 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46860 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44782 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39092 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39108 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:39124 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60114 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50778 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37850 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38422 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54852 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46098 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46106 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:46122 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45972 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57896 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34896 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58250 - "GET / HTTP/1.0" 200 OK 2026-03-15 21:17:02,055 - lava_callback - INFO - Received callback for node 69b47ec31727ff69d6f24003 INFO: 172.21.0.1:57442 - "POST /node/69b47ec31727ff69d6f24003 HTTP/1.0" 202 Accepted 2026-03-15 21:17:02,060 - lava_callback - INFO - Starting async job submit for node 69b47ec31727ff69d6f24003 2026-03-15 21:17:02,061 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 21:17:02,075 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b47ec31727ff69d6f24003 HTTP/1.1" 200 None 2026-03-15 21:17:02,076 - lava_callback - DEBUG - Processing node 69b47ec31727ff69d6f24003: baseline-arm-clabbe 2026-03-15 21:17:02,076 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b47ec31727ff69d6f24003 2026-03-15 21:17:02,077 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 21:17:02,091 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b47ec31727ff69d6f24003 HTTP/1.1" 200 None 2026-03-15 21:17:02,092 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 21:17:02,106 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b12591a870a1dc3343ba82 HTTP/1.1" 200 None 2026-03-15 21:17:02,107 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 21:17:02,159 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b47ec31727ff69d6f24003 HTTP/1.1" 200 None 2026-03-15 21:17:02,160 - lava_callback - ERROR - Error processing callback for node 69b47ec31727ff69d6f24003: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:57454 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45088 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45100 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:45104 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42386 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40560 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53262 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38106 - "GET / HTTP/1.0" 200 OK 2026-03-15 21:18:02,194 - lava_callback - INFO - Received callback for node 69b47ef71727ff69d6f24015 INFO: 172.21.0.1:53602 - "POST /node/69b47ef71727ff69d6f24015 HTTP/1.0" 202 Accepted 2026-03-15 21:18:02,199 - lava_callback - INFO - Starting async job submit for node 69b47ef71727ff69d6f24015 2026-03-15 21:18:02,200 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 21:18:02,220 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b47ef71727ff69d6f24015 HTTP/1.1" 200 None 2026-03-15 21:18:02,221 - lava_callback - DEBUG - Processing node 69b47ef71727ff69d6f24015: baseline-arm64-clabbe 2026-03-15 21:18:02,221 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b47ef71727ff69d6f24015 2026-03-15 21:18:02,222 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 21:18:02,239 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b47ef71727ff69d6f24015 HTTP/1.1" 200 None 2026-03-15 21:18:02,241 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 21:18:02,256 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aeba41feb96b28aa34a78b HTTP/1.1" 200 None 2026-03-15 21:18:02,258 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 21:18:02,286 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b47ef71727ff69d6f24015 HTTP/1.1" 200 None 2026-03-15 21:18:02,287 - lava_callback - ERROR - Error processing callback for node 69b47ef71727ff69d6f24015: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:53604 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54320 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54336 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:54350 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:32984 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55724 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42766 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38420 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48888 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54248 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54258 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:54260 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51196 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39470 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56334 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40272 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49532 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44332 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44340 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:44352 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37790 - "GET / HTTP/1.0" 200 OK 2026-03-15 21:20:30,877 - lava_callback - INFO - Received callback for node 69b47f981727ff69d6f2402b INFO: 172.21.0.1:51244 - "POST /node/69b47f981727ff69d6f2402b HTTP/1.0" 202 Accepted 2026-03-15 21:20:30,882 - lava_callback - INFO - Starting async job submit for node 69b47f981727ff69d6f2402b 2026-03-15 21:20:30,883 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 21:20:30,897 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b47f981727ff69d6f2402b HTTP/1.1" 200 None 2026-03-15 21:20:30,898 - lava_callback - DEBUG - Processing node 69b47f981727ff69d6f2402b: baseline-arm64-baylibre 2026-03-15 21:20:30,898 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b47f981727ff69d6f2402b 2026-03-15 21:20:30,899 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 21:20:30,913 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b47f981727ff69d6f2402b HTTP/1.1" 200 None 2026-03-15 21:20:30,914 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 21:20:30,928 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b3c8061727ff69d6f21d98 HTTP/1.1" 200 None 2026-03-15 21:20:30,930 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 21:20:30,965 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b47f981727ff69d6f2402b HTTP/1.1" 200 None 2026-03-15 21:20:30,973 - lava_callback - ERROR - Error processing callback for node 69b47f981727ff69d6f2402b: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:51254 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45804 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35400 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58660 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46016 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46018 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:46022 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43244 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56940 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47198 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37676 - "GET / HTTP/1.0" 200 OK 2026-03-15 21:22:02,285 - lava_callback - INFO - Received callback for node 69b47ff41727ff69d6f2403f INFO: 172.21.0.1:53722 - "POST /node/69b47ff41727ff69d6f2403f HTTP/1.0" 202 Accepted 2026-03-15 21:22:02,291 - lava_callback - INFO - Starting async job submit for node 69b47ff41727ff69d6f2403f 2026-03-15 21:22:02,291 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 21:22:02,312 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b47ff41727ff69d6f2403f HTTP/1.1" 200 None 2026-03-15 21:22:02,313 - lava_callback - DEBUG - Processing node 69b47ff41727ff69d6f2403f: baseline-arm64-clabbe 2026-03-15 21:22:02,313 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b47ff41727ff69d6f2403f 2026-03-15 21:22:02,314 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 21:22:02,327 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b47ff41727ff69d6f2403f HTTP/1.1" 200 None 2026-03-15 21:22:02,329 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 21:22:02,342 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aeba41feb96b28aa34a78b HTTP/1.1" 200 None 2026-03-15 21:22:02,343 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 21:22:02,364 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b47ff41727ff69d6f2403f HTTP/1.1" 200 None 2026-03-15 21:22:02,370 - lava_callback - ERROR - Error processing callback for node 69b47ff41727ff69d6f2403f: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:53732 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33208 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33214 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:33228 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50476 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45406 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38570 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43360 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54178 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37980 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37992 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:38006 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33630 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46158 - "GET / HTTP/1.0" 200 OK 2026-03-15 21:23:42,379 - lava_callback - INFO - Received callback for node 69b4804a1727ff69d6f24051 INFO: 172.21.0.1:59848 - "POST /node/69b4804a1727ff69d6f24051 HTTP/1.0" 202 Accepted 2026-03-15 21:23:42,384 - lava_callback - INFO - Starting async job submit for node 69b4804a1727ff69d6f24051 2026-03-15 21:23:42,385 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 21:23:42,400 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b4804a1727ff69d6f24051 HTTP/1.1" 200 None 2026-03-15 21:23:42,400 - lava_callback - DEBUG - Processing node 69b4804a1727ff69d6f24051: baseline-arm64-clabbe 2026-03-15 21:23:42,401 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b4804a1727ff69d6f24051 2026-03-15 21:23:42,401 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 21:23:42,420 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b4804a1727ff69d6f24051 HTTP/1.1" 200 None 2026-03-15 21:23:42,421 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 21:23:42,436 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aeba41feb96b28aa34a78b HTTP/1.1" 200 None 2026-03-15 21:23:42,438 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 21:23:42,459 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b4804a1727ff69d6f24051 HTTP/1.1" 200 None 2026-03-15 21:23:42,466 - lava_callback - ERROR - Error processing callback for node 69b4804a1727ff69d6f24051: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:59856 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50280 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54576 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39518 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39530 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:39544 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59076 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50298 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33348 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40666 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36824 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53364 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53378 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:53390 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54076 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34730 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34502 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49712 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52868 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44694 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44706 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:44720 - "GET / HTTP/1.0" 200 OK 2026-03-15 21:26:22,450 - lava_callback - INFO - Received callback for node 69b480ec1727ff69d6f24085 INFO: 172.21.0.1:37660 - "POST /node/69b480ec1727ff69d6f24085 HTTP/1.0" 202 Accepted 2026-03-15 21:26:22,455 - lava_callback - INFO - Starting async job submit for node 69b480ec1727ff69d6f24085 2026-03-15 21:26:22,456 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 21:26:22,471 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b480ec1727ff69d6f24085 HTTP/1.1" 200 None 2026-03-15 21:26:22,472 - lava_callback - DEBUG - Processing node 69b480ec1727ff69d6f24085: baseline-arm64-clabbe 2026-03-15 21:26:22,472 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b480ec1727ff69d6f24085 2026-03-15 21:26:22,473 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 21:26:22,487 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b480ec1727ff69d6f24085 HTTP/1.1" 200 None 2026-03-15 21:26:22,488 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 21:26:22,523 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aeba41feb96b28aa34a78b HTTP/1.1" 200 None 2026-03-15 21:26:22,524 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 21:26:22,552 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b480ec1727ff69d6f24085 HTTP/1.1" 200 None 2026-03-15 21:26:22,557 - lava_callback - ERROR - Error processing callback for node 69b480ec1727ff69d6f24085: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:37670 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56482 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56702 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44274 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54172 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36884 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36898 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:36902 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38884 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39106 - "GET / HTTP/1.0" 200 OK 2026-03-15 21:27:42,483 - lava_callback - INFO - Received callback for node 69b4813f1727ff69d6f240a5 INFO: 172.21.0.1:40080 - "POST /node/69b4813f1727ff69d6f240a5 HTTP/1.0" 202 Accepted 2026-03-15 21:27:42,488 - lava_callback - INFO - Starting async job submit for node 69b4813f1727ff69d6f240a5 2026-03-15 21:27:42,489 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 21:27:42,516 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b4813f1727ff69d6f240a5 HTTP/1.1" 200 None 2026-03-15 21:27:42,517 - lava_callback - DEBUG - Processing node 69b4813f1727ff69d6f240a5: baseline-arm64-clabbe 2026-03-15 21:27:42,517 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b4813f1727ff69d6f240a5 2026-03-15 21:27:42,518 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 21:27:42,533 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b4813f1727ff69d6f240a5 HTTP/1.1" 200 None 2026-03-15 21:27:42,534 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 21:27:42,547 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b3c8061727ff69d6f21d98 HTTP/1.1" 200 None 2026-03-15 21:27:42,549 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 21:27:42,570 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b4813f1727ff69d6f240a5 HTTP/1.1" 200 None 2026-03-15 21:27:42,571 - lava_callback - ERROR - Error processing callback for node 69b4813f1727ff69d6f240a5: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:40090 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42214 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57540 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44756 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44760 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:44770 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39394 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47116 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57364 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41952 - "GET / HTTP/1.0" 200 OK 2026-03-15 21:29:02,536 - lava_callback - INFO - Received callback for node 69b481941727ff69d6f240b9 INFO: 172.21.0.1:60888 - "POST /node/69b481941727ff69d6f240b9 HTTP/1.0" 202 Accepted 2026-03-15 21:29:02,541 - lava_callback - INFO - Starting async job submit for node 69b481941727ff69d6f240b9 2026-03-15 21:29:02,542 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 21:29:02,561 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b481941727ff69d6f240b9 HTTP/1.1" 200 None 2026-03-15 21:29:02,562 - lava_callback - DEBUG - Processing node 69b481941727ff69d6f240b9: baseline-arm64-clabbe 2026-03-15 21:29:02,562 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b481941727ff69d6f240b9 2026-03-15 21:29:02,562 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 21:29:02,577 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b481941727ff69d6f240b9 HTTP/1.1" 200 None 2026-03-15 21:29:02,578 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 21:29:02,596 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aeba41feb96b28aa34a78b HTTP/1.1" 200 None 2026-03-15 21:29:02,598 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 21:29:02,619 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b481941727ff69d6f240b9 HTTP/1.1" 200 None 2026-03-15 21:29:02,620 - lava_callback - ERROR - Error processing callback for node 69b481941727ff69d6f240b9: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:60894 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51372 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51380 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:51388 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38818 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58040 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38644 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49402 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38450 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46660 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46676 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:46688 - "GET / HTTP/1.0" 200 OK 2026-03-15 21:30:22,595 - lava_callback - INFO - Received callback for node 69b481e91727ff69d6f240c6 INFO: 172.21.0.1:50510 - "POST /node/69b481e91727ff69d6f240c6 HTTP/1.0" 202 Accepted 2026-03-15 21:30:22,601 - lava_callback - INFO - Starting async job submit for node 69b481e91727ff69d6f240c6 2026-03-15 21:30:22,602 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 21:30:22,646 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b481e91727ff69d6f240c6 HTTP/1.1" 200 None 2026-03-15 21:30:22,647 - lava_callback - DEBUG - Processing node 69b481e91727ff69d6f240c6: baseline-arm64-clabbe 2026-03-15 21:30:22,648 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b481e91727ff69d6f240c6 2026-03-15 21:30:22,648 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 21:30:22,662 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b481e91727ff69d6f240c6 HTTP/1.1" 200 None 2026-03-15 21:30:22,663 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 21:30:22,684 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b3c8061727ff69d6f21d98 HTTP/1.1" 200 None 2026-03-15 21:30:22,686 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 21:30:22,733 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b481e91727ff69d6f240c6 HTTP/1.1" 200 None 2026-03-15 21:30:22,735 - lava_callback - ERROR - Error processing callback for node 69b481e91727ff69d6f240c6: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:50518 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36104 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49294 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51796 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53116 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59498 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59504 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:59506 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40158 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57930 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52166 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51074 - "GET / HTTP/1.0" 200 OK 2026-03-15 21:32:02,648 - lava_callback - INFO - Received callback for node 69b4823f1727ff69d6f240d3 INFO: 172.21.0.1:41506 - "POST /node/69b4823f1727ff69d6f240d3 HTTP/1.0" 202 Accepted 2026-03-15 21:32:02,654 - lava_callback - INFO - Starting async job submit for node 69b4823f1727ff69d6f240d3 2026-03-15 21:32:02,655 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 21:32:02,670 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b4823f1727ff69d6f240d3 HTTP/1.1" 200 None 2026-03-15 21:32:02,670 - lava_callback - DEBUG - Processing node 69b4823f1727ff69d6f240d3: baseline-arm64-clabbe 2026-03-15 21:32:02,671 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b4823f1727ff69d6f240d3 2026-03-15 21:32:02,671 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 21:32:02,687 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b4823f1727ff69d6f240d3 HTTP/1.1" 200 None 2026-03-15 21:32:02,689 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 21:32:02,702 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b3c8061727ff69d6f21d98 HTTP/1.1" 200 None 2026-03-15 21:32:02,704 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 21:32:02,726 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b4823f1727ff69d6f240d3 HTTP/1.1" 200 None 2026-03-15 21:32:02,732 - lava_callback - ERROR - Error processing callback for node 69b4823f1727ff69d6f240d3: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:41510 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38072 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38086 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:38100 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60544 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40742 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53850 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39280 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48372 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45116 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45120 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:45128 - "GET / HTTP/1.0" 200 OK 2026-03-15 21:33:22,666 - lava_callback - INFO - Received callback for node 69b482921727ff69d6f240df INFO: 172.21.0.1:60302 - "POST /node/69b482921727ff69d6f240df HTTP/1.0" 202 Accepted 2026-03-15 21:33:22,671 - lava_callback - INFO - Starting async job submit for node 69b482921727ff69d6f240df 2026-03-15 21:33:22,672 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 21:33:22,690 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b482921727ff69d6f240df HTTP/1.1" 200 None 2026-03-15 21:33:22,691 - lava_callback - DEBUG - Processing node 69b482921727ff69d6f240df: baseline-arm64-clabbe 2026-03-15 21:33:22,692 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b482921727ff69d6f240df 2026-03-15 21:33:22,692 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 21:33:22,708 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b482921727ff69d6f240df HTTP/1.1" 200 None 2026-03-15 21:33:22,711 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 21:33:22,725 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b3c8061727ff69d6f21d98 HTTP/1.1" 200 None 2026-03-15 21:33:22,727 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 21:33:22,748 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b482921727ff69d6f240df HTTP/1.1" 200 None 2026-03-15 21:33:22,756 - lava_callback - ERROR - Error processing callback for node 69b482921727ff69d6f240df: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:60316 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50580 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57450 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44676 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51368 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33176 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33178 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:33192 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34450 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40886 - "GET / HTTP/1.0" 200 OK 2026-03-15 21:34:42,703 - lava_callback - INFO - Received callback for node 69b482e61727ff69d6f240fd INFO: 172.21.0.1:48650 - "POST /node/69b482e61727ff69d6f240fd HTTP/1.0" 202 Accepted 2026-03-15 21:34:42,708 - lava_callback - INFO - Starting async job submit for node 69b482e61727ff69d6f240fd 2026-03-15 21:34:42,709 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 21:34:42,724 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b482e61727ff69d6f240fd HTTP/1.1" 200 None 2026-03-15 21:34:42,725 - lava_callback - DEBUG - Processing node 69b482e61727ff69d6f240fd: baseline-arm64-clabbe 2026-03-15 21:34:42,725 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b482e61727ff69d6f240fd 2026-03-15 21:34:42,726 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 21:34:42,740 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b482e61727ff69d6f240fd HTTP/1.1" 200 None 2026-03-15 21:34:42,741 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 21:34:42,757 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b3c8061727ff69d6f21d98 HTTP/1.1" 200 None 2026-03-15 21:34:42,758 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 21:34:42,785 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b482e61727ff69d6f240fd HTTP/1.1" 200 None 2026-03-15 21:34:42,794 - lava_callback - ERROR - Error processing callback for node 69b482e61727ff69d6f240fd: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:48654 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45054 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33780 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40526 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40538 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:40552 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60190 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33010 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37864 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55462 - "GET / HTTP/1.0" 200 OK 2026-03-15 21:36:02,789 - lava_callback - INFO - Received callback for node 69b483321727ff69d6f2410a INFO: 172.21.0.1:41880 - "POST /node/69b483321727ff69d6f2410a HTTP/1.0" 202 Accepted 2026-03-15 21:36:02,795 - lava_callback - INFO - Starting async job submit for node 69b483321727ff69d6f2410a 2026-03-15 21:36:02,796 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 21:36:02,835 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b483321727ff69d6f2410a HTTP/1.1" 200 None 2026-03-15 21:36:02,835 - lava_callback - DEBUG - Processing node 69b483321727ff69d6f2410a: baseline-arm64-clabbe 2026-03-15 21:36:02,836 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b483321727ff69d6f2410a 2026-03-15 21:36:02,836 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 21:36:02,850 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b483321727ff69d6f2410a HTTP/1.1" 200 None 2026-03-15 21:36:02,851 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 21:36:02,865 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b3c8061727ff69d6f21d98 HTTP/1.1" 200 None 2026-03-15 21:36:02,866 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 21:36:02,896 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b483321727ff69d6f2410a HTTP/1.1" 200 None 2026-03-15 21:36:02,897 - lava_callback - ERROR - Error processing callback for node 69b483321727ff69d6f2410a: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:41886 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37030 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37038 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:37052 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51512 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47220 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44120 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41402 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47476 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38054 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38062 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:38078 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34174 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59646 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50334 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33656 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55976 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58134 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58146 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:58156 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37690 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47566 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49454 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39044 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33480 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48650 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48666 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:48678 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53650 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55878 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52112 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48174 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35568 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49270 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49272 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:49286 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34268 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34532 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33774 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37648 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46882 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49424 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49430 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:49444 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42992 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33906 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53294 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47834 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54932 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48876 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48878 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:48892 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37420 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52500 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:32958 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54256 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42492 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51978 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51980 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:51990 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57152 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41114 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40190 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48066 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50220 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48216 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48230 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:48236 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41184 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38472 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38592 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34126 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59600 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43200 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43216 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:43226 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46114 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60906 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50332 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54384 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44222 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55144 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55154 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:55162 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33024 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60074 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49130 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42952 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35386 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:32844 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:32852 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:32860 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54634 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53732 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42892 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42098 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46280 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45608 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45620 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:45626 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57132 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49336 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38514 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51950 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49726 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48166 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48182 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:48186 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47366 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58500 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47722 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47690 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38382 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56534 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56540 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:56548 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47942 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38190 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49634 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51750 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49078 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50952 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50954 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:50960 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42462 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41508 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34158 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50278 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50850 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47742 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47748 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:47752 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55832 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47260 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58980 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59664 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50676 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45030 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45034 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:45044 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59584 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47046 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59746 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55488 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44112 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53138 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53146 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:53156 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50498 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42726 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55062 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51870 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55350 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48562 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48570 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:48576 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56038 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59754 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35848 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42720 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45228 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60506 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60522 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:60536 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48332 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46486 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60934 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40796 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46960 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42956 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42958 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:42966 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54420 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42506 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33306 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41980 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56132 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45498 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45500 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:45506 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56638 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34190 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43106 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39996 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53382 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44042 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44056 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:44058 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42902 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55434 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43838 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56322 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56092 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43322 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43330 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:43338 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44548 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59188 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51714 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40658 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47618 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41636 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41638 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:41652 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35402 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46668 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33266 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51704 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50424 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40724 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40728 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:40736 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45898 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46806 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50590 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38718 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47174 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56202 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56216 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:56222 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36892 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37414 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56458 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54142 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48362 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39780 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39788 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:39802 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49816 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49502 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57202 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41972 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48408 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35498 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35500 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:35504 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43208 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37192 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48734 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36460 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34630 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53134 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53146 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:53152 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:32796 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57302 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42890 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35552 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54996 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56086 - "GET / HTTP/1.0" 200 OK 2026-03-15 22:07:13,388 - lava_callback - INFO - Received callback for node 69b48a811727ff69d6f24153 INFO: 172.21.0.1:56096 - "POST /node/69b48a811727ff69d6f24153 HTTP/1.0" 202 Accepted 2026-03-15 22:07:13,394 - lava_callback - INFO - Starting async job submit for node 69b48a811727ff69d6f24153 2026-03-15 22:07:13,394 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 22:07:13,442 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b48a811727ff69d6f24153 HTTP/1.1" 200 None 2026-03-15 22:07:13,443 - lava_callback - DEBUG - Processing node 69b48a811727ff69d6f24153: baseline-arm64-baylibre 2026-03-15 22:07:13,443 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b48a811727ff69d6f24153 2026-03-15 22:07:13,444 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 22:07:13,458 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b48a811727ff69d6f24153 HTTP/1.1" 200 None 2026-03-15 22:07:13,460 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 22:07:13,473 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b125a3a870a1dc3343ba94 HTTP/1.1" 200 None 2026-03-15 22:07:13,475 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 22:07:13,515 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b48a811727ff69d6f24153 HTTP/1.1" 200 None 2026-03-15 22:07:13,522 - lava_callback - ERROR - Error processing callback for node 69b48a811727ff69d6f24153: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:56104 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:56114 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52206 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52414 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39750 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54242 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60342 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52382 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52384 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:52386 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49902 - "GET / HTTP/1.0" 200 OK 2026-03-15 22:08:33,717 - lava_callback - INFO - Received callback for node 69b48ad31727ff69d6f24161 INFO: 172.21.0.1:59894 - "POST /node/69b48ad31727ff69d6f24161 HTTP/1.0" 202 Accepted 2026-03-15 22:08:33,723 - lava_callback - INFO - Starting async job submit for node 69b48ad31727ff69d6f24161 2026-03-15 22:08:33,724 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 22:08:33,739 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b48ad31727ff69d6f24161 HTTP/1.1" 200 None 2026-03-15 22:08:33,740 - lava_callback - DEBUG - Processing node 69b48ad31727ff69d6f24161: baseline-arm64-baylibre 2026-03-15 22:08:33,740 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b48ad31727ff69d6f24161 2026-03-15 22:08:33,741 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 22:08:33,756 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b48ad31727ff69d6f24161 HTTP/1.1" 200 None 2026-03-15 22:08:33,758 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 22:08:33,773 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b125a3a870a1dc3343ba94 HTTP/1.1" 200 None 2026-03-15 22:08:33,774 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 22:08:33,795 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b48ad31727ff69d6f24161 HTTP/1.1" 200 None 2026-03-15 22:08:33,801 - lava_callback - ERROR - Error processing callback for node 69b48ad31727ff69d6f24161: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:59896 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54204 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47742 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45002 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53956 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53970 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:53980 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51536 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45934 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33038 - "GET / HTTP/1.0" 200 OK 2026-03-15 22:09:53,555 - lava_callback - INFO - Received callback for node 69b48b251727ff69d6f24167 INFO: 172.21.0.1:53344 - "POST /node/69b48b251727ff69d6f24167 HTTP/1.0" 202 Accepted 2026-03-15 22:09:53,560 - lava_callback - INFO - Starting async job submit for node 69b48b251727ff69d6f24167 2026-03-15 22:09:53,561 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 22:09:53,578 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b48b251727ff69d6f24167 HTTP/1.1" 200 None 2026-03-15 22:09:53,579 - lava_callback - DEBUG - Processing node 69b48b251727ff69d6f24167: baseline-arm64-baylibre 2026-03-15 22:09:53,579 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b48b251727ff69d6f24167 2026-03-15 22:09:53,580 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 22:09:53,603 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b48b251727ff69d6f24167 HTTP/1.1" 200 None 2026-03-15 22:09:53,605 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 22:09:53,634 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b125a3a870a1dc3343ba94 HTTP/1.1" 200 None 2026-03-15 22:09:53,635 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 22:09:53,663 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b48b251727ff69d6f24167 HTTP/1.1" 200 None 2026-03-15 22:09:53,665 - lava_callback - ERROR - Error processing callback for node 69b48b251727ff69d6f24167: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:53352 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34380 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55474 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55476 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:55482 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36072 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43442 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36258 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39510 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33694 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48886 - "GET / HTTP/1.0" 200 OK 2026-03-15 22:11:13,598 - lava_callback - INFO - Received callback for node 69b48b781727ff69d6f24179 INFO: 172.21.0.1:48892 - "POST /node/69b48b781727ff69d6f24179 HTTP/1.0" 202 Accepted 2026-03-15 22:11:13,603 - lava_callback - INFO - Starting async job submit for node 69b48b781727ff69d6f24179 2026-03-15 22:11:13,604 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 22:11:13,635 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b48b781727ff69d6f24179 HTTP/1.1" 200 None 2026-03-15 22:11:13,636 - lava_callback - DEBUG - Processing node 69b48b781727ff69d6f24179: baseline-arm64-baylibre 2026-03-15 22:11:13,636 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b48b781727ff69d6f24179 2026-03-15 22:11:13,637 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 22:11:13,650 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b48b781727ff69d6f24179 HTTP/1.1" 200 None 2026-03-15 22:11:13,652 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 22:11:13,686 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b125a3a870a1dc3343ba94 HTTP/1.1" 200 None 2026-03-15 22:11:13,688 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 22:11:13,732 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b48b781727ff69d6f24179 HTTP/1.1" 200 None 2026-03-15 22:11:13,744 - lava_callback - ERROR - Error processing callback for node 69b48b781727ff69d6f24179: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:48906 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:48910 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54938 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38228 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41128 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42328 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42102 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37586 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37592 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:37606 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41784 - "GET / HTTP/1.0" 200 OK 2026-03-15 22:12:33,828 - lava_callback - INFO - Received callback for node 69b48bca1727ff69d6f24188 INFO: 172.21.0.1:54356 - "POST /node/69b48bca1727ff69d6f24188 HTTP/1.0" 202 Accepted 2026-03-15 22:12:33,834 - lava_callback - INFO - Starting async job submit for node 69b48bca1727ff69d6f24188 2026-03-15 22:12:33,835 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 22:12:33,867 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b48bca1727ff69d6f24188 HTTP/1.1" 200 None 2026-03-15 22:12:33,868 - lava_callback - DEBUG - Processing node 69b48bca1727ff69d6f24188: baseline-arm64-baylibre 2026-03-15 22:12:33,868 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b48bca1727ff69d6f24188 2026-03-15 22:12:33,869 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 22:12:33,882 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b48bca1727ff69d6f24188 HTTP/1.1" 200 None 2026-03-15 22:12:33,884 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 22:12:33,898 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b125a3a870a1dc3343ba94 HTTP/1.1" 200 None 2026-03-15 22:12:33,900 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 22:12:33,924 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b48bca1727ff69d6f24188 HTTP/1.1" 200 None 2026-03-15 22:12:33,925 - lava_callback - ERROR - Error processing callback for node 69b48bca1727ff69d6f24188: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:54360 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56220 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46722 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40326 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59966 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59980 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:59988 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46746 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51970 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45450 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33040 - "GET / HTTP/1.0" 200 OK 2026-03-15 22:14:04,437 - lava_callback - INFO - Received callback for node 69b48c261727ff69d6f24197 INFO: 172.21.0.1:49266 - "POST /node/69b48c261727ff69d6f24197 HTTP/1.0" 202 Accepted 2026-03-15 22:14:04,442 - lava_callback - INFO - Starting async job submit for node 69b48c261727ff69d6f24197 2026-03-15 22:14:04,443 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 22:14:04,458 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b48c261727ff69d6f24197 HTTP/1.1" 200 None 2026-03-15 22:14:04,459 - lava_callback - DEBUG - Processing node 69b48c261727ff69d6f24197: baseline-arm64-clabbe 2026-03-15 22:14:04,459 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b48c261727ff69d6f24197 2026-03-15 22:14:04,460 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 22:14:04,482 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b48c261727ff69d6f24197 HTTP/1.1" 200 None 2026-03-15 22:14:04,484 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 22:14:04,506 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b125a3a870a1dc3343ba94 HTTP/1.1" 200 None 2026-03-15 22:14:04,508 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 22:14:04,530 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b48c261727ff69d6f24197 HTTP/1.1" 200 None 2026-03-15 22:14:04,531 - lava_callback - ERROR - Error processing callback for node 69b48c261727ff69d6f24197: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:49270 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37230 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37232 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:37238 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50904 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37142 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60100 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35058 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40238 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48208 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48216 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:48220 - "GET / HTTP/1.0" 200 OK 2026-03-15 22:15:24,463 - lava_callback - INFO - Received callback for node 69b48c791727ff69d6f241ab INFO: 172.21.0.1:60326 - "POST /node/69b48c791727ff69d6f241ab HTTP/1.0" 202 Accepted 2026-03-15 22:15:24,469 - lava_callback - INFO - Starting async job submit for node 69b48c791727ff69d6f241ab 2026-03-15 22:15:24,469 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 22:15:24,484 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b48c791727ff69d6f241ab HTTP/1.1" 200 None 2026-03-15 22:15:24,485 - lava_callback - DEBUG - Processing node 69b48c791727ff69d6f241ab: baseline-arm64-clabbe 2026-03-15 22:15:24,485 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b48c791727ff69d6f241ab 2026-03-15 22:15:24,486 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 22:15:24,506 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b48c791727ff69d6f241ab HTTP/1.1" 200 None 2026-03-15 22:15:24,507 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 22:15:24,523 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b125a3a870a1dc3343ba94 HTTP/1.1" 200 None 2026-03-15 22:15:24,524 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 22:15:24,545 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b48c791727ff69d6f241ab HTTP/1.1" 200 None 2026-03-15 22:15:24,547 - lava_callback - ERROR - Error processing callback for node 69b48c791727ff69d6f241ab: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:60340 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42672 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52608 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39376 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49016 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49694 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49698 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:49714 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33018 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45642 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54708 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44644 - "GET / HTTP/1.0" 200 OK 2026-03-15 22:17:04,592 - lava_callback - INFO - Received callback for node 69b48ccc1727ff69d6f241b9 INFO: 172.21.0.1:43794 - "POST /node/69b48ccc1727ff69d6f241b9 HTTP/1.0" 202 Accepted 2026-03-15 22:17:04,597 - lava_callback - INFO - Starting async job submit for node 69b48ccc1727ff69d6f241b9 2026-03-15 22:17:04,598 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 22:17:04,613 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b48ccc1727ff69d6f241b9 HTTP/1.1" 200 None 2026-03-15 22:17:04,614 - lava_callback - DEBUG - Processing node 69b48ccc1727ff69d6f241b9: baseline-arm64-clabbe 2026-03-15 22:17:04,614 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b48ccc1727ff69d6f241b9 2026-03-15 22:17:04,614 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 22:17:04,628 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b48ccc1727ff69d6f241b9 HTTP/1.1" 200 None 2026-03-15 22:17:04,629 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 22:17:04,642 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b125a3a870a1dc3343ba94 HTTP/1.1" 200 None 2026-03-15 22:17:04,644 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 22:17:04,665 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b48ccc1727ff69d6f241b9 HTTP/1.1" 200 None 2026-03-15 22:17:04,667 - lava_callback - ERROR - Error processing callback for node 69b48ccc1727ff69d6f241b9: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:43800 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50706 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50714 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:50716 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58450 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49194 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38408 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40956 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46100 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46104 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46120 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:46136 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38132 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38386 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41214 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51248 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43066 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56966 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56976 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:56988 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44614 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58046 - "GET / HTTP/1.0" 200 OK 2026-03-15 22:19:44,688 - lava_callback - INFO - Received callback for node 69b48d701727ff69d6f241cd INFO: 172.21.0.1:54216 - "POST /node/69b48d701727ff69d6f241cd HTTP/1.0" 202 Accepted 2026-03-15 22:19:44,693 - lava_callback - INFO - Starting async job submit for node 69b48d701727ff69d6f241cd 2026-03-15 22:19:44,694 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 22:19:44,709 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b48d701727ff69d6f241cd HTTP/1.1" 200 None 2026-03-15 22:19:44,710 - lava_callback - DEBUG - Processing node 69b48d701727ff69d6f241cd: baseline-arm64-clabbe 2026-03-15 22:19:44,710 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b48d701727ff69d6f241cd 2026-03-15 22:19:44,711 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 22:19:44,725 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b48d701727ff69d6f241cd HTTP/1.1" 200 None 2026-03-15 22:19:44,727 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 22:19:44,747 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b125a3a870a1dc3343ba94 HTTP/1.1" 200 None 2026-03-15 22:19:44,748 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 22:19:44,769 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b48d701727ff69d6f241cd HTTP/1.1" 200 None 2026-03-15 22:19:44,770 - lava_callback - ERROR - Error processing callback for node 69b48d701727ff69d6f241cd: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:54232 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43448 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58072 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50990 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50992 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:51002 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56338 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55704 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37766 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45308 - "GET / HTTP/1.0" 200 OK 2026-03-15 22:21:04,702 - lava_callback - INFO - Received callback for node 69b48dc41727ff69d6f241dc INFO: 172.21.0.1:40236 - "POST /node/69b48dc41727ff69d6f241dc HTTP/1.0" 202 Accepted 2026-03-15 22:21:04,708 - lava_callback - INFO - Starting async job submit for node 69b48dc41727ff69d6f241dc 2026-03-15 22:21:04,709 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 22:21:04,723 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b48dc41727ff69d6f241dc HTTP/1.1" 200 None 2026-03-15 22:21:04,724 - lava_callback - DEBUG - Processing node 69b48dc41727ff69d6f241dc: baseline-arm64-clabbe 2026-03-15 22:21:04,724 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b48dc41727ff69d6f241dc 2026-03-15 22:21:04,725 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 22:21:04,747 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b48dc41727ff69d6f241dc HTTP/1.1" 200 None 2026-03-15 22:21:04,749 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 22:21:04,771 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b125a3a870a1dc3343ba94 HTTP/1.1" 200 None 2026-03-15 22:21:04,772 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 22:21:04,798 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b48dc41727ff69d6f241dc HTTP/1.1" 200 None 2026-03-15 22:21:04,800 - lava_callback - ERROR - Error processing callback for node 69b48dc41727ff69d6f241dc: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:40248 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37056 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37066 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:37072 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:32960 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50586 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37964 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35230 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57748 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37412 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37418 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:37430 - "GET / HTTP/1.0" 200 OK 2026-03-15 22:22:24,867 - lava_callback - INFO - Received callback for node 69b48e171727ff69d6f241eb INFO: 172.21.0.1:34514 - "POST /node/69b48e171727ff69d6f241eb HTTP/1.0" 202 Accepted 2026-03-15 22:22:24,872 - lava_callback - INFO - Starting async job submit for node 69b48e171727ff69d6f241eb 2026-03-15 22:22:24,873 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 22:22:24,908 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b48e171727ff69d6f241eb HTTP/1.1" 200 None 2026-03-15 22:22:24,909 - lava_callback - DEBUG - Processing node 69b48e171727ff69d6f241eb: baseline-arm64-clabbe 2026-03-15 22:22:24,909 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b48e171727ff69d6f241eb 2026-03-15 22:22:24,910 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 22:22:24,934 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b48e171727ff69d6f241eb HTTP/1.1" 200 None 2026-03-15 22:22:24,936 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 22:22:24,950 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b125a3a870a1dc3343ba94 HTTP/1.1" 200 None 2026-03-15 22:22:24,951 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 22:22:24,973 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b48e171727ff69d6f241eb HTTP/1.1" 200 None 2026-03-15 22:22:24,978 - lava_callback - ERROR - Error processing callback for node 69b48e171727ff69d6f241eb: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:34530 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50892 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40402 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35110 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36418 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44726 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44734 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:44738 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46274 - "GET / HTTP/1.0" 200 OK 2026-03-15 22:23:34,264 - lava_callback - INFO - Received callback for node 69b48e641727ff69d6f241f3 INFO: 172.21.0.1:39784 - "POST /node/69b48e641727ff69d6f241f3 HTTP/1.0" 202 Accepted 2026-03-15 22:23:34,270 - lava_callback - INFO - Starting async job submit for node 69b48e641727ff69d6f241f3 2026-03-15 22:23:34,270 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 22:23:34,307 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b48e641727ff69d6f241f3 HTTP/1.1" 200 None 2026-03-15 22:23:34,308 - lava_callback - DEBUG - Processing node 69b48e641727ff69d6f241f3: baseline-arm64-baylibre 2026-03-15 22:23:34,308 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b48e641727ff69d6f241f3 2026-03-15 22:23:34,309 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 22:23:34,322 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b48e641727ff69d6f241f3 HTTP/1.1" 200 None 2026-03-15 22:23:34,323 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 22:23:34,337 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b125a3a870a1dc3343ba94 HTTP/1.1" 200 None 2026-03-15 22:23:34,338 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 22:23:34,359 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b48e641727ff69d6f241f3 HTTP/1.1" 200 None 2026-03-15 22:23:34,360 - lava_callback - ERROR - Error processing callback for node 69b48e641727ff69d6f241f3: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:39796 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51354 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42898 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43204 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50376 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50388 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:50390 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42974 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41516 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45074 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52346 - "GET / HTTP/1.0" 200 OK 2026-03-15 22:25:04,931 - lava_callback - INFO - Received callback for node 69b48ebc1727ff69d6f24202 INFO: 172.21.0.1:50648 - "POST /node/69b48ebc1727ff69d6f24202 HTTP/1.0" 202 Accepted 2026-03-15 22:25:04,936 - lava_callback - INFO - Starting async job submit for node 69b48ebc1727ff69d6f24202 2026-03-15 22:25:04,937 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 22:25:04,951 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b48ebc1727ff69d6f24202 HTTP/1.1" 200 None 2026-03-15 22:25:04,952 - lava_callback - DEBUG - Processing node 69b48ebc1727ff69d6f24202: baseline-arm64-clabbe 2026-03-15 22:25:04,953 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b48ebc1727ff69d6f24202 2026-03-15 22:25:04,953 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 22:25:04,968 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b48ebc1727ff69d6f24202 HTTP/1.1" 200 None 2026-03-15 22:25:04,970 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 22:25:04,983 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b125a3a870a1dc3343ba94 HTTP/1.1" 200 None 2026-03-15 22:25:04,985 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 22:25:05,006 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b48ebc1727ff69d6f24202 HTTP/1.1" 200 None 2026-03-15 22:25:05,015 - lava_callback - ERROR - Error processing callback for node 69b48ebc1727ff69d6f24202: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:50652 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60514 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60516 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:60532 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48422 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45128 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50350 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54614 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44994 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40770 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40786 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:40798 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47494 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47556 - "GET / HTTP/1.0" 200 OK 2026-03-15 22:26:44,973 - lava_callback - INFO - Received callback for node 69b48f101727ff69d6f24210 INFO: 172.21.0.1:39890 - "POST /node/69b48f101727ff69d6f24210 HTTP/1.0" 202 Accepted 2026-03-15 22:26:44,979 - lava_callback - INFO - Starting async job submit for node 69b48f101727ff69d6f24210 2026-03-15 22:26:44,980 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 22:26:44,994 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b48f101727ff69d6f24210 HTTP/1.1" 200 None 2026-03-15 22:26:44,995 - lava_callback - DEBUG - Processing node 69b48f101727ff69d6f24210: baseline-arm64-clabbe 2026-03-15 22:26:44,995 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b48f101727ff69d6f24210 2026-03-15 22:26:44,996 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 22:26:45,022 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b48f101727ff69d6f24210 HTTP/1.1" 200 None 2026-03-15 22:26:45,023 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 22:26:45,038 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b125a3a870a1dc3343ba94 HTTP/1.1" 200 None 2026-03-15 22:26:45,039 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 22:26:45,065 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b48f101727ff69d6f24210 HTTP/1.1" 200 None 2026-03-15 22:26:45,066 - lava_callback - ERROR - Error processing callback for node 69b48f101727ff69d6f24210: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:39898 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46412 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45842 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35430 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35440 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:35452 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58042 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57746 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36712 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38520 - "GET / HTTP/1.0" 200 OK 2026-03-15 22:28:04,991 - lava_callback - INFO - Received callback for node 69b48f651727ff69d6f2421e INFO: 172.21.0.1:38782 - "POST /node/69b48f651727ff69d6f2421e HTTP/1.0" 202 Accepted 2026-03-15 22:28:04,996 - lava_callback - INFO - Starting async job submit for node 69b48f651727ff69d6f2421e 2026-03-15 22:28:04,997 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 22:28:05,023 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b48f651727ff69d6f2421e HTTP/1.1" 200 None 2026-03-15 22:28:05,024 - lava_callback - DEBUG - Processing node 69b48f651727ff69d6f2421e: baseline-arm64-clabbe 2026-03-15 22:28:05,025 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b48f651727ff69d6f2421e 2026-03-15 22:28:05,025 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 22:28:05,039 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b48f651727ff69d6f2421e HTTP/1.1" 200 None 2026-03-15 22:28:05,040 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 22:28:05,055 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b125a3a870a1dc3343ba94 HTTP/1.1" 200 None 2026-03-15 22:28:05,056 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 22:28:05,103 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b48f651727ff69d6f2421e HTTP/1.1" 200 None 2026-03-15 22:28:05,105 - lava_callback - ERROR - Error processing callback for node 69b48f651727ff69d6f2421e: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:38792 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37174 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37188 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:37196 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59006 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34494 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38376 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59622 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34116 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50252 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50262 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:50278 - "GET / HTTP/1.0" 200 OK 2026-03-15 22:29:25,057 - lava_callback - INFO - Received callback for node 69b48fb71727ff69d6f24224 INFO: 172.21.0.1:56672 - "POST /node/69b48fb71727ff69d6f24224 HTTP/1.0" 202 Accepted 2026-03-15 22:29:25,063 - lava_callback - INFO - Starting async job submit for node 69b48fb71727ff69d6f24224 2026-03-15 22:29:25,064 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 22:29:25,103 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b48fb71727ff69d6f24224 HTTP/1.1" 200 None 2026-03-15 22:29:25,104 - lava_callback - DEBUG - Processing node 69b48fb71727ff69d6f24224: baseline-arm64-clabbe 2026-03-15 22:29:25,104 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b48fb71727ff69d6f24224 2026-03-15 22:29:25,105 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 22:29:25,131 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b48fb71727ff69d6f24224 HTTP/1.1" 200 None 2026-03-15 22:29:25,132 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 22:29:25,146 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b125a3a870a1dc3343ba94 HTTP/1.1" 200 None 2026-03-15 22:29:25,148 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 22:29:25,197 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b48fb71727ff69d6f24224 HTTP/1.1" 200 None 2026-03-15 22:29:25,199 - lava_callback - ERROR - Error processing callback for node 69b48fb71727ff69d6f24224: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:56686 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47718 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34674 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49956 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35972 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50672 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50674 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:50682 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42160 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34316 - "GET / HTTP/1.0" 200 OK 2026-03-15 22:30:45,133 - lava_callback - INFO - Received callback for node 69b4900a1727ff69d6f2422f INFO: 172.21.0.1:54432 - "POST /node/69b4900a1727ff69d6f2422f HTTP/1.0" 202 Accepted 2026-03-15 22:30:45,138 - lava_callback - INFO - Starting async job submit for node 69b4900a1727ff69d6f2422f 2026-03-15 22:30:45,139 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 22:30:45,163 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b4900a1727ff69d6f2422f HTTP/1.1" 200 None 2026-03-15 22:30:45,163 - lava_callback - DEBUG - Processing node 69b4900a1727ff69d6f2422f: baseline-arm64-clabbe 2026-03-15 22:30:45,164 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b4900a1727ff69d6f2422f 2026-03-15 22:30:45,164 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 22:30:45,183 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b4900a1727ff69d6f2422f HTTP/1.1" 200 None 2026-03-15 22:30:45,185 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 22:30:45,221 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b125a3a870a1dc3343ba94 HTTP/1.1" 200 None 2026-03-15 22:30:45,223 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 22:30:45,267 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b4900a1727ff69d6f2422f HTTP/1.1" 200 None 2026-03-15 22:30:45,273 - lava_callback - ERROR - Error processing callback for node 69b4900a1727ff69d6f2422f: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:54434 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33996 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55100 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59646 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59654 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:59662 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52388 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55292 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53144 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57792 - "GET / HTTP/1.0" 200 OK 2026-03-15 22:32:05,202 - lava_callback - INFO - Received callback for node 69b4905e1727ff69d6f2423a INFO: 172.21.0.1:39572 - "POST /node/69b4905e1727ff69d6f2423a HTTP/1.0" 202 Accepted 2026-03-15 22:32:05,207 - lava_callback - INFO - Starting async job submit for node 69b4905e1727ff69d6f2423a 2026-03-15 22:32:05,208 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 22:32:05,256 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b4905e1727ff69d6f2423a HTTP/1.1" 200 None 2026-03-15 22:32:05,256 - lava_callback - DEBUG - Processing node 69b4905e1727ff69d6f2423a: baseline-arm64-clabbe 2026-03-15 22:32:05,257 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b4905e1727ff69d6f2423a 2026-03-15 22:32:05,257 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 22:32:05,276 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b4905e1727ff69d6f2423a HTTP/1.1" 200 None 2026-03-15 22:32:05,277 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 22:32:05,290 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b125a3a870a1dc3343ba94 HTTP/1.1" 200 None 2026-03-15 22:32:05,292 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 22:32:05,339 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b4905e1727ff69d6f2423a HTTP/1.1" 200 None 2026-03-15 22:32:05,341 - lava_callback - ERROR - Error processing callback for node 69b4905e1727ff69d6f2423a: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:39588 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43826 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43838 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:43842 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55472 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52028 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38804 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43398 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59792 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57562 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57564 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:57566 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53084 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33978 - "GET / HTTP/1.0" 200 OK 2026-03-15 22:33:45,287 - lava_callback - INFO - Received callback for node 69b490b31727ff69d6f24245 INFO: 172.21.0.1:41452 - "POST /node/69b490b31727ff69d6f24245 HTTP/1.0" 202 Accepted 2026-03-15 22:33:45,292 - lava_callback - INFO - Starting async job submit for node 69b490b31727ff69d6f24245 2026-03-15 22:33:45,293 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 22:33:45,319 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b490b31727ff69d6f24245 HTTP/1.1" 200 None 2026-03-15 22:33:45,320 - lava_callback - DEBUG - Processing node 69b490b31727ff69d6f24245: baseline-arm64-clabbe 2026-03-15 22:33:45,320 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b490b31727ff69d6f24245 2026-03-15 22:33:45,321 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 22:33:45,334 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b490b31727ff69d6f24245 HTTP/1.1" 200 None 2026-03-15 22:33:45,335 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 22:33:45,348 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b125a3a870a1dc3343ba94 HTTP/1.1" 200 None 2026-03-15 22:33:45,350 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 22:33:45,375 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b490b31727ff69d6f24245 HTTP/1.1" 200 None 2026-03-15 22:33:45,380 - lava_callback - ERROR - Error processing callback for node 69b490b31727ff69d6f24245: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:41456 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41318 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50902 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49168 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49178 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:49182 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33990 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36744 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42936 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47312 - "GET / HTTP/1.0" 200 OK 2026-03-15 22:35:05,293 - lava_callback - INFO - Received callback for node 69b491061727ff69d6f24251 INFO: 172.21.0.1:48028 - "POST /node/69b491061727ff69d6f24251 HTTP/1.0" 202 Accepted 2026-03-15 22:35:05,298 - lava_callback - INFO - Starting async job submit for node 69b491061727ff69d6f24251 2026-03-15 22:35:05,299 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 22:35:05,313 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b491061727ff69d6f24251 HTTP/1.1" 200 None 2026-03-15 22:35:05,314 - lava_callback - DEBUG - Processing node 69b491061727ff69d6f24251: baseline-arm64-clabbe 2026-03-15 22:35:05,314 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b491061727ff69d6f24251 2026-03-15 22:35:05,315 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 22:35:05,338 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b491061727ff69d6f24251 HTTP/1.1" 200 None 2026-03-15 22:35:05,339 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 22:35:05,353 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b125a3a870a1dc3343ba94 HTTP/1.1" 200 None 2026-03-15 22:35:05,355 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 22:35:05,381 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b491061727ff69d6f24251 HTTP/1.1" 200 None 2026-03-15 22:35:05,382 - lava_callback - ERROR - Error processing callback for node 69b491061727ff69d6f24251: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:48038 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56324 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56328 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:56338 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50134 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35928 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60342 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51814 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42170 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54920 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54932 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:54938 - "GET / HTTP/1.0" 200 OK 2026-03-15 22:36:25,331 - lava_callback - INFO - Received callback for node 69b4915a1727ff69d6f24256 INFO: 172.21.0.1:35434 - "POST /node/69b4915a1727ff69d6f24256 HTTP/1.0" 202 Accepted 2026-03-15 22:36:25,336 - lava_callback - INFO - Starting async job submit for node 69b4915a1727ff69d6f24256 2026-03-15 22:36:25,337 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 22:36:25,378 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b4915a1727ff69d6f24256 HTTP/1.1" 200 None 2026-03-15 22:36:25,379 - lava_callback - DEBUG - Processing node 69b4915a1727ff69d6f24256: baseline-arm64-clabbe 2026-03-15 22:36:25,380 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b4915a1727ff69d6f24256 2026-03-15 22:36:25,380 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 22:36:25,399 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b4915a1727ff69d6f24256 HTTP/1.1" 200 None 2026-03-15 22:36:25,400 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 22:36:25,428 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b125a3a870a1dc3343ba94 HTTP/1.1" 200 None 2026-03-15 22:36:25,429 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 22:36:25,456 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b4915a1727ff69d6f24256 HTTP/1.1" 200 None 2026-03-15 22:36:25,457 - lava_callback - ERROR - Error processing callback for node 69b4915a1727ff69d6f24256: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:35442 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35470 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42150 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55576 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37778 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59886 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59898 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:59904 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45212 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40170 - "GET / HTTP/1.0" 200 OK 2026-03-15 22:37:45,416 - lava_callback - INFO - Received callback for node 69b491b11727ff69d6f24261 INFO: 172.21.0.1:47824 - "POST /node/69b491b11727ff69d6f24261 HTTP/1.0" 202 Accepted 2026-03-15 22:37:45,422 - lava_callback - INFO - Starting async job submit for node 69b491b11727ff69d6f24261 2026-03-15 22:37:45,422 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 22:37:45,437 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b491b11727ff69d6f24261 HTTP/1.1" 200 None 2026-03-15 22:37:45,438 - lava_callback - DEBUG - Processing node 69b491b11727ff69d6f24261: baseline-arm64-clabbe 2026-03-15 22:37:45,438 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b491b11727ff69d6f24261 2026-03-15 22:37:45,439 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 22:37:45,452 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b491b11727ff69d6f24261 HTTP/1.1" 200 None 2026-03-15 22:37:45,453 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 22:37:45,471 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b125a3a870a1dc3343ba94 HTTP/1.1" 200 None 2026-03-15 22:37:45,473 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 22:37:45,495 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b491b11727ff69d6f24261 HTTP/1.1" 200 None 2026-03-15 22:37:45,496 - lava_callback - ERROR - Error processing callback for node 69b491b11727ff69d6f24261: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:47828 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33840 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59576 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54426 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54430 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:54436 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46350 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:32802 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36246 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46190 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55132 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34582 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34592 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:34602 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41372 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58342 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40344 - "GET / HTTP/1.0" 200 OK 2026-03-15 22:39:55,148 - lava_callback - INFO - Received callback for node 69b492331727ff69d6f2426c INFO: 172.21.0.1:37026 - "POST /node/69b492331727ff69d6f2426c HTTP/1.0" 202 Accepted 2026-03-15 22:39:55,153 - lava_callback - INFO - Starting async job submit for node 69b492331727ff69d6f2426c 2026-03-15 22:39:55,154 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 22:39:55,178 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b492331727ff69d6f2426c HTTP/1.1" 200 None 2026-03-15 22:39:55,179 - lava_callback - DEBUG - Processing node 69b492331727ff69d6f2426c: baseline-arm-baylibre 2026-03-15 22:39:55,180 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b492331727ff69d6f2426c 2026-03-15 22:39:55,180 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 22:39:55,228 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b492331727ff69d6f2426c HTTP/1.1" 200 None 2026-03-15 22:39:55,230 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 22:39:55,251 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b195f7a26b422765ba3705 HTTP/1.1" 200 None 2026-03-15 22:39:55,253 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 22:39:55,280 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b492331727ff69d6f2426c HTTP/1.1" 200 None 2026-03-15 22:39:55,286 - lava_callback - ERROR - Error processing callback for node 69b492331727ff69d6f2426c: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:37030 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35284 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49724 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49736 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:49750 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54798 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43814 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44060 - "GET / HTTP/1.0" 200 OK 2026-03-15 22:40:55,166 - lava_callback - INFO - Received callback for node 69b4926f1727ff69d6f24278 INFO: 172.21.0.1:44144 - "POST /node/69b4926f1727ff69d6f24278 HTTP/1.0" 202 Accepted 2026-03-15 22:40:55,172 - lava_callback - INFO - Starting async job submit for node 69b4926f1727ff69d6f24278 2026-03-15 22:40:55,173 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 22:40:55,191 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b4926f1727ff69d6f24278 HTTP/1.1" 200 None 2026-03-15 22:40:55,192 - lava_callback - DEBUG - Processing node 69b4926f1727ff69d6f24278: baseline-arm-baylibre 2026-03-15 22:40:55,192 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b4926f1727ff69d6f24278 2026-03-15 22:40:55,193 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 22:40:55,209 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b4926f1727ff69d6f24278 HTTP/1.1" 200 None 2026-03-15 22:40:55,210 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 22:40:55,223 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b195f7a26b422765ba3705 HTTP/1.1" 200 None 2026-03-15 22:40:55,225 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 22:40:55,251 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b4926f1727ff69d6f24278 HTTP/1.1" 200 None 2026-03-15 22:40:55,254 - lava_callback - ERROR - Error processing callback for node 69b4926f1727ff69d6f24278: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:44150 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40964 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48224 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48236 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:48238 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36736 - "GET / HTTP/1.0" 200 OK 2026-03-15 22:41:35,279 - lava_callback - INFO - Received callback for node 69b492931727ff69d6f24285 INFO: 172.21.0.1:52580 - "POST /node/69b492931727ff69d6f24285 HTTP/1.0" 202 Accepted 2026-03-15 22:41:35,284 - lava_callback - INFO - Starting async job submit for node 69b492931727ff69d6f24285 2026-03-15 22:41:35,285 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 22:41:35,301 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b492931727ff69d6f24285 HTTP/1.1" 200 None 2026-03-15 22:41:35,301 - lava_callback - DEBUG - Processing node 69b492931727ff69d6f24285: baseline-arm-baylibre 2026-03-15 22:41:35,302 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b492931727ff69d6f24285 2026-03-15 22:41:35,302 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 22:41:35,315 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b492931727ff69d6f24285 HTTP/1.1" 200 None 2026-03-15 22:41:35,317 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 22:41:35,329 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b195f7a26b422765ba3705 HTTP/1.1" 200 None 2026-03-15 22:41:35,331 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 22:41:35,356 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b492931727ff69d6f24285 HTTP/1.1" 200 None 2026-03-15 22:41:35,357 - lava_callback - ERROR - Error processing callback for node 69b492931727ff69d6f24285: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:52588 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56452 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53286 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49100 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59072 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59088 - "GET /api/metrics HTTP/1.0" 200 OK 2026-03-15 22:42:15,267 - lava_callback - INFO - Received callback for node 69b492b81727ff69d6f24296 INFO: 172.21.0.1:59092 - "POST /node/69b492b81727ff69d6f24296 HTTP/1.0" 202 Accepted 2026-03-15 22:42:15,273 - lava_callback - INFO - Starting async job submit for node 69b492b81727ff69d6f24296 2026-03-15 22:42:15,274 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 22:42:15,288 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b492b81727ff69d6f24296 HTTP/1.1" 200 None 2026-03-15 22:42:15,289 - lava_callback - DEBUG - Processing node 69b492b81727ff69d6f24296: baseline-arm-baylibre 2026-03-15 22:42:15,289 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b492b81727ff69d6f24296 2026-03-15 22:42:15,290 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 22:42:15,307 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b492b81727ff69d6f24296 HTTP/1.1" 200 None 2026-03-15 22:42:15,308 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 22:42:15,336 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b195f7a26b422765ba3705 HTTP/1.1" 200 None 2026-03-15 22:42:15,337 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 22:42:15,372 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b492b81727ff69d6f24296 HTTP/1.1" 200 None 2026-03-15 22:42:15,373 - lava_callback - ERROR - Error processing callback for node 69b492b81727ff69d6f24296: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:59104 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37416 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38916 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33278 - "GET / HTTP/1.0" 200 OK 2026-03-15 22:42:55,299 - lava_callback - INFO - Received callback for node 69b492dc1727ff69d6f242a2 INFO: 172.21.0.1:57056 - "POST /node/69b492dc1727ff69d6f242a2 HTTP/1.0" 202 Accepted 2026-03-15 22:42:55,304 - lava_callback - INFO - Starting async job submit for node 69b492dc1727ff69d6f242a2 2026-03-15 22:42:55,305 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 22:42:55,328 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b492dc1727ff69d6f242a2 HTTP/1.1" 200 None 2026-03-15 22:42:55,329 - lava_callback - DEBUG - Processing node 69b492dc1727ff69d6f242a2: baseline-arm-baylibre 2026-03-15 22:42:55,329 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b492dc1727ff69d6f242a2 2026-03-15 22:42:55,330 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 22:42:55,343 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b492dc1727ff69d6f242a2 HTTP/1.1" 200 None 2026-03-15 22:42:55,345 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 22:42:55,405 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b195f7a26b422765ba3705 HTTP/1.1" 200 None 2026-03-15 22:42:55,407 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 22:42:55,435 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b492dc1727ff69d6f242a2 HTTP/1.1" 200 None 2026-03-15 22:42:55,436 - lava_callback - ERROR - Error processing callback for node 69b492dc1727ff69d6f242a2: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:57058 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34650 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48350 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48354 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:48368 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38906 - "GET / HTTP/1.0" 200 OK 2026-03-15 22:43:35,320 - lava_callback - INFO - Received callback for node 69b493021727ff69d6f242b0 INFO: 172.21.0.1:50192 - "POST /node/69b493021727ff69d6f242b0 HTTP/1.0" 202 Accepted 2026-03-15 22:43:35,326 - lava_callback - INFO - Starting async job submit for node 69b493021727ff69d6f242b0 2026-03-15 22:43:35,327 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 22:43:35,342 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b493021727ff69d6f242b0 HTTP/1.1" 200 None 2026-03-15 22:43:35,343 - lava_callback - DEBUG - Processing node 69b493021727ff69d6f242b0: baseline-arm-baylibre 2026-03-15 22:43:35,343 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b493021727ff69d6f242b0 2026-03-15 22:43:35,343 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 22:43:35,365 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b493021727ff69d6f242b0 HTTP/1.1" 200 None 2026-03-15 22:43:35,366 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 22:43:35,387 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b195f7a26b422765ba3705 HTTP/1.1" 200 None 2026-03-15 22:43:35,388 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 22:43:35,413 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b493021727ff69d6f242b0 HTTP/1.1" 200 None 2026-03-15 22:43:35,414 - lava_callback - ERROR - Error processing callback for node 69b493021727ff69d6f242b0: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:50196 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48552 - "GET / HTTP/1.0" 200 OK 2026-03-15 22:43:55,320 - lava_callback - INFO - Received callback for node 69b493261727ff69d6f242c1 INFO: 172.21.0.1:47240 - "POST /node/69b493261727ff69d6f242c1 HTTP/1.0" 202 Accepted 2026-03-15 22:43:55,326 - lava_callback - INFO - Starting async job submit for node 69b493261727ff69d6f242c1 2026-03-15 22:43:55,326 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 22:43:55,343 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b493261727ff69d6f242c1 HTTP/1.1" 200 None 2026-03-15 22:43:55,344 - lava_callback - DEBUG - Processing node 69b493261727ff69d6f242c1: baseline-arm-baylibre 2026-03-15 22:43:55,345 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b493261727ff69d6f242c1 2026-03-15 22:43:55,345 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 22:43:55,359 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b493261727ff69d6f242c1 HTTP/1.1" 200 None 2026-03-15 22:43:55,361 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 22:43:55,375 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b195f7a26b422765ba3705 HTTP/1.1" 200 None 2026-03-15 22:43:55,377 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 22:43:55,402 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b493261727ff69d6f242c1 HTTP/1.1" 200 None 2026-03-15 22:43:55,403 - lava_callback - ERROR - Error processing callback for node 69b493261727ff69d6f242c1: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:47246 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58852 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58168 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58182 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:58194 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55396 - "GET / HTTP/1.0" 200 OK 2026-03-15 22:44:35,436 - lava_callback - INFO - Received callback for node 69b4934b1727ff69d6f242cf INFO: 172.21.0.1:53546 - "POST /node/69b4934b1727ff69d6f242cf HTTP/1.0" 202 Accepted 2026-03-15 22:44:35,441 - lava_callback - INFO - Starting async job submit for node 69b4934b1727ff69d6f242cf 2026-03-15 22:44:35,442 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 22:44:35,458 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b4934b1727ff69d6f242cf HTTP/1.1" 200 None 2026-03-15 22:44:35,459 - lava_callback - DEBUG - Processing node 69b4934b1727ff69d6f242cf: baseline-arm-baylibre 2026-03-15 22:44:35,459 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b4934b1727ff69d6f242cf 2026-03-15 22:44:35,460 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 22:44:35,477 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b4934b1727ff69d6f242cf HTTP/1.1" 200 None 2026-03-15 22:44:35,478 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 22:44:35,492 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b195f7a26b422765ba3705 HTTP/1.1" 200 None 2026-03-15 22:44:35,493 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 22:44:35,514 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b4934b1727ff69d6f242cf HTTP/1.1" 200 None 2026-03-15 22:44:35,515 - lava_callback - ERROR - Error processing callback for node 69b4934b1727ff69d6f242cf: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:53550 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48418 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43492 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46830 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45118 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45130 - "GET /api/metrics HTTP/1.0" 200 OK 2026-03-15 22:45:15,529 - lava_callback - INFO - Received callback for node 69b4936f1727ff69d6f242df INFO: 172.21.0.1:45140 - "POST /node/69b4936f1727ff69d6f242df HTTP/1.0" 202 Accepted 2026-03-15 22:45:15,534 - lava_callback - INFO - Starting async job submit for node 69b4936f1727ff69d6f242df 2026-03-15 22:45:15,535 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 22:45:15,551 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b4936f1727ff69d6f242df HTTP/1.1" 200 None 2026-03-15 22:45:15,552 - lava_callback - DEBUG - Processing node 69b4936f1727ff69d6f242df: baseline-arm-baylibre 2026-03-15 22:45:15,552 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b4936f1727ff69d6f242df 2026-03-15 22:45:15,553 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 22:45:15,566 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b4936f1727ff69d6f242df HTTP/1.1" 200 None 2026-03-15 22:45:15,568 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 22:45:15,581 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b195f7a26b422765ba3705 HTTP/1.1" 200 None 2026-03-15 22:45:15,583 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 22:45:15,603 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b4936f1727ff69d6f242df HTTP/1.1" 200 None 2026-03-15 22:45:15,604 - lava_callback - ERROR - Error processing callback for node 69b4936f1727ff69d6f242df: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:45156 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48590 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49852 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43388 - "GET / HTTP/1.0" 200 OK 2026-03-15 22:45:55,842 - lava_callback - INFO - Received callback for node 69b493941727ff69d6f242e9 INFO: 172.21.0.1:52936 - "POST /node/69b493941727ff69d6f242e9 HTTP/1.0" 202 Accepted 2026-03-15 22:45:55,847 - lava_callback - INFO - Starting async job submit for node 69b493941727ff69d6f242e9 2026-03-15 22:45:55,848 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 22:45:55,863 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b493941727ff69d6f242e9 HTTP/1.1" 200 None 2026-03-15 22:45:55,864 - lava_callback - DEBUG - Processing node 69b493941727ff69d6f242e9: baseline-arm-baylibre 2026-03-15 22:45:55,864 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b493941727ff69d6f242e9 2026-03-15 22:45:55,865 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 22:45:55,880 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b493941727ff69d6f242e9 HTTP/1.1" 200 None 2026-03-15 22:45:55,881 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 22:45:55,895 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b195f7a26b422765ba3705 HTTP/1.1" 200 None 2026-03-15 22:45:55,896 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 22:45:55,917 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b493941727ff69d6f242e9 HTTP/1.1" 200 None 2026-03-15 22:45:55,918 - lava_callback - ERROR - Error processing callback for node 69b493941727ff69d6f242e9: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:52942 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56484 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58806 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58822 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:58838 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48810 - "GET / HTTP/1.0" 200 OK 2026-03-15 22:46:35,485 - lava_callback - INFO - Received callback for node 69b493b91727ff69d6f242fb INFO: 172.21.0.1:60498 - "POST /node/69b493b91727ff69d6f242fb HTTP/1.0" 202 Accepted 2026-03-15 22:46:35,491 - lava_callback - INFO - Starting async job submit for node 69b493b91727ff69d6f242fb 2026-03-15 22:46:35,491 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 22:46:35,506 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b493b91727ff69d6f242fb HTTP/1.1" 200 None 2026-03-15 22:46:35,507 - lava_callback - DEBUG - Processing node 69b493b91727ff69d6f242fb: baseline-arm-baylibre 2026-03-15 22:46:35,507 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b493b91727ff69d6f242fb 2026-03-15 22:46:35,508 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 22:46:35,521 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b493b91727ff69d6f242fb HTTP/1.1" 200 None 2026-03-15 22:46:35,522 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 22:46:35,536 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b195f7a26b422765ba3705 HTTP/1.1" 200 None 2026-03-15 22:46:35,537 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 22:46:35,568 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b493b91727ff69d6f242fb HTTP/1.1" 200 None 2026-03-15 22:46:35,569 - lava_callback - ERROR - Error processing callback for node 69b493b91727ff69d6f242fb: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:60500 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46418 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53236 - "GET / HTTP/1.0" 200 OK 2026-03-15 22:47:05,878 - lava_callback - INFO - Received callback for node 69b493e01727ff69d6f24306 INFO: 172.21.0.1:44234 - "POST /node/69b493e01727ff69d6f24306 HTTP/1.0" 202 Accepted 2026-03-15 22:47:05,886 - lava_callback - INFO - Starting async job submit for node 69b493e01727ff69d6f24306 2026-03-15 22:47:05,887 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 22:47:05,902 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b493e01727ff69d6f24306 HTTP/1.1" 200 None 2026-03-15 22:47:05,903 - lava_callback - DEBUG - Processing node 69b493e01727ff69d6f24306: baseline-arm-clabbe 2026-03-15 22:47:05,903 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b493e01727ff69d6f24306 2026-03-15 22:47:05,904 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 22:47:05,923 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b493e01727ff69d6f24306 HTTP/1.1" 200 None 2026-03-15 22:47:05,924 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 22:47:05,975 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b195f7a26b422765ba3705 HTTP/1.1" 200 None 2026-03-15 22:47:05,976 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 22:47:05,997 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b493e01727ff69d6f24306 HTTP/1.1" 200 None 2026-03-15 22:47:05,999 - lava_callback - ERROR - Error processing callback for node 69b493e01727ff69d6f24306: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:44246 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:32958 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:32964 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:32974 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47192 - "GET / HTTP/1.0" 200 OK 2026-03-15 22:47:35,554 - lava_callback - INFO - Received callback for node 69b494031727ff69d6f24313 INFO: 172.21.0.1:41458 - "POST /node/69b494031727ff69d6f24313 HTTP/1.0" 202 Accepted 2026-03-15 22:47:35,560 - lava_callback - INFO - Starting async job submit for node 69b494031727ff69d6f24313 2026-03-15 22:47:35,561 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 22:47:35,583 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b494031727ff69d6f24313 HTTP/1.1" 200 None 2026-03-15 22:47:35,584 - lava_callback - DEBUG - Processing node 69b494031727ff69d6f24313: baseline-arm-baylibre 2026-03-15 22:47:35,584 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b494031727ff69d6f24313 2026-03-15 22:47:35,585 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 22:47:35,598 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b494031727ff69d6f24313 HTTP/1.1" 200 None 2026-03-15 22:47:35,599 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 22:47:35,612 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b195f7a26b422765ba3705 HTTP/1.1" 200 None 2026-03-15 22:47:35,614 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 22:47:35,634 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b494031727ff69d6f24313 HTTP/1.1" 200 None 2026-03-15 22:47:35,639 - lava_callback - ERROR - Error processing callback for node 69b494031727ff69d6f24313: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:41468 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59276 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48098 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46590 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49328 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49338 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:49352 - "GET / HTTP/1.0" 200 OK 2026-03-15 22:48:25,895 - lava_callback - INFO - Received callback for node 69b4942a1727ff69d6f2431f INFO: 172.21.0.1:56102 - "POST /node/69b4942a1727ff69d6f2431f HTTP/1.0" 202 Accepted 2026-03-15 22:48:25,900 - lava_callback - INFO - Starting async job submit for node 69b4942a1727ff69d6f2431f 2026-03-15 22:48:25,902 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 22:48:25,925 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b4942a1727ff69d6f2431f HTTP/1.1" 200 None 2026-03-15 22:48:25,927 - lava_callback - DEBUG - Processing node 69b4942a1727ff69d6f2431f: baseline-arm-clabbe 2026-03-15 22:48:25,927 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b4942a1727ff69d6f2431f 2026-03-15 22:48:25,928 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 22:48:25,956 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b4942a1727ff69d6f2431f HTTP/1.1" 200 None 2026-03-15 22:48:25,958 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 22:48:25,972 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b195f7a26b422765ba3705 HTTP/1.1" 200 None 2026-03-15 22:48:25,974 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 22:48:25,997 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b4942a1727ff69d6f2431f HTTP/1.1" 200 None 2026-03-15 22:48:25,999 - lava_callback - ERROR - Error processing callback for node 69b4942a1727ff69d6f2431f: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:56114 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39516 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35868 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50498 - "GET / HTTP/1.0" 200 OK 2026-03-15 22:49:05,910 - lava_callback - INFO - Received callback for node 69b4944e1727ff69d6f2432e INFO: 172.21.0.1:33600 - "POST /node/69b4944e1727ff69d6f2432e HTTP/1.0" 202 Accepted 2026-03-15 22:49:05,916 - lava_callback - INFO - Starting async job submit for node 69b4944e1727ff69d6f2432e 2026-03-15 22:49:05,917 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 22:49:05,938 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b4944e1727ff69d6f2432e HTTP/1.1" 200 None 2026-03-15 22:49:05,939 - lava_callback - DEBUG - Processing node 69b4944e1727ff69d6f2432e: baseline-arm-clabbe 2026-03-15 22:49:05,939 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b4944e1727ff69d6f2432e 2026-03-15 22:49:05,940 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 22:49:05,953 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b4944e1727ff69d6f2432e HTTP/1.1" 200 None 2026-03-15 22:49:05,955 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 22:49:05,969 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b195f7a26b422765ba3705 HTTP/1.1" 200 None 2026-03-15 22:49:05,971 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 22:49:05,992 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b4944e1727ff69d6f2432e HTTP/1.1" 200 None 2026-03-15 22:49:05,993 - lava_callback - ERROR - Error processing callback for node 69b4944e1727ff69d6f2432e: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:33608 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40432 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40446 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:40462 - "GET / HTTP/1.0" 200 OK 2026-03-15 22:49:25,981 - lava_callback - INFO - Received callback for node 69b494731727ff69d6f24336 INFO: 172.21.0.1:40416 - "POST /node/69b494731727ff69d6f24336 HTTP/1.0" 202 Accepted 2026-03-15 22:49:25,986 - lava_callback - INFO - Starting async job submit for node 69b494731727ff69d6f24336 2026-03-15 22:49:25,987 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 22:49:26,007 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b494731727ff69d6f24336 HTTP/1.1" 200 None 2026-03-15 22:49:26,008 - lava_callback - DEBUG - Processing node 69b494731727ff69d6f24336: baseline-arm-clabbe 2026-03-15 22:49:26,008 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b494731727ff69d6f24336 2026-03-15 22:49:26,009 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 22:49:26,024 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b494731727ff69d6f24336 HTTP/1.1" 200 None 2026-03-15 22:49:26,025 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 22:49:26,046 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b195f7a26b422765ba3705 HTTP/1.1" 200 None 2026-03-15 22:49:26,048 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 22:49:26,074 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b494731727ff69d6f24336 HTTP/1.1" 200 None 2026-03-15 22:49:26,079 - lava_callback - ERROR - Error processing callback for node 69b494731727ff69d6f24336: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:40428 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36166 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48788 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58506 - "GET / HTTP/1.0" 200 OK 2026-03-15 22:50:05,923 - lava_callback - INFO - Received callback for node 69b494971727ff69d6f24342 INFO: 172.21.0.1:34926 - "POST /node/69b494971727ff69d6f24342 HTTP/1.0" 202 Accepted 2026-03-15 22:50:05,928 - lava_callback - INFO - Starting async job submit for node 69b494971727ff69d6f24342 2026-03-15 22:50:05,929 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 22:50:05,944 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b494971727ff69d6f24342 HTTP/1.1" 200 None 2026-03-15 22:50:05,944 - lava_callback - DEBUG - Processing node 69b494971727ff69d6f24342: baseline-arm-clabbe 2026-03-15 22:50:05,945 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b494971727ff69d6f24342 2026-03-15 22:50:05,945 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 22:50:05,963 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b494971727ff69d6f24342 HTTP/1.1" 200 None 2026-03-15 22:50:05,965 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 22:50:05,979 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b195f7a26b422765ba3705 HTTP/1.1" 200 None 2026-03-15 22:50:05,980 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 22:50:06,007 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b494971727ff69d6f24342 HTTP/1.1" 200 None 2026-03-15 22:50:06,014 - lava_callback - ERROR - Error processing callback for node 69b494971727ff69d6f24342: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:34932 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39482 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39484 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:39492 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52720 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44308 - "GET / HTTP/1.0" 200 OK 2026-03-15 22:50:45,965 - lava_callback - INFO - Received callback for node 69b494bb1727ff69d6f2434c INFO: 172.21.0.1:35120 - "POST /node/69b494bb1727ff69d6f2434c HTTP/1.0" 202 Accepted 2026-03-15 22:50:45,970 - lava_callback - INFO - Starting async job submit for node 69b494bb1727ff69d6f2434c 2026-03-15 22:50:45,971 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 22:50:45,986 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b494bb1727ff69d6f2434c HTTP/1.1" 200 None 2026-03-15 22:50:45,986 - lava_callback - DEBUG - Processing node 69b494bb1727ff69d6f2434c: baseline-arm-clabbe 2026-03-15 22:50:45,987 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b494bb1727ff69d6f2434c 2026-03-15 22:50:45,987 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 22:50:46,026 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b494bb1727ff69d6f2434c HTTP/1.1" 200 None 2026-03-15 22:50:46,028 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 22:50:46,041 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b195f7a26b422765ba3705 HTTP/1.1" 200 None 2026-03-15 22:50:46,043 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 22:50:46,086 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b494bb1727ff69d6f2434c HTTP/1.1" 200 None 2026-03-15 22:50:46,087 - lava_callback - ERROR - Error processing callback for node 69b494bb1727ff69d6f2434c: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:35132 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58230 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55280 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43362 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43370 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:43380 - "GET / HTTP/1.0" 200 OK 2026-03-15 22:51:26,018 - lava_callback - INFO - Received callback for node 69b494de1727ff69d6f24356 INFO: 172.21.0.1:48950 - "POST /node/69b494de1727ff69d6f24356 HTTP/1.0" 202 Accepted 2026-03-15 22:51:26,023 - lava_callback - INFO - Starting async job submit for node 69b494de1727ff69d6f24356 2026-03-15 22:51:26,024 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 22:51:26,048 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b494de1727ff69d6f24356 HTTP/1.1" 200 None 2026-03-15 22:51:26,048 - lava_callback - DEBUG - Processing node 69b494de1727ff69d6f24356: baseline-arm-clabbe 2026-03-15 22:51:26,049 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b494de1727ff69d6f24356 2026-03-15 22:51:26,049 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 22:51:26,063 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b494de1727ff69d6f24356 HTTP/1.1" 200 None 2026-03-15 22:51:26,065 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 22:51:26,078 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b195f7a26b422765ba3705 HTTP/1.1" 200 None 2026-03-15 22:51:26,080 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 22:51:26,106 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b494de1727ff69d6f24356 HTTP/1.1" 200 None 2026-03-15 22:51:26,107 - lava_callback - ERROR - Error processing callback for node 69b494de1727ff69d6f24356: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:48962 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36696 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53304 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59060 - "GET / HTTP/1.0" 200 OK 2026-03-15 22:52:06,088 - lava_callback - INFO - Received callback for node 69b495011727ff69d6f24363 INFO: 172.21.0.1:33898 - "POST /node/69b495011727ff69d6f24363 HTTP/1.0" 202 Accepted 2026-03-15 22:52:06,094 - lava_callback - INFO - Starting async job submit for node 69b495011727ff69d6f24363 2026-03-15 22:52:06,095 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 22:52:06,110 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b495011727ff69d6f24363 HTTP/1.1" 200 None 2026-03-15 22:52:06,111 - lava_callback - DEBUG - Processing node 69b495011727ff69d6f24363: baseline-arm-clabbe 2026-03-15 22:52:06,111 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b495011727ff69d6f24363 2026-03-15 22:52:06,112 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 22:52:06,125 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b495011727ff69d6f24363 HTTP/1.1" 200 None 2026-03-15 22:52:06,127 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 22:52:06,140 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b195f7a26b422765ba3705 HTTP/1.1" 200 None 2026-03-15 22:52:06,142 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 22:52:06,163 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b495011727ff69d6f24363 HTTP/1.1" 200 None 2026-03-15 22:52:06,167 - lava_callback - ERROR - Error processing callback for node 69b495011727ff69d6f24363: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:33902 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49890 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49904 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:49918 - "GET / HTTP/1.0" 200 OK 2026-03-15 22:52:26,033 - lava_callback - INFO - Received callback for node 69b495251727ff69d6f2436f INFO: 172.21.0.1:41196 - "POST /node/69b495251727ff69d6f2436f HTTP/1.0" 202 Accepted 2026-03-15 22:52:26,038 - lava_callback - INFO - Starting async job submit for node 69b495251727ff69d6f2436f 2026-03-15 22:52:26,039 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 22:52:26,053 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b495251727ff69d6f2436f HTTP/1.1" 200 None 2026-03-15 22:52:26,054 - lava_callback - DEBUG - Processing node 69b495251727ff69d6f2436f: baseline-arm-clabbe 2026-03-15 22:52:26,054 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b495251727ff69d6f2436f 2026-03-15 22:52:26,055 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 22:52:26,070 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b495251727ff69d6f2436f HTTP/1.1" 200 None 2026-03-15 22:52:26,072 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 22:52:26,087 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b195f7a26b422765ba3705 HTTP/1.1" 200 None 2026-03-15 22:52:26,089 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 22:52:26,116 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b495251727ff69d6f2436f HTTP/1.1" 200 None 2026-03-15 22:52:26,122 - lava_callback - ERROR - Error processing callback for node 69b495251727ff69d6f2436f: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:41206 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60004 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36334 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51854 - "GET / HTTP/1.0" 200 OK 2026-03-15 22:53:06,065 - lava_callback - INFO - Received callback for node 69b495491727ff69d6f24377 INFO: 172.21.0.1:45146 - "POST /node/69b495491727ff69d6f24377 HTTP/1.0" 202 Accepted 2026-03-15 22:53:06,071 - lava_callback - INFO - Starting async job submit for node 69b495491727ff69d6f24377 2026-03-15 22:53:06,072 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 22:53:06,086 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b495491727ff69d6f24377 HTTP/1.1" 200 None 2026-03-15 22:53:06,087 - lava_callback - DEBUG - Processing node 69b495491727ff69d6f24377: baseline-arm-clabbe 2026-03-15 22:53:06,087 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b495491727ff69d6f24377 2026-03-15 22:53:06,088 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 22:53:06,101 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b495491727ff69d6f24377 HTTP/1.1" 200 None 2026-03-15 22:53:06,102 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 22:53:06,116 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b195f7a26b422765ba3705 HTTP/1.1" 200 None 2026-03-15 22:53:06,117 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 22:53:06,139 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b495491727ff69d6f24377 HTTP/1.1" 200 None 2026-03-15 22:53:06,141 - lava_callback - ERROR - Error processing callback for node 69b495491727ff69d6f24377: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:45148 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56850 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56858 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:56862 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42682 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44348 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58542 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36406 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38302 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48960 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48968 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:48982 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35400 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53016 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52252 - "GET / HTTP/1.0" 200 OK 2026-03-15 22:54:56,264 - lava_callback - INFO - Received callback for node 69b495b11727ff69d6f24386 INFO: 172.21.0.1:45106 - "POST /node/69b495b11727ff69d6f24386 HTTP/1.0" 202 Accepted 2026-03-15 22:54:56,269 - lava_callback - INFO - Starting async job submit for node 69b495b11727ff69d6f24386 2026-03-15 22:54:56,270 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 22:54:56,285 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b495b11727ff69d6f24386 HTTP/1.1" 200 None 2026-03-15 22:54:56,286 - lava_callback - DEBUG - Processing node 69b495b11727ff69d6f24386: baseline-arm-baylibre 2026-03-15 22:54:56,286 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b495b11727ff69d6f24386 2026-03-15 22:54:56,287 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 22:54:56,302 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b495b11727ff69d6f24386 HTTP/1.1" 200 None 2026-03-15 22:54:56,304 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 22:54:56,318 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aef424ce46d8ec186ab80e HTTP/1.1" 200 None 2026-03-15 22:54:56,319 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 22:54:56,340 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b495b11727ff69d6f24386 HTTP/1.1" 200 None 2026-03-15 22:54:56,349 - lava_callback - ERROR - Error processing callback for node 69b495b11727ff69d6f24386: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:45120 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48730 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45750 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45758 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:45760 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34882 - "GET / HTTP/1.0" 200 OK 2026-03-15 22:55:35,910 - lava_callback - INFO - Received callback for node 69b495da1727ff69d6f24395 INFO: 172.21.0.1:42278 - "POST /node/69b495da1727ff69d6f24395 HTTP/1.0" 202 Accepted 2026-03-15 22:55:35,916 - lava_callback - INFO - Starting async job submit for node 69b495da1727ff69d6f24395 2026-03-15 22:55:35,917 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 22:55:35,931 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b495da1727ff69d6f24395 HTTP/1.1" 200 None 2026-03-15 22:55:35,932 - lava_callback - DEBUG - Processing node 69b495da1727ff69d6f24395: baseline-arm-baylibre 2026-03-15 22:55:35,933 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b495da1727ff69d6f24395 2026-03-15 22:55:35,933 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 22:55:35,947 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b495da1727ff69d6f24395 HTTP/1.1" 200 None 2026-03-15 22:55:35,948 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 22:55:35,961 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aef424ce46d8ec186ab80e HTTP/1.1" 200 None 2026-03-15 22:55:35,963 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 22:55:35,984 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b495da1727ff69d6f24395 HTTP/1.1" 200 None 2026-03-15 22:55:35,985 - lava_callback - ERROR - Error processing callback for node 69b495da1727ff69d6f24395: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:42288 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48146 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39410 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53330 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50686 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50692 - "GET /api/metrics HTTP/1.0" 200 OK 2026-03-15 22:56:16,312 - lava_callback - INFO - Received callback for node 69b496021727ff69d6f243a0 INFO: 172.21.0.1:50708 - "POST /node/69b496021727ff69d6f243a0 HTTP/1.0" 202 Accepted 2026-03-15 22:56:16,318 - lava_callback - INFO - Starting async job submit for node 69b496021727ff69d6f243a0 2026-03-15 22:56:16,319 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 22:56:16,333 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b496021727ff69d6f243a0 HTTP/1.1" 200 None 2026-03-15 22:56:16,334 - lava_callback - DEBUG - Processing node 69b496021727ff69d6f243a0: baseline-arm-baylibre 2026-03-15 22:56:16,334 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b496021727ff69d6f243a0 2026-03-15 22:56:16,335 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 22:56:16,348 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b496021727ff69d6f243a0 HTTP/1.1" 200 None 2026-03-15 22:56:16,350 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 22:56:16,363 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aef424ce46d8ec186ab80e HTTP/1.1" 200 None 2026-03-15 22:56:16,365 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 22:56:16,385 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b496021727ff69d6f243a0 HTTP/1.1" 200 None 2026-03-15 22:56:16,387 - lava_callback - ERROR - Error processing callback for node 69b496021727ff69d6f243a0: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:50720 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38912 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35116 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59428 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38418 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35752 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54250 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54258 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:54268 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59418 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35462 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44574 - "GET / HTTP/1.0" 200 OK 2026-03-15 22:57:56,096 - lava_callback - INFO - Received callback for node 69b496671727ff69d6f243b1 INFO: 172.21.0.1:44582 - "POST /node/69b496671727ff69d6f243b1 HTTP/1.0" 202 Accepted 2026-03-15 22:57:56,101 - lava_callback - INFO - Starting async job submit for node 69b496671727ff69d6f243b1 2026-03-15 22:57:56,102 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 22:57:56,117 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b496671727ff69d6f243b1 HTTP/1.1" 200 None 2026-03-15 22:57:56,118 - lava_callback - DEBUG - Processing node 69b496671727ff69d6f243b1: baseline-arm-baylibre 2026-03-15 22:57:56,118 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b496671727ff69d6f243b1 2026-03-15 22:57:56,118 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 22:57:56,136 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b496671727ff69d6f243b1 HTTP/1.1" 200 None 2026-03-15 22:57:56,138 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 22:57:56,156 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aef424ce46d8ec186ab80e HTTP/1.1" 200 None 2026-03-15 22:57:56,158 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 22:57:56,180 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b496671727ff69d6f243b1 HTTP/1.1" 200 None 2026-03-15 22:57:56,185 - lava_callback - ERROR - Error processing callback for node 69b496671727ff69d6f243b1: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:44590 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34040 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54568 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54576 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:54590 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33734 - "GET / HTTP/1.0" 200 OK 2026-03-15 22:58:36,117 - lava_callback - INFO - Received callback for node 69b496901727ff69d6f243bc INFO: 172.21.0.1:58224 - "POST /node/69b496901727ff69d6f243bc HTTP/1.0" 202 Accepted 2026-03-15 22:58:36,123 - lava_callback - INFO - Starting async job submit for node 69b496901727ff69d6f243bc 2026-03-15 22:58:36,124 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 22:58:36,159 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b496901727ff69d6f243bc HTTP/1.1" 200 None 2026-03-15 22:58:36,160 - lava_callback - DEBUG - Processing node 69b496901727ff69d6f243bc: baseline-arm-baylibre 2026-03-15 22:58:36,160 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b496901727ff69d6f243bc 2026-03-15 22:58:36,161 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 22:58:36,175 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b496901727ff69d6f243bc HTTP/1.1" 200 None 2026-03-15 22:58:36,176 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 22:58:36,190 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aef424ce46d8ec186ab80e HTTP/1.1" 200 None 2026-03-15 22:58:36,192 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 22:58:36,213 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b496901727ff69d6f243bc HTTP/1.1" 200 None 2026-03-15 22:58:36,219 - lava_callback - ERROR - Error processing callback for node 69b496901727ff69d6f243bc: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:58226 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54468 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59468 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36100 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38476 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38488 - "GET /api/metrics HTTP/1.0" 200 OK 2026-03-15 22:59:16,178 - lava_callback - INFO - Received callback for node 69b496b91727ff69d6f243c9 INFO: 172.21.0.1:38496 - "POST /node/69b496b91727ff69d6f243c9 HTTP/1.0" 202 Accepted 2026-03-15 22:59:16,184 - lava_callback - INFO - Starting async job submit for node 69b496b91727ff69d6f243c9 2026-03-15 22:59:16,185 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 22:59:16,244 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b496b91727ff69d6f243c9 HTTP/1.1" 200 None 2026-03-15 22:59:16,245 - lava_callback - DEBUG - Processing node 69b496b91727ff69d6f243c9: baseline-arm-baylibre 2026-03-15 22:59:16,245 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b496b91727ff69d6f243c9 2026-03-15 22:59:16,246 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 22:59:16,259 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b496b91727ff69d6f243c9 HTTP/1.1" 200 None 2026-03-15 22:59:16,261 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 22:59:16,274 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aef424ce46d8ec186ab80e HTTP/1.1" 200 None 2026-03-15 22:59:16,276 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 22:59:16,305 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b496b91727ff69d6f243c9 HTTP/1.1" 200 None 2026-03-15 22:59:16,306 - lava_callback - ERROR - Error processing callback for node 69b496b91727ff69d6f243c9: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:38506 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49760 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44664 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40080 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46374 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45506 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41330 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41338 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:41354 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35430 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59802 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54340 - "GET / HTTP/1.0" 200 OK 2026-03-15 23:00:56,318 - lava_callback - INFO - Received callback for node 69b497211727ff69d6f243d9 INFO: 172.21.0.1:60658 - "POST /node/69b497211727ff69d6f243d9 HTTP/1.0" 202 Accepted 2026-03-15 23:00:56,323 - lava_callback - INFO - Starting async job submit for node 69b497211727ff69d6f243d9 2026-03-15 23:00:56,324 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 23:00:56,339 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b497211727ff69d6f243d9 HTTP/1.1" 200 None 2026-03-15 23:00:56,341 - lava_callback - DEBUG - Processing node 69b497211727ff69d6f243d9: baseline-arm-baylibre 2026-03-15 23:00:56,341 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b497211727ff69d6f243d9 2026-03-15 23:00:56,342 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 23:00:56,360 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b497211727ff69d6f243d9 HTTP/1.1" 200 None 2026-03-15 23:00:56,361 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 23:00:56,388 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aef424ce46d8ec186ab80e HTTP/1.1" 200 None 2026-03-15 23:00:56,389 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 23:00:56,419 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b497211727ff69d6f243d9 HTTP/1.1" 200 None 2026-03-15 23:00:56,424 - lava_callback - ERROR - Error processing callback for node 69b497211727ff69d6f243d9: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:60660 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55254 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34450 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34460 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:34466 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:32936 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60878 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39872 - "GET / HTTP/1.0" 200 OK 2026-03-15 23:01:56,289 - lava_callback - INFO - Received callback for node 69b4975d1727ff69d6f243e7 INFO: 172.21.0.1:49054 - "POST /node/69b4975d1727ff69d6f243e7 HTTP/1.0" 202 Accepted 2026-03-15 23:01:56,294 - lava_callback - INFO - Starting async job submit for node 69b4975d1727ff69d6f243e7 2026-03-15 23:01:56,295 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 23:01:56,310 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b4975d1727ff69d6f243e7 HTTP/1.1" 200 None 2026-03-15 23:01:56,311 - lava_callback - DEBUG - Processing node 69b4975d1727ff69d6f243e7: baseline-arm-baylibre 2026-03-15 23:01:56,311 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b4975d1727ff69d6f243e7 2026-03-15 23:01:56,312 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 23:01:56,328 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b4975d1727ff69d6f243e7 HTTP/1.1" 200 None 2026-03-15 23:01:56,329 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 23:01:56,351 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aef424ce46d8ec186ab80e HTTP/1.1" 200 None 2026-03-15 23:01:56,353 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 23:01:56,385 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b4975d1727ff69d6f243e7 HTTP/1.1" 200 None 2026-03-15 23:01:56,387 - lava_callback - ERROR - Error processing callback for node 69b4975d1727ff69d6f243e7: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:49058 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54152 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45588 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45602 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:45608 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48280 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46540 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48714 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33728 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43012 - "GET / HTTP/1.0" 200 OK 2026-03-15 23:03:06,539 - lava_callback - INFO - Received callback for node 69b497991727ff69d6f243fb INFO: 172.21.0.1:43026 - "POST /node/69b497991727ff69d6f243fb HTTP/1.0" 202 Accepted 2026-03-15 23:03:06,545 - lava_callback - INFO - Starting async job submit for node 69b497991727ff69d6f243fb 2026-03-15 23:03:06,546 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 23:03:06,569 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b497991727ff69d6f243fb HTTP/1.1" 200 None 2026-03-15 23:03:06,570 - lava_callback - DEBUG - Processing node 69b497991727ff69d6f243fb: baseline-arm-clabbe 2026-03-15 23:03:06,571 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b497991727ff69d6f243fb 2026-03-15 23:03:06,571 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 23:03:06,595 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b497991727ff69d6f243fb HTTP/1.1" 200 None 2026-03-15 23:03:06,597 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 23:03:06,630 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aef424ce46d8ec186ab80e HTTP/1.1" 200 None 2026-03-15 23:03:06,632 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 23:03:06,658 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b497991727ff69d6f243fb HTTP/1.1" 200 None 2026-03-15 23:03:06,659 - lava_callback - ERROR - Error processing callback for node 69b497991727ff69d6f243fb: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:41248 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41252 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:41260 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38046 - "GET / HTTP/1.0" 200 OK 2026-03-15 23:03:36,433 - lava_callback - INFO - Received callback for node 69b497bb1727ff69d6f24406 INFO: 172.21.0.1:48420 - "POST /node/69b497bb1727ff69d6f24406 HTTP/1.0" 202 Accepted 2026-03-15 23:03:36,438 - lava_callback - INFO - Starting async job submit for node 69b497bb1727ff69d6f24406 2026-03-15 23:03:36,439 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 23:03:36,465 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b497bb1727ff69d6f24406 HTTP/1.1" 200 None 2026-03-15 23:03:36,466 - lava_callback - DEBUG - Processing node 69b497bb1727ff69d6f24406: baseline-arm-baylibre 2026-03-15 23:03:36,467 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b497bb1727ff69d6f24406 2026-03-15 23:03:36,467 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 23:03:36,485 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b497bb1727ff69d6f24406 HTTP/1.1" 200 None 2026-03-15 23:03:36,487 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 23:03:36,500 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aef424ce46d8ec186ab80e HTTP/1.1" 200 None 2026-03-15 23:03:36,501 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 23:03:36,523 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b497bb1727ff69d6f24406 HTTP/1.1" 200 None 2026-03-15 23:03:36,524 - lava_callback - ERROR - Error processing callback for node 69b497bb1727ff69d6f24406: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:48436 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55420 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58264 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55980 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45946 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45948 - "GET /api/metrics HTTP/1.0" 200 OK 2026-03-15 23:04:16,425 - lava_callback - INFO - Received callback for node 69b497de1727ff69d6f24413 INFO: 172.21.0.1:45960 - "POST /node/69b497de1727ff69d6f24413 HTTP/1.0" 202 Accepted 2026-03-15 23:04:16,431 - lava_callback - INFO - Starting async job submit for node 69b497de1727ff69d6f24413 2026-03-15 23:04:16,432 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 23:04:16,455 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b497de1727ff69d6f24413 HTTP/1.1" 200 None 2026-03-15 23:04:16,456 - lava_callback - DEBUG - Processing node 69b497de1727ff69d6f24413: baseline-arm-baylibre 2026-03-15 23:04:16,456 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b497de1727ff69d6f24413 2026-03-15 23:04:16,457 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 23:04:16,470 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b497de1727ff69d6f24413 HTTP/1.1" 200 None 2026-03-15 23:04:16,471 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 23:04:16,485 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aef424ce46d8ec186ab80e HTTP/1.1" 200 None 2026-03-15 23:04:16,486 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 23:04:16,527 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b497de1727ff69d6f24413 HTTP/1.1" 200 None 2026-03-15 23:04:16,529 - lava_callback - ERROR - Error processing callback for node 69b497de1727ff69d6f24413: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:45962 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34324 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40310 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52408 - "GET / HTTP/1.0" 200 OK 2026-03-15 23:04:46,619 - lava_callback - INFO - Received callback for node 69b498051727ff69d6f2441d INFO: 172.21.0.1:52416 - "POST /node/69b498051727ff69d6f2441d HTTP/1.0" 202 Accepted 2026-03-15 23:04:46,625 - lava_callback - INFO - Starting async job submit for node 69b498051727ff69d6f2441d 2026-03-15 23:04:46,626 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 23:04:46,640 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b498051727ff69d6f2441d HTTP/1.1" 200 None 2026-03-15 23:04:46,641 - lava_callback - DEBUG - Processing node 69b498051727ff69d6f2441d: baseline-arm-clabbe 2026-03-15 23:04:46,641 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b498051727ff69d6f2441d 2026-03-15 23:04:46,642 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 23:04:46,661 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b498051727ff69d6f2441d HTTP/1.1" 200 None 2026-03-15 23:04:46,662 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 23:04:46,675 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aef424ce46d8ec186ab80e HTTP/1.1" 200 None 2026-03-15 23:04:46,677 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 23:04:46,702 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b498051727ff69d6f2441d HTTP/1.1" 200 None 2026-03-15 23:04:46,704 - lava_callback - ERROR - Error processing callback for node 69b498051727ff69d6f2441d: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:49108 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36698 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45700 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45716 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:45724 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40714 - "GET / HTTP/1.0" 200 OK 2026-03-15 23:05:26,533 - lava_callback - INFO - Received callback for node 69b4982a1727ff69d6f2442c INFO: 172.21.0.1:40730 - "POST /node/69b4982a1727ff69d6f2442c HTTP/1.0" 202 Accepted 2026-03-15 23:05:26,538 - lava_callback - INFO - Starting async job submit for node 69b4982a1727ff69d6f2442c 2026-03-15 23:05:26,539 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 23:05:26,578 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b4982a1727ff69d6f2442c HTTP/1.1" 200 None 2026-03-15 23:05:26,579 - lava_callback - DEBUG - Processing node 69b4982a1727ff69d6f2442c: baseline-arm-clabbe 2026-03-15 23:05:26,579 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b4982a1727ff69d6f2442c 2026-03-15 23:05:26,580 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 23:05:26,618 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b4982a1727ff69d6f2442c HTTP/1.1" 200 None 2026-03-15 23:05:26,620 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 23:05:26,636 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aef424ce46d8ec186ab80e HTTP/1.1" 200 None 2026-03-15 23:05:26,637 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 23:05:26,660 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b4982a1727ff69d6f2442c HTTP/1.1" 200 None 2026-03-15 23:05:26,661 - lava_callback - ERROR - Error processing callback for node 69b4982a1727ff69d6f2442c: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:39706 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42854 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57502 - "GET / HTTP/1.0" 200 OK 2026-03-15 23:05:56,538 - lava_callback - INFO - Received callback for node 69b4984b1727ff69d6f2443a INFO: 172.21.0.1:57516 - "POST /node/69b4984b1727ff69d6f2443a HTTP/1.0" 202 Accepted 2026-03-15 23:05:56,543 - lava_callback - INFO - Starting async job submit for node 69b4984b1727ff69d6f2443a 2026-03-15 23:05:56,544 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 23:05:56,570 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b4984b1727ff69d6f2443a HTTP/1.1" 200 None 2026-03-15 23:05:56,571 - lava_callback - DEBUG - Processing node 69b4984b1727ff69d6f2443a: baseline-arm-baylibre 2026-03-15 23:05:56,572 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b4984b1727ff69d6f2443a 2026-03-15 23:05:56,572 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 23:05:56,586 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b4984b1727ff69d6f2443a HTTP/1.1" 200 None 2026-03-15 23:05:56,587 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 23:05:56,600 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aef424ce46d8ec186ab80e HTTP/1.1" 200 None 2026-03-15 23:05:56,602 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 23:05:56,631 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b4984b1727ff69d6f2443a HTTP/1.1" 200 None 2026-03-15 23:05:56,633 - lava_callback - ERROR - Error processing callback for node 69b4984b1727ff69d6f2443a: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:57292 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42136 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42142 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:42146 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34634 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33734 - "GET / HTTP/1.0" 200 OK 2026-03-15 23:06:36,559 - lava_callback - INFO - Received callback for node 69b4986f1727ff69d6f24446 INFO: 172.21.0.1:33742 - "POST /node/69b4986f1727ff69d6f24446 HTTP/1.0" 202 Accepted 2026-03-15 23:06:36,564 - lava_callback - INFO - Starting async job submit for node 69b4986f1727ff69d6f24446 2026-03-15 23:06:36,565 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 23:06:36,579 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b4986f1727ff69d6f24446 HTTP/1.1" 200 None 2026-03-15 23:06:36,580 - lava_callback - DEBUG - Processing node 69b4986f1727ff69d6f24446: baseline-arm-baylibre 2026-03-15 23:06:36,581 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b4986f1727ff69d6f24446 2026-03-15 23:06:36,581 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 23:06:36,595 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b4986f1727ff69d6f24446 HTTP/1.1" 200 None 2026-03-15 23:06:36,596 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 23:06:36,609 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aef424ce46d8ec186ab80e HTTP/1.1" 200 None 2026-03-15 23:06:36,611 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 23:06:36,640 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b4986f1727ff69d6f24446 HTTP/1.1" 200 None 2026-03-15 23:06:36,641 - lava_callback - ERROR - Error processing callback for node 69b4986f1727ff69d6f24446: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:50576 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41704 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46162 - "GET / HTTP/1.0" 200 OK 2026-03-15 23:07:06,736 - lava_callback - INFO - Received callback for node 69b498941727ff69d6f24457 INFO: 172.21.0.1:46178 - "POST /node/69b498941727ff69d6f24457 HTTP/1.0" 202 Accepted 2026-03-15 23:07:06,741 - lava_callback - INFO - Starting async job submit for node 69b498941727ff69d6f24457 2026-03-15 23:07:06,742 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 23:07:06,757 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b498941727ff69d6f24457 HTTP/1.1" 200 None 2026-03-15 23:07:06,758 - lava_callback - DEBUG - Processing node 69b498941727ff69d6f24457: baseline-arm-clabbe 2026-03-15 23:07:06,758 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b498941727ff69d6f24457 2026-03-15 23:07:06,758 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 23:07:06,776 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b498941727ff69d6f24457 HTTP/1.1" 200 None 2026-03-15 23:07:06,777 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 23:07:06,792 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aef424ce46d8ec186ab80e HTTP/1.1" 200 None 2026-03-15 23:07:06,793 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 23:07:06,814 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b498941727ff69d6f24457 HTTP/1.1" 200 None 2026-03-15 23:07:06,815 - lava_callback - ERROR - Error processing callback for node 69b498941727ff69d6f24457: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:54498 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54512 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:54518 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42974 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55808 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58828 - "GET / HTTP/1.0" 200 OK 2026-03-15 23:07:46,744 - lava_callback - INFO - Received callback for node 69b498b81727ff69d6f24460 INFO: 172.21.0.1:58842 - "POST /node/69b498b81727ff69d6f24460 HTTP/1.0" 202 Accepted 2026-03-15 23:07:46,750 - lava_callback - INFO - Starting async job submit for node 69b498b81727ff69d6f24460 2026-03-15 23:07:46,751 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 23:07:46,766 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b498b81727ff69d6f24460 HTTP/1.1" 200 None 2026-03-15 23:07:46,767 - lava_callback - DEBUG - Processing node 69b498b81727ff69d6f24460: baseline-arm-clabbe 2026-03-15 23:07:46,767 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b498b81727ff69d6f24460 2026-03-15 23:07:46,768 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 23:07:46,796 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b498b81727ff69d6f24460 HTTP/1.1" 200 None 2026-03-15 23:07:46,798 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 23:07:46,821 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aef424ce46d8ec186ab80e HTTP/1.1" 200 None 2026-03-15 23:07:46,822 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 23:07:46,843 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b498b81727ff69d6f24460 HTTP/1.1" 200 None 2026-03-15 23:07:46,849 - lava_callback - ERROR - Error processing callback for node 69b498b81727ff69d6f24460: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:40164 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36140 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37526 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37538 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:37552 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50152 - "GET / HTTP/1.0" 200 OK 2026-03-15 23:08:26,775 - lava_callback - INFO - Received callback for node 69b498dd1727ff69d6f2446e INFO: 172.21.0.1:50166 - "POST /node/69b498dd1727ff69d6f2446e HTTP/1.0" 202 Accepted 2026-03-15 23:08:26,780 - lava_callback - INFO - Starting async job submit for node 69b498dd1727ff69d6f2446e 2026-03-15 23:08:26,781 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 23:08:26,796 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b498dd1727ff69d6f2446e HTTP/1.1" 200 None 2026-03-15 23:08:26,797 - lava_callback - DEBUG - Processing node 69b498dd1727ff69d6f2446e: baseline-arm-clabbe 2026-03-15 23:08:26,797 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b498dd1727ff69d6f2446e 2026-03-15 23:08:26,798 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 23:08:26,819 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b498dd1727ff69d6f2446e HTTP/1.1" 200 None 2026-03-15 23:08:26,821 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 23:08:26,836 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aef424ce46d8ec186ab80e HTTP/1.1" 200 None 2026-03-15 23:08:26,837 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 23:08:26,858 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b498dd1727ff69d6f2446e HTTP/1.1" 200 None 2026-03-15 23:08:26,860 - lava_callback - ERROR - Error processing callback for node 69b498dd1727ff69d6f2446e: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:52016 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35390 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48266 - "GET / HTTP/1.0" 200 OK 2026-03-15 23:08:56,786 - lava_callback - INFO - Received callback for node 69b498fd1727ff69d6f24478 INFO: 172.21.0.1:48268 - "POST /node/69b498fd1727ff69d6f24478 HTTP/1.0" 202 Accepted 2026-03-15 23:08:56,792 - lava_callback - INFO - Starting async job submit for node 69b498fd1727ff69d6f24478 2026-03-15 23:08:56,793 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 23:08:56,816 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b498fd1727ff69d6f24478 HTTP/1.1" 200 None 2026-03-15 23:08:56,817 - lava_callback - DEBUG - Processing node 69b498fd1727ff69d6f24478: baseline-arm-baylibre 2026-03-15 23:08:56,817 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b498fd1727ff69d6f24478 2026-03-15 23:08:56,818 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 23:08:56,853 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b498fd1727ff69d6f24478 HTTP/1.1" 200 None 2026-03-15 23:08:56,854 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 23:08:56,895 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aef424ce46d8ec186ab80e HTTP/1.1" 200 None 2026-03-15 23:08:56,897 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 23:08:56,929 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b498fd1727ff69d6f24478 HTTP/1.1" 200 None 2026-03-15 23:08:56,931 - lava_callback - ERROR - Error processing callback for node 69b498fd1727ff69d6f24478: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:49096 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37960 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37962 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:37974 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51918 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54362 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41366 - "GET / HTTP/1.0" 200 OK 2026-03-15 23:09:46,812 - lava_callback - INFO - Received callback for node 69b499241727ff69d6f24484 INFO: 172.21.0.1:41374 - "POST /node/69b499241727ff69d6f24484 HTTP/1.0" 202 Accepted 2026-03-15 23:09:46,818 - lava_callback - INFO - Starting async job submit for node 69b499241727ff69d6f24484 2026-03-15 23:09:46,819 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 23:09:46,834 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b499241727ff69d6f24484 HTTP/1.1" 200 None 2026-03-15 23:09:46,835 - lava_callback - DEBUG - Processing node 69b499241727ff69d6f24484: baseline-arm-clabbe 2026-03-15 23:09:46,835 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b499241727ff69d6f24484 2026-03-15 23:09:46,836 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 23:09:46,858 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b499241727ff69d6f24484 HTTP/1.1" 200 None 2026-03-15 23:09:46,860 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 23:09:46,882 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aef424ce46d8ec186ab80e HTTP/1.1" 200 None 2026-03-15 23:09:46,884 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 23:09:46,906 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b499241727ff69d6f24484 HTTP/1.1" 200 None 2026-03-15 23:09:46,907 - lava_callback - ERROR - Error processing callback for node 69b499241727ff69d6f24484: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:60612 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56634 - "GET / HTTP/1.0" 200 OK 2026-03-15 23:10:07,130 - lava_callback - INFO - Received callback for node 69b499481727ff69d6f24490 INFO: 172.21.0.1:56640 - "POST /node/69b499481727ff69d6f24490 HTTP/1.0" 202 Accepted 2026-03-15 23:10:07,135 - lava_callback - INFO - Starting async job submit for node 69b499481727ff69d6f24490 2026-03-15 23:10:07,136 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 23:10:07,176 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b499481727ff69d6f24490 HTTP/1.1" 200 None 2026-03-15 23:10:07,177 - lava_callback - DEBUG - Processing node 69b499481727ff69d6f24490: baseline-arm-clabbe 2026-03-15 23:10:07,177 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b499481727ff69d6f24490 2026-03-15 23:10:07,178 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 23:10:07,199 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b499481727ff69d6f24490 HTTP/1.1" 200 None 2026-03-15 23:10:07,200 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 23:10:07,228 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aef424ce46d8ec186ab80e HTTP/1.1" 200 None 2026-03-15 23:10:07,229 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 23:10:07,285 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b499481727ff69d6f24490 HTTP/1.1" 200 None 2026-03-15 23:10:07,286 - lava_callback - ERROR - Error processing callback for node 69b499481727ff69d6f24490: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:60884 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60890 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:60892 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49136 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48882 - "GET / HTTP/1.0" 200 OK 2026-03-15 23:10:37,057 - lava_callback - INFO - Received callback for node 69b499691727ff69d6f24499 INFO: 172.21.0.1:48886 - "POST /node/69b499691727ff69d6f24499 HTTP/1.0" 202 Accepted 2026-03-15 23:10:37,062 - lava_callback - INFO - Starting async job submit for node 69b499691727ff69d6f24499 2026-03-15 23:10:37,063 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 23:10:37,078 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b499691727ff69d6f24499 HTTP/1.1" 200 None 2026-03-15 23:10:37,079 - lava_callback - DEBUG - Processing node 69b499691727ff69d6f24499: baseline-arm-baylibre 2026-03-15 23:10:37,079 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b499691727ff69d6f24499 2026-03-15 23:10:37,080 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 23:10:37,103 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b499691727ff69d6f24499 HTTP/1.1" 200 None 2026-03-15 23:10:37,105 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 23:10:37,118 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aef424ce46d8ec186ab80e HTTP/1.1" 200 None 2026-03-15 23:10:37,120 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 23:10:37,142 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b499691727ff69d6f24499 HTTP/1.1" 200 None 2026-03-15 23:10:37,148 - lava_callback - ERROR - Error processing callback for node 69b499691727ff69d6f24499: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:59356 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54040 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52222 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39066 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39076 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:39086 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47224 - "GET / HTTP/1.0" 200 OK 2026-03-15 23:11:26,881 - lava_callback - INFO - Received callback for node 69b499911727ff69d6f244a4 INFO: 172.21.0.1:47236 - "POST /node/69b499911727ff69d6f244a4 HTTP/1.0" 202 Accepted 2026-03-15 23:11:26,887 - lava_callback - INFO - Starting async job submit for node 69b499911727ff69d6f244a4 2026-03-15 23:11:26,888 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 23:11:26,912 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b499911727ff69d6f244a4 HTTP/1.1" 200 None 2026-03-15 23:11:26,913 - lava_callback - DEBUG - Processing node 69b499911727ff69d6f244a4: baseline-arm-clabbe 2026-03-15 23:11:26,914 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b499911727ff69d6f244a4 2026-03-15 23:11:26,914 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 23:11:26,929 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b499911727ff69d6f244a4 HTTP/1.1" 200 None 2026-03-15 23:11:26,930 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 23:11:26,952 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aef424ce46d8ec186ab80e HTTP/1.1" 200 None 2026-03-15 23:11:26,953 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 23:11:26,986 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b499911727ff69d6f244a4 HTTP/1.1" 200 None 2026-03-15 23:11:26,988 - lava_callback - ERROR - Error processing callback for node 69b499911727ff69d6f244a4: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:60250 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41620 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47600 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41456 - "GET / HTTP/1.0" 200 OK 2026-03-15 23:12:06,880 - lava_callback - INFO - Received callback for node 69b499b51727ff69d6f244b0 INFO: 172.21.0.1:41458 - "POST /node/69b499b51727ff69d6f244b0 HTTP/1.0" 202 Accepted 2026-03-15 23:12:06,885 - lava_callback - INFO - Starting async job submit for node 69b499b51727ff69d6f244b0 2026-03-15 23:12:06,886 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 23:12:06,901 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b499b51727ff69d6f244b0 HTTP/1.1" 200 None 2026-03-15 23:12:06,902 - lava_callback - DEBUG - Processing node 69b499b51727ff69d6f244b0: baseline-arm-clabbe 2026-03-15 23:12:06,902 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b499b51727ff69d6f244b0 2026-03-15 23:12:06,903 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 23:12:06,916 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b499b51727ff69d6f244b0 HTTP/1.1" 200 None 2026-03-15 23:12:06,917 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 23:12:06,936 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aef424ce46d8ec186ab80e HTTP/1.1" 200 None 2026-03-15 23:12:06,938 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 23:12:06,959 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b499b51727ff69d6f244b0 HTTP/1.1" 200 None 2026-03-15 23:12:06,965 - lava_callback - ERROR - Error processing callback for node 69b499b51727ff69d6f244b0: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:48888 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48890 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:48898 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41046 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45404 - "GET / HTTP/1.0" 200 OK 2026-03-15 23:12:36,941 - lava_callback - INFO - Received callback for node 69b499d61727ff69d6f244b9 INFO: 172.21.0.1:45420 - "POST /node/69b499d61727ff69d6f244b9 HTTP/1.0" 202 Accepted 2026-03-15 23:12:36,947 - lava_callback - INFO - Starting async job submit for node 69b499d61727ff69d6f244b9 2026-03-15 23:12:36,948 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 23:12:36,984 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b499d61727ff69d6f244b9 HTTP/1.1" 200 None 2026-03-15 23:12:36,985 - lava_callback - DEBUG - Processing node 69b499d61727ff69d6f244b9: baseline-arm-baylibre 2026-03-15 23:12:36,985 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b499d61727ff69d6f244b9 2026-03-15 23:12:36,986 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 23:12:37,035 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b499d61727ff69d6f244b9 HTTP/1.1" 200 None 2026-03-15 23:12:37,036 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 23:12:37,090 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aef424ce46d8ec186ab80e HTTP/1.1" 200 None 2026-03-15 23:12:37,092 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 23:12:37,127 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b499d61727ff69d6f244b9 HTTP/1.1" 200 None 2026-03-15 23:12:37,129 - lava_callback - ERROR - Error processing callback for node 69b499d61727ff69d6f244b9: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:40856 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44386 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41894 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35334 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35338 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:35354 - "GET / HTTP/1.0" 200 OK 2026-03-15 23:13:16,931 - lava_callback - INFO - Received callback for node 69b499fb1727ff69d6f244c4 INFO: 172.21.0.1:35370 - "POST /node/69b499fb1727ff69d6f244c4 HTTP/1.0" 202 Accepted 2026-03-15 23:13:16,937 - lava_callback - INFO - Starting async job submit for node 69b499fb1727ff69d6f244c4 2026-03-15 23:13:16,937 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 23:13:16,957 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b499fb1727ff69d6f244c4 HTTP/1.1" 200 None 2026-03-15 23:13:16,957 - lava_callback - DEBUG - Processing node 69b499fb1727ff69d6f244c4: baseline-arm-baylibre 2026-03-15 23:13:16,958 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b499fb1727ff69d6f244c4 2026-03-15 23:13:16,958 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 23:13:16,972 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b499fb1727ff69d6f244c4 HTTP/1.1" 200 None 2026-03-15 23:13:16,973 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 23:13:17,003 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aef424ce46d8ec186ab80e HTTP/1.1" 200 None 2026-03-15 23:13:17,004 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 23:13:17,049 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b499fb1727ff69d6f244c4 HTTP/1.1" 200 None 2026-03-15 23:13:17,051 - lava_callback - ERROR - Error processing callback for node 69b499fb1727ff69d6f244c4: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:43348 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45810 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49534 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58676 - "GET / HTTP/1.0" 200 OK 2026-03-15 23:13:57,027 - lava_callback - INFO - Received callback for node 69b49a231727ff69d6f244ce INFO: 172.21.0.1:58690 - "POST /node/69b49a231727ff69d6f244ce HTTP/1.0" 202 Accepted 2026-03-15 23:13:57,032 - lava_callback - INFO - Starting async job submit for node 69b49a231727ff69d6f244ce 2026-03-15 23:13:57,033 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 23:13:57,061 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b49a231727ff69d6f244ce HTTP/1.1" 200 None 2026-03-15 23:13:57,062 - lava_callback - DEBUG - Processing node 69b49a231727ff69d6f244ce: baseline-arm-baylibre 2026-03-15 23:13:57,063 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b49a231727ff69d6f244ce 2026-03-15 23:13:57,063 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 23:13:57,078 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b49a231727ff69d6f244ce HTTP/1.1" 200 None 2026-03-15 23:13:57,080 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 23:13:57,093 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aef424ce46d8ec186ab80e HTTP/1.1" 200 None 2026-03-15 23:13:57,094 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 23:13:57,115 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b49a231727ff69d6f244ce HTTP/1.1" 200 None 2026-03-15 23:13:57,117 - lava_callback - ERROR - Error processing callback for node 69b49a231727ff69d6f244ce: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:48680 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51680 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51694 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:51696 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42948 - "GET / HTTP/1.0" 200 OK 2026-03-15 23:14:27,034 - lava_callback - INFO - Received callback for node 69b49a4d1727ff69d6f244dc INFO: 172.21.0.1:42964 - "POST /node/69b49a4d1727ff69d6f244dc HTTP/1.0" 202 Accepted 2026-03-15 23:14:27,040 - lava_callback - INFO - Starting async job submit for node 69b49a4d1727ff69d6f244dc 2026-03-15 23:14:27,041 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 23:14:27,084 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b49a4d1727ff69d6f244dc HTTP/1.1" 200 None 2026-03-15 23:14:27,085 - lava_callback - DEBUG - Processing node 69b49a4d1727ff69d6f244dc: baseline-arm-clabbe 2026-03-15 23:14:27,085 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b49a4d1727ff69d6f244dc 2026-03-15 23:14:27,086 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 23:14:27,128 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b49a4d1727ff69d6f244dc HTTP/1.1" 200 None 2026-03-15 23:14:27,129 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 23:14:27,146 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aef424ce46d8ec186ab80e HTTP/1.1" 200 None 2026-03-15 23:14:27,148 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 23:14:27,169 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b49a4d1727ff69d6f244dc HTTP/1.1" 200 None 2026-03-15 23:14:27,171 - lava_callback - ERROR - Error processing callback for node 69b49a4d1727ff69d6f244dc: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:34906 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47734 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46542 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46176 - "GET / HTTP/1.0" 200 OK 2026-03-15 23:15:06,998 - lava_callback - INFO - Received callback for node 69b49a741727ff69d6f244e7 INFO: 172.21.0.1:46184 - "POST /node/69b49a741727ff69d6f244e7 HTTP/1.0" 202 Accepted 2026-03-15 23:15:07,005 - lava_callback - INFO - Starting async job submit for node 69b49a741727ff69d6f244e7 2026-03-15 23:15:07,006 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 23:15:07,043 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b49a741727ff69d6f244e7 HTTP/1.1" 200 None 2026-03-15 23:15:07,044 - lava_callback - DEBUG - Processing node 69b49a741727ff69d6f244e7: baseline-arm-clabbe 2026-03-15 23:15:07,044 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b49a741727ff69d6f244e7 2026-03-15 23:15:07,045 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 23:15:07,060 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b49a741727ff69d6f244e7 HTTP/1.1" 200 None 2026-03-15 23:15:07,062 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 23:15:07,099 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aef424ce46d8ec186ab80e HTTP/1.1" 200 None 2026-03-15 23:15:07,101 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 23:15:07,140 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b49a741727ff69d6f244e7 HTTP/1.1" 200 None 2026-03-15 23:15:07,142 - lava_callback - ERROR - Error processing callback for node 69b49a741727ff69d6f244e7: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:39008 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39022 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:39026 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54620 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60734 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41112 - "GET / HTTP/1.0" 200 OK 2026-03-15 23:15:47,062 - lava_callback - INFO - Received callback for node 69b49a9c1727ff69d6f244f3 INFO: 172.21.0.1:41128 - "POST /node/69b49a9c1727ff69d6f244f3 HTTP/1.0" 202 Accepted 2026-03-15 23:15:47,068 - lava_callback - INFO - Starting async job submit for node 69b49a9c1727ff69d6f244f3 2026-03-15 23:15:47,068 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 23:15:47,089 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b49a9c1727ff69d6f244f3 HTTP/1.1" 200 None 2026-03-15 23:15:47,089 - lava_callback - DEBUG - Processing node 69b49a9c1727ff69d6f244f3: baseline-arm-clabbe 2026-03-15 23:15:47,090 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b49a9c1727ff69d6f244f3 2026-03-15 23:15:47,090 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 23:15:47,106 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b49a9c1727ff69d6f244f3 HTTP/1.1" 200 None 2026-03-15 23:15:47,108 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 23:15:47,121 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aef424ce46d8ec186ab80e HTTP/1.1" 200 None 2026-03-15 23:15:47,122 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 23:15:47,146 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b49a9c1727ff69d6f244f3 HTTP/1.1" 200 None 2026-03-15 23:15:47,157 - lava_callback - ERROR - Error processing callback for node 69b49a9c1727ff69d6f244f3: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:52272 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56532 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44800 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44812 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:44814 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41536 - "GET / HTTP/1.0" 200 OK 2026-03-15 23:16:27,211 - lava_callback - INFO - Received callback for node 69b49ac31727ff69d6f244fe INFO: 172.21.0.1:41542 - "POST /node/69b49ac31727ff69d6f244fe HTTP/1.0" 202 Accepted 2026-03-15 23:16:27,217 - lava_callback - INFO - Starting async job submit for node 69b49ac31727ff69d6f244fe 2026-03-15 23:16:27,218 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 23:16:27,254 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b49ac31727ff69d6f244fe HTTP/1.1" 200 None 2026-03-15 23:16:27,255 - lava_callback - DEBUG - Processing node 69b49ac31727ff69d6f244fe: baseline-arm-clabbe 2026-03-15 23:16:27,256 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b49ac31727ff69d6f244fe 2026-03-15 23:16:27,256 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 23:16:27,288 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b49ac31727ff69d6f244fe HTTP/1.1" 200 None 2026-03-15 23:16:27,290 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 23:16:27,304 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aef424ce46d8ec186ab80e HTTP/1.1" 200 None 2026-03-15 23:16:27,305 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 23:16:27,328 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b49ac31727ff69d6f244fe HTTP/1.1" 200 None 2026-03-15 23:16:27,329 - lava_callback - ERROR - Error processing callback for node 69b49ac31727ff69d6f244fe: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:40460 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34696 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40208 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52964 - "GET / HTTP/1.0" 200 OK 2026-03-15 23:17:07,141 - lava_callback - INFO - Received callback for node 69b49aea1727ff69d6f24506 INFO: 172.21.0.1:52980 - "POST /node/69b49aea1727ff69d6f24506 HTTP/1.0" 202 Accepted 2026-03-15 23:17:07,147 - lava_callback - INFO - Starting async job submit for node 69b49aea1727ff69d6f24506 2026-03-15 23:17:07,147 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 23:17:07,172 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b49aea1727ff69d6f24506 HTTP/1.1" 200 None 2026-03-15 23:17:07,173 - lava_callback - DEBUG - Processing node 69b49aea1727ff69d6f24506: baseline-arm-clabbe 2026-03-15 23:17:07,173 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b49aea1727ff69d6f24506 2026-03-15 23:17:07,174 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 23:17:07,187 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b49aea1727ff69d6f24506 HTTP/1.1" 200 None 2026-03-15 23:17:07,188 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 23:17:07,202 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aef424ce46d8ec186ab80e HTTP/1.1" 200 None 2026-03-15 23:17:07,203 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 23:17:07,224 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b49aea1727ff69d6f24506 HTTP/1.1" 200 None 2026-03-15 23:17:07,230 - lava_callback - ERROR - Error processing callback for node 69b49aea1727ff69d6f24506: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:52620 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52622 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:52626 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46206 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45508 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41288 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52278 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52970 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57770 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57776 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:57780 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47676 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47340 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56142 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33658 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37314 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42892 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42898 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:42904 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44038 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51188 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50402 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58580 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43110 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35642 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35648 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:35662 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42428 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44120 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52714 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46344 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49424 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56858 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56864 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:56878 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37832 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45134 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33604 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40090 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40096 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46324 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46330 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:46338 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42108 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48364 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50620 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40606 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48276 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38434 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38442 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:38444 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45748 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45890 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56826 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52360 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60110 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37318 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37324 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:37340 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59128 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33774 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60092 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44020 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52254 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59384 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59392 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:59402 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35578 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59576 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57522 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60474 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46844 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51432 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51442 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:51458 - "GET / HTTP/1.0" 200 OK 2026-03-15 23:26:17,927 - lava_callback - INFO - Received callback for node 69b49d0e1727ff69d6f24524 INFO: 172.21.0.1:51470 - "POST /node/69b49d0e1727ff69d6f24524 HTTP/1.0" 202 Accepted 2026-03-15 23:26:17,932 - lava_callback - INFO - Starting async job submit for node 69b49d0e1727ff69d6f24524 2026-03-15 23:26:17,933 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 23:26:17,953 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b49d0e1727ff69d6f24524 HTTP/1.1" 200 None 2026-03-15 23:26:17,954 - lava_callback - DEBUG - Processing node 69b49d0e1727ff69d6f24524: baseline-arm64-baylibre 2026-03-15 23:26:17,954 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b49d0e1727ff69d6f24524 2026-03-15 23:26:17,955 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 23:26:17,987 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b49d0e1727ff69d6f24524 HTTP/1.1" 200 None 2026-03-15 23:26:17,989 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 23:26:18,018 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aef431ce46d8ec186ab81d HTTP/1.1" 200 None 2026-03-15 23:26:18,019 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 23:26:18,056 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b49d0e1727ff69d6f24524 HTTP/1.1" 200 None 2026-03-15 23:26:18,063 - lava_callback - ERROR - Error processing callback for node 69b49d0e1727ff69d6f24524: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:44428 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37122 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55850 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36138 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50304 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53806 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53822 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:53832 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56130 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38238 - "GET / HTTP/1.0" 200 OK 2026-03-15 23:27:37,731 - lava_callback - INFO - Received callback for node 69b49d601727ff69d6f2453b INFO: 172.21.0.1:38246 - "POST /node/69b49d601727ff69d6f2453b HTTP/1.0" 202 Accepted 2026-03-15 23:27:37,738 - lava_callback - INFO - Starting async job submit for node 69b49d601727ff69d6f2453b 2026-03-15 23:27:37,739 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 23:27:37,754 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b49d601727ff69d6f2453b HTTP/1.1" 200 None 2026-03-15 23:27:37,755 - lava_callback - DEBUG - Processing node 69b49d601727ff69d6f2453b: baseline-arm64-baylibre 2026-03-15 23:27:37,755 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b49d601727ff69d6f2453b 2026-03-15 23:27:37,755 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 23:27:37,793 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b49d601727ff69d6f2453b HTTP/1.1" 200 None 2026-03-15 23:27:37,795 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 23:27:37,808 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aef431ce46d8ec186ab81d HTTP/1.1" 200 None 2026-03-15 23:27:37,810 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 23:27:37,831 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b49d601727ff69d6f2453b HTTP/1.1" 200 None 2026-03-15 23:27:37,837 - lava_callback - ERROR - Error processing callback for node 69b49d601727ff69d6f2453b: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:57802 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36532 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43220 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35200 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35208 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:35210 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44686 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37380 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51494 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34752 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38200 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55196 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55212 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:55214 - "GET / HTTP/1.0" 200 OK 2026-03-15 23:29:17,866 - lava_callback - INFO - Received callback for node 69b49dbf1727ff69d6f24550 INFO: 172.21.0.1:55224 - "POST /node/69b49dbf1727ff69d6f24550 HTTP/1.0" 202 Accepted 2026-03-15 23:29:17,872 - lava_callback - INFO - Starting async job submit for node 69b49dbf1727ff69d6f24550 2026-03-15 23:29:17,873 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 23:29:17,891 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b49dbf1727ff69d6f24550 HTTP/1.1" 200 None 2026-03-15 23:29:17,892 - lava_callback - DEBUG - Processing node 69b49dbf1727ff69d6f24550: baseline-arm64-baylibre 2026-03-15 23:29:17,892 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b49dbf1727ff69d6f24550 2026-03-15 23:29:17,893 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 23:29:17,910 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b49dbf1727ff69d6f24550 HTTP/1.1" 200 None 2026-03-15 23:29:17,911 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 23:29:17,931 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aef431ce46d8ec186ab81d HTTP/1.1" 200 None 2026-03-15 23:29:17,933 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 23:29:17,954 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b49dbf1727ff69d6f24550 HTTP/1.1" 200 None 2026-03-15 23:29:17,960 - lava_callback - ERROR - Error processing callback for node 69b49dbf1727ff69d6f24550: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:58874 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52930 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46096 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36872 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54456 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45900 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45906 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:45908 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39096 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55334 - "GET / HTTP/1.0" 200 OK 2026-03-15 23:30:37,883 - lava_callback - INFO - Received callback for node 69b49e131727ff69d6f24566 INFO: 172.21.0.1:55340 - "POST /node/69b49e131727ff69d6f24566 HTTP/1.0" 202 Accepted 2026-03-15 23:30:37,889 - lava_callback - INFO - Starting async job submit for node 69b49e131727ff69d6f24566 2026-03-15 23:30:37,889 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 23:30:37,906 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b49e131727ff69d6f24566 HTTP/1.1" 200 None 2026-03-15 23:30:37,907 - lava_callback - DEBUG - Processing node 69b49e131727ff69d6f24566: baseline-arm64-baylibre 2026-03-15 23:30:37,907 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b49e131727ff69d6f24566 2026-03-15 23:30:37,907 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 23:30:37,921 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b49e131727ff69d6f24566 HTTP/1.1" 200 None 2026-03-15 23:30:37,922 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 23:30:37,938 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aef431ce46d8ec186ab81d HTTP/1.1" 200 None 2026-03-15 23:30:37,940 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 23:30:37,973 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b49e131727ff69d6f24566 HTTP/1.1" 200 None 2026-03-15 23:30:37,974 - lava_callback - ERROR - Error processing callback for node 69b49e131727ff69d6f24566: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:51160 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49264 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60414 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42276 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42284 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:42298 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36006 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42526 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49682 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45880 - "GET / HTTP/1.0" 200 OK 2026-03-15 23:31:58,136 - lava_callback - INFO - Received callback for node 69b49e661727ff69d6f2457d INFO: 172.21.0.1:45888 - "POST /node/69b49e661727ff69d6f2457d HTTP/1.0" 202 Accepted 2026-03-15 23:31:58,142 - lava_callback - INFO - Starting async job submit for node 69b49e661727ff69d6f2457d 2026-03-15 23:31:58,143 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 23:31:58,175 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b49e661727ff69d6f2457d HTTP/1.1" 200 None 2026-03-15 23:31:58,175 - lava_callback - DEBUG - Processing node 69b49e661727ff69d6f2457d: baseline-arm64-baylibre 2026-03-15 23:31:58,176 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b49e661727ff69d6f2457d 2026-03-15 23:31:58,176 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 23:31:58,192 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b49e661727ff69d6f2457d HTTP/1.1" 200 None 2026-03-15 23:31:58,193 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 23:31:58,207 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aef431ce46d8ec186ab81d HTTP/1.1" 200 None 2026-03-15 23:31:58,208 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 23:31:58,229 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b49e661727ff69d6f2457d HTTP/1.1" 200 None 2026-03-15 23:31:58,230 - lava_callback - ERROR - Error processing callback for node 69b49e661727ff69d6f2457d: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:35910 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49806 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49822 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:49826 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37334 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40180 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52490 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42506 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39844 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52258 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52272 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:52282 - "GET / HTTP/1.0" 200 OK 2026-03-15 23:33:18,066 - lava_callback - INFO - Received callback for node 69b49eb91727ff69d6f2458d INFO: 172.21.0.1:52294 - "POST /node/69b49eb91727ff69d6f2458d HTTP/1.0" 202 Accepted 2026-03-15 23:33:18,072 - lava_callback - INFO - Starting async job submit for node 69b49eb91727ff69d6f2458d 2026-03-15 23:33:18,073 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 23:33:18,092 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b49eb91727ff69d6f2458d HTTP/1.1" 200 None 2026-03-15 23:33:18,093 - lava_callback - DEBUG - Processing node 69b49eb91727ff69d6f2458d: baseline-arm64-baylibre 2026-03-15 23:33:18,093 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b49eb91727ff69d6f2458d 2026-03-15 23:33:18,094 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 23:33:18,109 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b49eb91727ff69d6f2458d HTTP/1.1" 200 None 2026-03-15 23:33:18,110 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 23:33:18,156 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aef431ce46d8ec186ab81d HTTP/1.1" 200 None 2026-03-15 23:33:18,157 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 23:33:18,178 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b49eb91727ff69d6f2458d HTTP/1.1" 200 None 2026-03-15 23:33:18,179 - lava_callback - ERROR - Error processing callback for node 69b49eb91727ff69d6f2458d: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:34954 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45810 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45060 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52538 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54136 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46500 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46508 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:46512 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60254 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57870 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56004 - "GET / HTTP/1.0" 200 OK 2026-03-15 23:34:47,873 - lava_callback - INFO - Received callback for node 69b49f111727ff69d6f24599 INFO: 172.21.0.1:56008 - "POST /node/69b49f111727ff69d6f24599 HTTP/1.0" 202 Accepted 2026-03-15 23:34:47,879 - lava_callback - INFO - Starting async job submit for node 69b49f111727ff69d6f24599 2026-03-15 23:34:47,879 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 23:34:47,895 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b49f111727ff69d6f24599 HTTP/1.1" 200 None 2026-03-15 23:34:47,896 - lava_callback - DEBUG - Processing node 69b49f111727ff69d6f24599: baseline-arm64-clabbe 2026-03-15 23:34:47,896 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b49f111727ff69d6f24599 2026-03-15 23:34:47,897 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 23:34:47,910 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b49f111727ff69d6f24599 HTTP/1.1" 200 None 2026-03-15 23:34:47,912 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 23:34:47,925 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aef431ce46d8ec186ab81d HTTP/1.1" 200 None 2026-03-15 23:34:47,926 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 23:34:47,951 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b49f111727ff69d6f24599 HTTP/1.1" 200 None 2026-03-15 23:34:47,959 - lava_callback - ERROR - Error processing callback for node 69b49f111727ff69d6f24599: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:59808 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60772 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60264 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60272 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:60288 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55870 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40698 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60474 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47008 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43210 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48800 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48808 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:48818 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37850 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53306 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40268 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38008 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46360 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48760 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48774 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:48786 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60100 - "GET / HTTP/1.0" 200 OK 2026-03-15 23:37:27,989 - lava_callback - INFO - Received callback for node 69b49fa81727ff69d6f245a6 INFO: 172.21.0.1:60108 - "POST /node/69b49fa81727ff69d6f245a6 HTTP/1.0" 202 Accepted 2026-03-15 23:37:27,995 - lava_callback - INFO - Starting async job submit for node 69b49fa81727ff69d6f245a6 2026-03-15 23:37:27,995 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 23:37:28,017 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b49fa81727ff69d6f245a6 HTTP/1.1" 200 None 2026-03-15 23:37:28,018 - lava_callback - DEBUG - Processing node 69b49fa81727ff69d6f245a6: baseline-arm64-clabbe 2026-03-15 23:37:28,018 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b49fa81727ff69d6f245a6 2026-03-15 23:37:28,018 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 23:37:28,038 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b49fa81727ff69d6f245a6 HTTP/1.1" 200 None 2026-03-15 23:37:28,039 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 23:37:28,053 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aef431ce46d8ec186ab81d HTTP/1.1" 200 None 2026-03-15 23:37:28,054 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 23:37:28,085 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b49fa81727ff69d6f245a6 HTTP/1.1" 200 None 2026-03-15 23:37:28,087 - lava_callback - ERROR - Error processing callback for node 69b49fa81727ff69d6f245a6: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:35232 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48776 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42250 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46390 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57524 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57538 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:57544 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33796 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51352 - "GET / HTTP/1.0" 200 OK 2026-03-15 23:38:38,336 - lava_callback - INFO - Received callback for node 69b49ff11727ff69d6f245b1 INFO: 172.21.0.1:51368 - "POST /node/69b49ff11727ff69d6f245b1 HTTP/1.0" 202 Accepted 2026-03-15 23:38:38,341 - lava_callback - INFO - Starting async job submit for node 69b49ff11727ff69d6f245b1 2026-03-15 23:38:38,342 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 23:38:38,358 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b49ff11727ff69d6f245b1 HTTP/1.1" 200 None 2026-03-15 23:38:38,359 - lava_callback - DEBUG - Processing node 69b49ff11727ff69d6f245b1: baseline-arm64-baylibre 2026-03-15 23:38:38,359 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b49ff11727ff69d6f245b1 2026-03-15 23:38:38,360 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 23:38:38,382 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b49ff11727ff69d6f245b1 HTTP/1.1" 200 None 2026-03-15 23:38:38,383 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 23:38:38,396 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aef431ce46d8ec186ab81d HTTP/1.1" 200 None 2026-03-15 23:38:38,398 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 23:38:38,420 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b49ff11727ff69d6f245b1 HTTP/1.1" 200 None 2026-03-15 23:38:38,421 - lava_callback - ERROR - Error processing callback for node 69b49ff11727ff69d6f245b1: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:53870 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47174 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42978 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49482 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49488 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:49494 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38522 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57902 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41610 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33730 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49756 - "GET / HTTP/1.0" 200 OK 2026-03-15 23:40:08,162 - lava_callback - INFO - Received callback for node 69b4a04d1727ff69d6f245c1 INFO: 172.21.0.1:49768 - "POST /node/69b4a04d1727ff69d6f245c1 HTTP/1.0" 202 Accepted 2026-03-15 23:40:08,168 - lava_callback - INFO - Starting async job submit for node 69b4a04d1727ff69d6f245c1 2026-03-15 23:40:08,169 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 23:40:08,184 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b4a04d1727ff69d6f245c1 HTTP/1.1" 200 None 2026-03-15 23:40:08,184 - lava_callback - DEBUG - Processing node 69b4a04d1727ff69d6f245c1: baseline-arm64-clabbe 2026-03-15 23:40:08,185 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b4a04d1727ff69d6f245c1 2026-03-15 23:40:08,185 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 23:40:08,203 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b4a04d1727ff69d6f245c1 HTTP/1.1" 200 None 2026-03-15 23:40:08,204 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 23:40:08,218 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aef431ce46d8ec186ab81d HTTP/1.1" 200 None 2026-03-15 23:40:08,220 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 23:40:08,241 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b4a04d1727ff69d6f245c1 HTTP/1.1" 200 None 2026-03-15 23:40:08,242 - lava_callback - ERROR - Error processing callback for node 69b4a04d1727ff69d6f245c1: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:45264 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45276 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:45292 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46294 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49670 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40362 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33232 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42006 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35310 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35324 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:35332 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57492 - "GET / HTTP/1.0" 200 OK 2026-03-15 23:41:28,253 - lava_callback - INFO - Received callback for node 69b4a09e1727ff69d6f245cf INFO: 172.21.0.1:57502 - "POST /node/69b4a09e1727ff69d6f245cf HTTP/1.0" 202 Accepted 2026-03-15 23:41:28,258 - lava_callback - INFO - Starting async job submit for node 69b4a09e1727ff69d6f245cf 2026-03-15 23:41:28,259 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 23:41:28,285 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b4a09e1727ff69d6f245cf HTTP/1.1" 200 None 2026-03-15 23:41:28,286 - lava_callback - DEBUG - Processing node 69b4a09e1727ff69d6f245cf: baseline-arm64-clabbe 2026-03-15 23:41:28,286 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b4a09e1727ff69d6f245cf 2026-03-15 23:41:28,286 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 23:41:28,300 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b4a09e1727ff69d6f245cf HTTP/1.1" 200 None 2026-03-15 23:41:28,302 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 23:41:28,315 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aef431ce46d8ec186ab81d HTTP/1.1" 200 None 2026-03-15 23:41:28,316 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 23:41:28,360 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b4a09e1727ff69d6f245cf HTTP/1.1" 200 None 2026-03-15 23:41:28,361 - lava_callback - ERROR - Error processing callback for node 69b4a09e1727ff69d6f245cf: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:58782 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38786 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50700 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34730 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39282 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39290 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:39304 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37866 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43614 - "GET / HTTP/1.0" 200 OK 2026-03-15 23:42:38,642 - lava_callback - INFO - Received callback for node 69b4a0e61727ff69d6f245d5 INFO: 172.21.0.1:43624 - "POST /node/69b4a0e61727ff69d6f245d5 HTTP/1.0" 202 Accepted 2026-03-15 23:42:38,647 - lava_callback - INFO - Starting async job submit for node 69b4a0e61727ff69d6f245d5 2026-03-15 23:42:38,648 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 23:42:38,663 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b4a0e61727ff69d6f245d5 HTTP/1.1" 200 None 2026-03-15 23:42:38,664 - lava_callback - DEBUG - Processing node 69b4a0e61727ff69d6f245d5: baseline-arm64-baylibre 2026-03-15 23:42:38,664 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b4a0e61727ff69d6f245d5 2026-03-15 23:42:38,665 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 23:42:38,678 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b4a0e61727ff69d6f245d5 HTTP/1.1" 200 None 2026-03-15 23:42:38,679 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 23:42:38,695 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aef431ce46d8ec186ab81d HTTP/1.1" 200 None 2026-03-15 23:42:38,697 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 23:42:38,717 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b4a0e61727ff69d6f245d5 HTTP/1.1" 200 None 2026-03-15 23:42:38,718 - lava_callback - ERROR - Error processing callback for node 69b4a0e61727ff69d6f245d5: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:60990 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57054 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48106 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33176 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33178 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:33180 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47292 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34772 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35134 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44700 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42374 - "GET / HTTP/1.0" 200 OK 2026-03-15 23:44:08,256 - lava_callback - INFO - Received callback for node 69b4a1421727ff69d6f245e4 INFO: 172.21.0.1:42378 - "POST /node/69b4a1421727ff69d6f245e4 HTTP/1.0" 202 Accepted 2026-03-15 23:44:08,262 - lava_callback - INFO - Starting async job submit for node 69b4a1421727ff69d6f245e4 2026-03-15 23:44:08,263 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 23:44:08,301 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b4a1421727ff69d6f245e4 HTTP/1.1" 200 None 2026-03-15 23:44:08,302 - lava_callback - DEBUG - Processing node 69b4a1421727ff69d6f245e4: baseline-arm64-clabbe 2026-03-15 23:44:08,302 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b4a1421727ff69d6f245e4 2026-03-15 23:44:08,303 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 23:44:08,330 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b4a1421727ff69d6f245e4 HTTP/1.1" 200 None 2026-03-15 23:44:08,331 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 23:44:08,346 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aef431ce46d8ec186ab81d HTTP/1.1" 200 None 2026-03-15 23:44:08,347 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 23:44:08,391 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b4a1421727ff69d6f245e4 HTTP/1.1" 200 None 2026-03-15 23:44:08,392 - lava_callback - ERROR - Error processing callback for node 69b4a1421727ff69d6f245e4: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:58846 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58854 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:58866 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35870 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40332 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33708 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42270 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45478 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35038 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35054 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:35068 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56406 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39252 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33264 - "GET / HTTP/1.0" 200 OK 2026-03-15 23:45:48,355 - lava_callback - INFO - Received callback for node 69b4a1971727ff69d6f245ef INFO: 172.21.0.1:33266 - "POST /node/69b4a1971727ff69d6f245ef HTTP/1.0" 202 Accepted 2026-03-15 23:45:48,361 - lava_callback - INFO - Starting async job submit for node 69b4a1971727ff69d6f245ef 2026-03-15 23:45:48,361 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 23:45:48,376 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b4a1971727ff69d6f245ef HTTP/1.1" 200 None 2026-03-15 23:45:48,377 - lava_callback - DEBUG - Processing node 69b4a1971727ff69d6f245ef: baseline-arm64-clabbe 2026-03-15 23:45:48,377 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b4a1971727ff69d6f245ef 2026-03-15 23:45:48,378 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 23:45:48,396 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b4a1971727ff69d6f245ef HTTP/1.1" 200 None 2026-03-15 23:45:48,398 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 23:45:48,411 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aef431ce46d8ec186ab81d HTTP/1.1" 200 None 2026-03-15 23:45:48,412 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 23:45:48,457 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b4a1971727ff69d6f245ef HTTP/1.1" 200 None 2026-03-15 23:45:48,462 - lava_callback - ERROR - Error processing callback for node 69b4a1971727ff69d6f245ef: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:41010 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47838 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43816 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43822 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:43836 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33176 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34678 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48306 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50156 - "GET / HTTP/1.0" 200 OK 2026-03-15 23:46:58,960 - lava_callback - INFO - Received callback for node 69b4a1df1727ff69d6f245f6 INFO: 172.21.0.1:50170 - "POST /node/69b4a1df1727ff69d6f245f6 HTTP/1.0" 202 Accepted 2026-03-15 23:46:58,966 - lava_callback - INFO - Starting async job submit for node 69b4a1df1727ff69d6f245f6 2026-03-15 23:46:58,967 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 23:46:58,992 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b4a1df1727ff69d6f245f6 HTTP/1.1" 200 None 2026-03-15 23:46:58,993 - lava_callback - DEBUG - Processing node 69b4a1df1727ff69d6f245f6: baseline-arm64-baylibre 2026-03-15 23:46:58,993 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b4a1df1727ff69d6f245f6 2026-03-15 23:46:58,994 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 23:46:59,008 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b4a1df1727ff69d6f245f6 HTTP/1.1" 200 None 2026-03-15 23:46:59,009 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 23:46:59,042 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aef431ce46d8ec186ab81d HTTP/1.1" 200 None 2026-03-15 23:46:59,043 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 23:46:59,064 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b4a1df1727ff69d6f245f6 HTTP/1.1" 200 None 2026-03-15 23:46:59,066 - lava_callback - ERROR - Error processing callback for node 69b4a1df1727ff69d6f245f6: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:45386 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54938 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54950 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:54956 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41114 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58566 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45502 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43728 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39238 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43596 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43602 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:43616 - "GET / HTTP/1.0" 200 OK 2026-03-15 23:48:18,899 - lava_callback - INFO - Received callback for node 69b4a2311727ff69d6f24607 INFO: 172.21.0.1:43628 - "POST /node/69b4a2311727ff69d6f24607 HTTP/1.0" 202 Accepted 2026-03-15 23:48:18,904 - lava_callback - INFO - Starting async job submit for node 69b4a2311727ff69d6f24607 2026-03-15 23:48:18,905 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 23:48:18,929 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b4a2311727ff69d6f24607 HTTP/1.1" 200 None 2026-03-15 23:48:18,930 - lava_callback - DEBUG - Processing node 69b4a2311727ff69d6f24607: baseline-arm64-baylibre 2026-03-15 23:48:18,930 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b4a2311727ff69d6f24607 2026-03-15 23:48:18,931 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 23:48:18,944 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b4a2311727ff69d6f24607 HTTP/1.1" 200 None 2026-03-15 23:48:18,946 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 23:48:18,959 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aef431ce46d8ec186ab81d HTTP/1.1" 200 None 2026-03-15 23:48:18,961 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 23:48:18,981 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b4a2311727ff69d6f24607 HTTP/1.1" 200 None 2026-03-15 23:48:18,983 - lava_callback - ERROR - Error processing callback for node 69b4a2311727ff69d6f24607: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:41728 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49744 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49414 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60252 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45394 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53714 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53726 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:53740 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35236 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51452 - "GET / HTTP/1.0" 200 OK 2026-03-15 23:49:38,980 - lava_callback - INFO - Received callback for node 69b4a2821727ff69d6f2461d INFO: 172.21.0.1:51462 - "POST /node/69b4a2821727ff69d6f2461d HTTP/1.0" 202 Accepted 2026-03-15 23:49:38,985 - lava_callback - INFO - Starting async job submit for node 69b4a2821727ff69d6f2461d 2026-03-15 23:49:38,986 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 23:49:39,006 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b4a2821727ff69d6f2461d HTTP/1.1" 200 None 2026-03-15 23:49:39,007 - lava_callback - DEBUG - Processing node 69b4a2821727ff69d6f2461d: baseline-arm64-baylibre 2026-03-15 23:49:39,007 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b4a2821727ff69d6f2461d 2026-03-15 23:49:39,008 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 23:49:39,041 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b4a2821727ff69d6f2461d HTTP/1.1" 200 None 2026-03-15 23:49:39,043 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 23:49:39,066 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aef431ce46d8ec186ab81d HTTP/1.1" 200 None 2026-03-15 23:49:39,068 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 23:49:39,108 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b4a2821727ff69d6f2461d HTTP/1.1" 200 None 2026-03-15 23:49:39,110 - lava_callback - ERROR - Error processing callback for node 69b4a2821727ff69d6f2461d: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:44208 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58182 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55520 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40692 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40696 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:40698 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52146 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59542 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59466 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36470 - "GET / HTTP/1.0" 200 OK 2026-03-15 23:50:59,222 - lava_callback - INFO - Received callback for node 69b4a2d51727ff69d6f24623 INFO: 172.21.0.1:36484 - "POST /node/69b4a2d51727ff69d6f24623 HTTP/1.0" 202 Accepted 2026-03-15 23:50:59,227 - lava_callback - INFO - Starting async job submit for node 69b4a2d51727ff69d6f24623 2026-03-15 23:50:59,228 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 23:50:59,275 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b4a2d51727ff69d6f24623 HTTP/1.1" 200 None 2026-03-15 23:50:59,276 - lava_callback - DEBUG - Processing node 69b4a2d51727ff69d6f24623: baseline-arm64-baylibre 2026-03-15 23:50:59,276 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b4a2d51727ff69d6f24623 2026-03-15 23:50:59,277 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 23:50:59,315 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b4a2d51727ff69d6f24623 HTTP/1.1" 200 None 2026-03-15 23:50:59,316 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 23:50:59,330 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aef431ce46d8ec186ab81d HTTP/1.1" 200 None 2026-03-15 23:50:59,331 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 23:50:59,373 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b4a2d51727ff69d6f24623 HTTP/1.1" 200 None 2026-03-15 23:50:59,374 - lava_callback - ERROR - Error processing callback for node 69b4a2d51727ff69d6f24623: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:44306 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56478 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56492 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:56498 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33622 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38846 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53114 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58986 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39602 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40604 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40620 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:40626 - "GET / HTTP/1.0" 200 OK 2026-03-15 23:52:19,342 - lava_callback - INFO - Received callback for node 69b4a3241727ff69d6f2462e INFO: 172.21.0.1:40634 - "POST /node/69b4a3241727ff69d6f2462e HTTP/1.0" 202 Accepted 2026-03-15 23:52:19,347 - lava_callback - INFO - Starting async job submit for node 69b4a3241727ff69d6f2462e 2026-03-15 23:52:19,348 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 23:52:19,389 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b4a3241727ff69d6f2462e HTTP/1.1" 200 None 2026-03-15 23:52:19,390 - lava_callback - DEBUG - Processing node 69b4a3241727ff69d6f2462e: baseline-arm64-baylibre 2026-03-15 23:52:19,391 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b4a3241727ff69d6f2462e 2026-03-15 23:52:19,391 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 23:52:19,405 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b4a3241727ff69d6f2462e HTTP/1.1" 200 None 2026-03-15 23:52:19,407 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 23:52:19,420 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aef431ce46d8ec186ab81d HTTP/1.1" 200 None 2026-03-15 23:52:19,422 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 23:52:19,454 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b4a3241727ff69d6f2462e HTTP/1.1" 200 None 2026-03-15 23:52:19,460 - lava_callback - ERROR - Error processing callback for node 69b4a3241727ff69d6f2462e: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:46764 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42400 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52090 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33526 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56644 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53748 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53764 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:53776 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33830 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39302 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40482 - "GET / HTTP/1.0" 200 OK 2026-03-15 23:53:48,713 - lava_callback - INFO - Received callback for node 69b4a3831727ff69d6f24639 INFO: 172.21.0.1:40490 - "POST /node/69b4a3831727ff69d6f24639 HTTP/1.0" 202 Accepted 2026-03-15 23:53:48,719 - lava_callback - INFO - Starting async job submit for node 69b4a3831727ff69d6f24639 2026-03-15 23:53:48,720 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 23:53:48,758 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b4a3831727ff69d6f24639 HTTP/1.1" 200 None 2026-03-15 23:53:48,758 - lava_callback - DEBUG - Processing node 69b4a3831727ff69d6f24639: baseline-arm64-clabbe 2026-03-15 23:53:48,759 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b4a3831727ff69d6f24639 2026-03-15 23:53:48,759 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 23:53:48,773 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b4a3831727ff69d6f24639 HTTP/1.1" 200 None 2026-03-15 23:53:48,774 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 23:53:48,788 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aef431ce46d8ec186ab81d HTTP/1.1" 200 None 2026-03-15 23:53:48,789 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 23:53:48,819 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b4a3831727ff69d6f24639 HTTP/1.1" 200 None 2026-03-15 23:53:48,820 - lava_callback - ERROR - Error processing callback for node 69b4a3831727ff69d6f24639: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:51170 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52800 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44154 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44164 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:44174 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47264 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40916 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37344 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38852 - "GET / HTTP/1.0" 200 OK 2026-03-15 23:54:59,278 - lava_callback - INFO - Received callback for node 69b4a3cf1727ff69d6f24644 INFO: 172.21.0.1:38862 - "POST /node/69b4a3cf1727ff69d6f24644 HTTP/1.0" 202 Accepted 2026-03-15 23:54:59,283 - lava_callback - INFO - Starting async job submit for node 69b4a3cf1727ff69d6f24644 2026-03-15 23:54:59,284 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 23:54:59,302 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b4a3cf1727ff69d6f24644 HTTP/1.1" 200 None 2026-03-15 23:54:59,303 - lava_callback - DEBUG - Processing node 69b4a3cf1727ff69d6f24644: baseline-arm64-baylibre 2026-03-15 23:54:59,303 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b4a3cf1727ff69d6f24644 2026-03-15 23:54:59,304 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 23:54:59,317 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b4a3cf1727ff69d6f24644 HTTP/1.1" 200 None 2026-03-15 23:54:59,319 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 23:54:59,332 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aef431ce46d8ec186ab81d HTTP/1.1" 200 None 2026-03-15 23:54:59,333 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 23:54:59,354 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b4a3cf1727ff69d6f24644 HTTP/1.1" 200 None 2026-03-15 23:54:59,362 - lava_callback - ERROR - Error processing callback for node 69b4a3cf1727ff69d6f24644: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:53364 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54966 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54970 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:54986 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55220 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48586 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59864 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46776 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53628 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33206 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33220 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:33236 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35948 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52080 - "GET / HTTP/1.0" 200 OK 2026-03-15 23:56:39,705 - lava_callback - INFO - Received callback for node 69b4a4241727ff69d6f2464f INFO: 172.21.0.1:40128 - "POST /node/69b4a4241727ff69d6f2464f HTTP/1.0" 202 Accepted 2026-03-15 23:56:39,711 - lava_callback - INFO - Starting async job submit for node 69b4a4241727ff69d6f2464f 2026-03-15 23:56:39,712 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 23:56:39,727 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b4a4241727ff69d6f2464f HTTP/1.1" 200 None 2026-03-15 23:56:39,728 - lava_callback - DEBUG - Processing node 69b4a4241727ff69d6f2464f: baseline-arm64-baylibre 2026-03-15 23:56:39,728 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b4a4241727ff69d6f2464f 2026-03-15 23:56:39,729 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 23:56:39,742 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b4a4241727ff69d6f2464f HTTP/1.1" 200 None 2026-03-15 23:56:39,743 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 23:56:39,783 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aef431ce46d8ec186ab81d HTTP/1.1" 200 None 2026-03-15 23:56:39,785 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 23:56:39,812 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b4a4241727ff69d6f2464f HTTP/1.1" 200 None 2026-03-15 23:56:39,816 - lava_callback - ERROR - Error processing callback for node 69b4a4241727ff69d6f2464f: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:40134 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39142 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34196 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49242 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49254 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:49266 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45474 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58388 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34408 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59174 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48280 - "GET / HTTP/1.0" 200 OK 2026-03-15 23:58:09,518 - lava_callback - INFO - Received callback for node 69b4a4821727ff69d6f2465b INFO: 172.21.0.1:48286 - "POST /node/69b4a4821727ff69d6f2465b HTTP/1.0" 202 Accepted 2026-03-15 23:58:09,524 - lava_callback - INFO - Starting async job submit for node 69b4a4821727ff69d6f2465b 2026-03-15 23:58:09,525 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 23:58:09,541 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b4a4821727ff69d6f2465b HTTP/1.1" 200 None 2026-03-15 23:58:09,542 - lava_callback - DEBUG - Processing node 69b4a4821727ff69d6f2465b: baseline-arm64-clabbe 2026-03-15 23:58:09,542 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b4a4821727ff69d6f2465b 2026-03-15 23:58:09,543 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 23:58:09,557 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b4a4821727ff69d6f2465b HTTP/1.1" 200 None 2026-03-15 23:58:09,559 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 23:58:09,574 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aef431ce46d8ec186ab81d HTTP/1.1" 200 None 2026-03-15 23:58:09,576 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 23:58:09,630 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b4a4821727ff69d6f2465b HTTP/1.1" 200 None 2026-03-15 23:58:09,637 - lava_callback - ERROR - Error processing callback for node 69b4a4821727ff69d6f2465b: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:40532 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40546 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:40550 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49110 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48258 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45286 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40022 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59172 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53866 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53868 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:53878 - "GET / HTTP/1.0" 200 OK 2026-03-15 23:59:19,462 - lava_callback - INFO - Received callback for node 69b4a4d01727ff69d6f24662 INFO: 172.21.0.1:53892 - "POST /node/69b4a4d01727ff69d6f24662 HTTP/1.0" 202 Accepted 2026-03-15 23:59:19,468 - lava_callback - INFO - Starting async job submit for node 69b4a4d01727ff69d6f24662 2026-03-15 23:59:19,468 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 23:59:19,511 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b4a4d01727ff69d6f24662 HTTP/1.1" 200 None 2026-03-15 23:59:19,512 - lava_callback - DEBUG - Processing node 69b4a4d01727ff69d6f24662: baseline-arm64-baylibre 2026-03-15 23:59:19,513 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b4a4d01727ff69d6f24662 2026-03-15 23:59:19,513 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 23:59:19,557 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b4a4d01727ff69d6f24662 HTTP/1.1" 200 None 2026-03-15 23:59:19,559 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 23:59:19,591 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aef431ce46d8ec186ab81d HTTP/1.1" 200 None 2026-03-15 23:59:19,592 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-15 23:59:19,635 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b4a4d01727ff69d6f24662 HTTP/1.1" 200 None 2026-03-15 23:59:19,637 - lava_callback - ERROR - Error processing callback for node 69b4a4d01727ff69d6f24662: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:47140 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55404 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51532 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40264 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38846 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59126 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59138 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:59144 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51500 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43156 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50160 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45124 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53762 - "GET / HTTP/1.0" 200 OK 2026-03-16 00:01:08,994 - lava_callback - INFO - Received callback for node 69b4a5351727ff69d6f2466f INFO: 172.21.0.1:53770 - "POST /node/69b4a5351727ff69d6f2466f HTTP/1.0" 202 Accepted 2026-03-16 00:01:09,003 - lava_callback - INFO - Starting async job submit for node 69b4a5351727ff69d6f2466f 2026-03-16 00:01:09,004 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 00:01:09,027 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b4a5351727ff69d6f2466f HTTP/1.1" 200 None 2026-03-16 00:01:09,028 - lava_callback - DEBUG - Processing node 69b4a5351727ff69d6f2466f: baseline-arm64-clabbe 2026-03-16 00:01:09,029 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b4a5351727ff69d6f2466f 2026-03-16 00:01:09,030 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 00:01:09,050 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b4a5351727ff69d6f2466f HTTP/1.1" 200 None 2026-03-16 00:01:09,052 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 00:01:09,074 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aef431ce46d8ec186ab81d HTTP/1.1" 200 None 2026-03-16 00:01:09,076 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 00:01:09,111 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b4a5351727ff69d6f2466f HTTP/1.1" 200 None 2026-03-16 00:01:09,113 - lava_callback - ERROR - Error processing callback for node 69b4a5351727ff69d6f2466f: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:41826 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41840 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:41856 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38494 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40524 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48358 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40434 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43632 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46262 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46270 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:46284 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59368 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55630 - "GET / HTTP/1.0" 200 OK 2026-03-16 00:02:39,664 - lava_callback - INFO - Received callback for node 69b4a58d1727ff69d6f24679 INFO: 172.21.0.1:55632 - "POST /node/69b4a58d1727ff69d6f24679 HTTP/1.0" 202 Accepted 2026-03-16 00:02:39,669 - lava_callback - INFO - Starting async job submit for node 69b4a58d1727ff69d6f24679 2026-03-16 00:02:39,670 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 00:02:39,696 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b4a58d1727ff69d6f24679 HTTP/1.1" 200 None 2026-03-16 00:02:39,697 - lava_callback - DEBUG - Processing node 69b4a58d1727ff69d6f24679: baseline-arm64-baylibre 2026-03-16 00:02:39,698 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b4a58d1727ff69d6f24679 2026-03-16 00:02:39,698 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 00:02:39,715 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b4a58d1727ff69d6f24679 HTTP/1.1" 200 None 2026-03-16 00:02:39,717 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 00:02:39,731 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aef431ce46d8ec186ab81d HTTP/1.1" 200 None 2026-03-16 00:02:39,733 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 00:02:39,753 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b4a58d1727ff69d6f24679 HTTP/1.1" 200 None 2026-03-16 00:02:39,759 - lava_callback - ERROR - Error processing callback for node 69b4a58d1727ff69d6f24679: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:48794 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56576 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48484 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58190 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58204 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:58206 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52958 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39568 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49710 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47350 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37476 - "GET / HTTP/1.0" 200 OK 2026-03-16 00:04:09,105 - lava_callback - INFO - Received callback for node 69b4a5f11727ff69d6f24682 INFO: 172.21.0.1:37488 - "POST /node/69b4a5f11727ff69d6f24682 HTTP/1.0" 202 Accepted 2026-03-16 00:04:09,110 - lava_callback - INFO - Starting async job submit for node 69b4a5f11727ff69d6f24682 2026-03-16 00:04:09,111 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 00:04:09,126 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b4a5f11727ff69d6f24682 HTTP/1.1" 200 None 2026-03-16 00:04:09,127 - lava_callback - DEBUG - Processing node 69b4a5f11727ff69d6f24682: baseline-arm64-clabbe 2026-03-16 00:04:09,127 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b4a5f11727ff69d6f24682 2026-03-16 00:04:09,128 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 00:04:09,176 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b4a5f11727ff69d6f24682 HTTP/1.1" 200 None 2026-03-16 00:04:09,178 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 00:04:09,214 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aef431ce46d8ec186ab81d HTTP/1.1" 200 None 2026-03-16 00:04:09,215 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 00:04:09,237 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b4a5f11727ff69d6f24682 HTTP/1.1" 200 None 2026-03-16 00:04:09,238 - lava_callback - ERROR - Error processing callback for node 69b4a5f11727ff69d6f24682: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:42656 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42666 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:42680 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45676 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43180 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45994 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47820 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35888 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54308 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54318 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:54330 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40374 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48726 - "GET / HTTP/1.0" 200 OK 2026-03-16 00:05:39,784 - lava_callback - INFO - Received callback for node 69b4a6411727ff69d6f2468d INFO: 172.21.0.1:35704 - "POST /node/69b4a6411727ff69d6f2468d HTTP/1.0" 202 Accepted 2026-03-16 00:05:39,789 - lava_callback - INFO - Starting async job submit for node 69b4a6411727ff69d6f2468d 2026-03-16 00:05:39,790 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 00:05:39,804 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b4a6411727ff69d6f2468d HTTP/1.1" 200 None 2026-03-16 00:05:39,805 - lava_callback - DEBUG - Processing node 69b4a6411727ff69d6f2468d: baseline-arm64-baylibre 2026-03-16 00:05:39,805 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b4a6411727ff69d6f2468d 2026-03-16 00:05:39,806 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 00:05:39,819 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b4a6411727ff69d6f2468d HTTP/1.1" 200 None 2026-03-16 00:05:39,820 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 00:05:39,843 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aef431ce46d8ec186ab81d HTTP/1.1" 200 None 2026-03-16 00:05:39,844 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 00:05:39,865 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b4a6411727ff69d6f2468d HTTP/1.1" 200 None 2026-03-16 00:05:39,870 - lava_callback - ERROR - Error processing callback for node 69b4a6411727ff69d6f2468d: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:35712 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35658 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:32822 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42234 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42244 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:42248 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49166 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34334 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54968 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46476 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43600 - "GET / HTTP/1.0" 200 OK 2026-03-16 00:07:09,207 - lava_callback - INFO - Received callback for node 69b4a69c1727ff69d6f24699 INFO: 172.21.0.1:43614 - "POST /node/69b4a69c1727ff69d6f24699 HTTP/1.0" 202 Accepted 2026-03-16 00:07:09,213 - lava_callback - INFO - Starting async job submit for node 69b4a69c1727ff69d6f24699 2026-03-16 00:07:09,214 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 00:07:09,252 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b4a69c1727ff69d6f24699 HTTP/1.1" 200 None 2026-03-16 00:07:09,253 - lava_callback - DEBUG - Processing node 69b4a69c1727ff69d6f24699: baseline-arm64-clabbe 2026-03-16 00:07:09,254 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b4a69c1727ff69d6f24699 2026-03-16 00:07:09,254 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 00:07:09,280 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b4a69c1727ff69d6f24699 HTTP/1.1" 200 None 2026-03-16 00:07:09,281 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 00:07:09,297 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aef431ce46d8ec186ab81d HTTP/1.1" 200 None 2026-03-16 00:07:09,299 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 00:07:09,322 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b4a69c1727ff69d6f24699 HTTP/1.1" 200 None 2026-03-16 00:07:09,323 - lava_callback - ERROR - Error processing callback for node 69b4a69c1727ff69d6f24699: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:40244 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40256 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:40260 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50602 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40832 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40164 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50398 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55892 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56184 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56194 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:56200 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38574 - "GET / HTTP/1.0" 200 OK 2026-03-16 00:08:29,236 - lava_callback - INFO - Received callback for node 69b4a6f31727ff69d6f246b6 INFO: 172.21.0.1:38588 - "POST /node/69b4a6f31727ff69d6f246b6 HTTP/1.0" 202 Accepted 2026-03-16 00:08:29,246 - lava_callback - INFO - Starting async job submit for node 69b4a6f31727ff69d6f246b6 2026-03-16 00:08:29,247 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 00:08:29,262 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b4a6f31727ff69d6f246b6 HTTP/1.1" 200 None 2026-03-16 00:08:29,263 - lava_callback - DEBUG - Processing node 69b4a6f31727ff69d6f246b6: baseline-arm64-clabbe 2026-03-16 00:08:29,263 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b4a6f31727ff69d6f246b6 2026-03-16 00:08:29,264 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 00:08:29,302 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b4a6f31727ff69d6f246b6 HTTP/1.1" 200 None 2026-03-16 00:08:29,303 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 00:08:29,317 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aef431ce46d8ec186ab81d HTTP/1.1" 200 None 2026-03-16 00:08:29,319 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 00:08:29,369 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b4a6f31727ff69d6f246b6 HTTP/1.1" 200 None 2026-03-16 00:08:29,370 - lava_callback - ERROR - Error processing callback for node 69b4a6f31727ff69d6f246b6: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:45296 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53734 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58394 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50892 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37092 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37102 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:37110 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39470 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54628 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43812 - "GET / HTTP/1.0" 200 OK 2026-03-16 00:09:49,332 - lava_callback - INFO - Received callback for node 69b4a7481727ff69d6f246d2 INFO: 172.21.0.1:43816 - "POST /node/69b4a7481727ff69d6f246d2 HTTP/1.0" 202 Accepted 2026-03-16 00:09:49,337 - lava_callback - INFO - Starting async job submit for node 69b4a7481727ff69d6f246d2 2026-03-16 00:09:49,338 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 00:09:49,381 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b4a7481727ff69d6f246d2 HTTP/1.1" 200 None 2026-03-16 00:09:49,382 - lava_callback - DEBUG - Processing node 69b4a7481727ff69d6f246d2: baseline-arm64-clabbe 2026-03-16 00:09:49,382 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b4a7481727ff69d6f246d2 2026-03-16 00:09:49,382 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 00:09:49,396 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b4a7481727ff69d6f246d2 HTTP/1.1" 200 None 2026-03-16 00:09:49,398 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 00:09:49,431 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aef431ce46d8ec186ab81d HTTP/1.1" 200 None 2026-03-16 00:09:49,432 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 00:09:49,489 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b4a7481727ff69d6f246d2 HTTP/1.1" 200 None 2026-03-16 00:09:49,490 - lava_callback - ERROR - Error processing callback for node 69b4a7481727ff69d6f246d2: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:40982 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58768 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54022 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54032 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:54042 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40086 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51492 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35978 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43220 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52400 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52778 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52784 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:52792 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40672 - "GET / HTTP/1.0" 200 OK 2026-03-16 00:11:29,413 - lava_callback - INFO - Received callback for node 69b4a79d1727ff69d6f246f2 INFO: 172.21.0.1:40688 - "POST /node/69b4a79d1727ff69d6f246f2 HTTP/1.0" 202 Accepted 2026-03-16 00:11:29,419 - lava_callback - INFO - Starting async job submit for node 69b4a79d1727ff69d6f246f2 2026-03-16 00:11:29,420 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 00:11:29,439 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b4a79d1727ff69d6f246f2 HTTP/1.1" 200 None 2026-03-16 00:11:29,440 - lava_callback - DEBUG - Processing node 69b4a79d1727ff69d6f246f2: baseline-arm64-clabbe 2026-03-16 00:11:29,440 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b4a79d1727ff69d6f246f2 2026-03-16 00:11:29,441 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 00:11:29,454 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b4a79d1727ff69d6f246f2 HTTP/1.1" 200 None 2026-03-16 00:11:29,456 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 00:11:29,469 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aef431ce46d8ec186ab81d HTTP/1.1" 200 None 2026-03-16 00:11:29,471 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 00:11:29,492 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b4a79d1727ff69d6f246f2 HTTP/1.1" 200 None 2026-03-16 00:11:29,493 - lava_callback - ERROR - Error processing callback for node 69b4a79d1727ff69d6f246f2: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:54054 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35970 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45808 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53966 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36556 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36564 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:36580 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55596 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55664 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35244 - "GET / HTTP/1.0" 200 OK 2026-03-16 00:12:49,471 - lava_callback - INFO - Received callback for node 69b4a7f21727ff69d6f24712 INFO: 172.21.0.1:35258 - "POST /node/69b4a7f21727ff69d6f24712 HTTP/1.0" 202 Accepted 2026-03-16 00:12:49,477 - lava_callback - INFO - Starting async job submit for node 69b4a7f21727ff69d6f24712 2026-03-16 00:12:49,477 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 00:12:49,515 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b4a7f21727ff69d6f24712 HTTP/1.1" 200 None 2026-03-16 00:12:49,516 - lava_callback - DEBUG - Processing node 69b4a7f21727ff69d6f24712: baseline-arm64-clabbe 2026-03-16 00:12:49,517 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b4a7f21727ff69d6f24712 2026-03-16 00:12:49,517 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 00:12:49,530 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b4a7f21727ff69d6f24712 HTTP/1.1" 200 None 2026-03-16 00:12:49,532 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 00:12:49,589 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aef431ce46d8ec186ab81d HTTP/1.1" 200 None 2026-03-16 00:12:49,591 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 00:12:49,618 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b4a7f21727ff69d6f24712 HTTP/1.1" 200 None 2026-03-16 00:12:49,619 - lava_callback - ERROR - Error processing callback for node 69b4a7f21727ff69d6f24712: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:37844 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40998 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51952 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51964 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:51976 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42360 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56152 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44704 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49322 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39896 - "GET / HTTP/1.0" 200 OK 2026-03-16 00:14:09,545 - lava_callback - INFO - Received callback for node 69b4a8481727ff69d6f24720 INFO: 172.21.0.1:39906 - "POST /node/69b4a8481727ff69d6f24720 HTTP/1.0" 202 Accepted 2026-03-16 00:14:09,551 - lava_callback - INFO - Starting async job submit for node 69b4a8481727ff69d6f24720 2026-03-16 00:14:09,552 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 00:14:09,605 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b4a8481727ff69d6f24720 HTTP/1.1" 200 None 2026-03-16 00:14:09,606 - lava_callback - DEBUG - Processing node 69b4a8481727ff69d6f24720: baseline-arm64-clabbe 2026-03-16 00:14:09,606 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b4a8481727ff69d6f24720 2026-03-16 00:14:09,607 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 00:14:09,623 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b4a8481727ff69d6f24720 HTTP/1.1" 200 None 2026-03-16 00:14:09,625 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 00:14:09,663 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aef431ce46d8ec186ab81d HTTP/1.1" 200 None 2026-03-16 00:14:09,664 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 00:14:09,700 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b4a8481727ff69d6f24720 HTTP/1.1" 200 None 2026-03-16 00:14:09,705 - lava_callback - ERROR - Error processing callback for node 69b4a8481727ff69d6f24720: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:56470 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56486 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:56498 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45768 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53168 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43836 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39912 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41012 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57632 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57646 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:57658 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44198 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59420 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50548 - "GET / HTTP/1.0" 200 OK 2026-03-16 00:15:49,681 - lava_callback - INFO - Received callback for node 69b4a8a01727ff69d6f24728 INFO: 172.21.0.1:50554 - "POST /node/69b4a8a01727ff69d6f24728 HTTP/1.0" 202 Accepted 2026-03-16 00:15:49,686 - lava_callback - INFO - Starting async job submit for node 69b4a8a01727ff69d6f24728 2026-03-16 00:15:49,687 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 00:15:49,709 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b4a8a01727ff69d6f24728 HTTP/1.1" 200 None 2026-03-16 00:15:49,710 - lava_callback - DEBUG - Processing node 69b4a8a01727ff69d6f24728: baseline-arm64-clabbe 2026-03-16 00:15:49,710 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b4a8a01727ff69d6f24728 2026-03-16 00:15:49,710 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 00:15:49,732 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b4a8a01727ff69d6f24728 HTTP/1.1" 200 None 2026-03-16 00:15:49,734 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 00:15:49,781 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aef431ce46d8ec186ab81d HTTP/1.1" 200 None 2026-03-16 00:15:49,783 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 00:15:49,804 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b4a8a01727ff69d6f24728 HTTP/1.1" 200 None 2026-03-16 00:15:49,809 - lava_callback - ERROR - Error processing callback for node 69b4a8a01727ff69d6f24728: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:58366 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46636 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56322 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56328 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:56340 - "GET / HTTP/1.0" 200 OK